2023-10-08T11:44:41.518 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-08T11:44:41.519 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down pg-warn} tasks/{0-client 1-tests/fscrypt-common}} --archive /home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417909 --name pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi --verbose --owner scheduled_pdonnell@teuthology -- /home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417909/orig.config.yaml 2023-10-08T11:44:41.572 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-08T11:44:41.662 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417909 branch: wip-batrick-testing-20231007.154158 description: fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down pg-warn} tasks/{0-client 1-tests/fscrypt-common}} email: pdonnell@redhat.com first_in_suite: false job_id: '7417909' kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-batrick-testing-20231007.154158 ceph: cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: global: mon pg warn min per osd: 0 ms die on skipped message: false mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - Reduced data availability - Degraded data redundancy - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 7b3143bae3b6870a749bfb9810ed6e7d0e89d7de ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 7b3143bae3b6870a749bfb9810ed6e7d0e89d7de kclient: syntax: v2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-batrick-testing-20231007.154158 sha1: 7b3143bae3b6870a749bfb9810ed6e7d0e89d7de owner: scheduled_pdonnell@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 - - client.0 seed: 8022 sha1: 7b3143bae3b6870a749bfb9810ed6e7d0e89d7de sleep_before_teardown: 0 subset: 128/256 suite: fs suite_branch: wip-batrick-testing-20231007.154158 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 7b3143bae3b6870a749bfb9810ed6e7d0e89d7de syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi062.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIaUqRNPzeivdAVjFxbTE7aegqU+fsew94mFIIW4Bbrcm+dCuxqbCKl38HqySkaqYTzzpw/J8xgW7f5TdvCZPFI= smithi130.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIji4vv7exnV643mesL2el1iARgG8BVYXW8k+rqmDyCXXRYO0qoq1qd8SQ0ndb4WJWo+zcvGXJKzjZpE5rsCLZ0= smithi156.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOlORvHIdXG0sJbmFe/N9QLhlHbr6DQQcMN4J6HH+Pco0bSoxOugndRHezHtmbyKJXwrplayFWNCdyetZ4wHuG0= task: null tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_fscrypt teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end - if not is_kupstream() then reject() end teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-10-07_20:01:29 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-08T11:44:41.663 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/qa; will attempt to use it 2023-10-08T11:44:41.663 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/qa/tasks 2023-10-08T11:44:41.664 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-08T11:44:41.665 INFO:teuthology.task.internal:Checking packages... 2023-10-08T11:44:41.688 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '7b3143bae3b6870a749bfb9810ed6e7d0e89d7de' 2023-10-08T11:44:41.688 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-08T11:44:41.688 INFO:teuthology.packaging:ref: None 2023-10-08T11:44:41.688 INFO:teuthology.packaging:tag: None 2023-10-08T11:44:41.689 INFO:teuthology.packaging:branch: wip-batrick-testing-20231007.154158 2023-10-08T11:44:41.689 INFO:teuthology.packaging:sha1: 7b3143bae3b6870a749bfb9810ed6e7d0e89d7de 2023-10-08T11:44:41.689 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-batrick-testing-20231007.154158 2023-10-08T11:44:41.832 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-6639-g7b3143ba-1jammy 2023-10-08T11:44:41.832 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-08T11:44:41.838 INFO:teuthology.task.internal:no buildpackages task found 2023-10-08T11:44:41.838 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-08T11:44:41.843 INFO:teuthology.task.internal:Saving configuration 2023-10-08T11:44:41.862 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-08T11:44:41.867 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-08T11:44:41.891 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi062.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417909', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 11:38:53.676959', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIL+7hs9YCHVtiWf4o0ixaQgRut4+TVnPC3nSUFXq36CL'} 2023-10-08T11:44:41.912 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi130.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417909', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 11:38:53.678419', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBFOT7+49FY4JHPF4GJB1POAlRCvounlRZh8xIn6udjj'} 2023-10-08T11:44:41.935 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi156.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417909', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 11:38:53.679556', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDgupPhkNQRrCnn71kh4nSBOk+UwEblOP7OEgndPnQtM'} 2023-10-08T11:44:41.935 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-08T11:44:41.941 INFO:teuthology.task.internal:roles: ubuntu@smithi062.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2023-10-08T11:44:41.942 INFO:teuthology.task.internal:roles: ubuntu@smithi130.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2023-10-08T11:44:41.942 INFO:teuthology.task.internal:roles: ubuntu@smithi156.front.sepia.ceph.com - ['client.0'] 2023-10-08T11:44:41.942 INFO:teuthology.run_tasks:Running task console_log... 2023-10-08T11:44:42.050 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb2af49eb80>, signals=[15]) 2023-10-08T11:44:42.051 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-08T11:44:42.060 INFO:teuthology.task.internal:Opening connections... 2023-10-08T11:44:42.060 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi062.front.sepia.ceph.com 2023-10-08T11:44:42.062 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T11:44:42.139 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi130.front.sepia.ceph.com 2023-10-08T11:44:42.140 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T11:44:42.214 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi156.front.sepia.ceph.com 2023-10-08T11:44:42.215 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T11:44:42.288 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-08T11:44:42.294 DEBUG:teuthology.orchestra.run.smithi062:> uname -m 2023-10-08T11:44:42.299 INFO:teuthology.orchestra.run.smithi062.stdout:x86_64 2023-10-08T11:44:42.300 DEBUG:teuthology.orchestra.run.smithi062:> cat /etc/os-release 2023-10-08T11:44:42.347 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-10-08T11:44:42.348 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="Ubuntu" 2023-10-08T11:44:42.348 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="22.04" 2023-10-08T11:44:42.348 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-10-08T11:44:42.348 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_CODENAME=jammy 2023-10-08T11:44:42.348 INFO:teuthology.orchestra.run.smithi062.stdout:ID=ubuntu 2023-10-08T11:44:42.348 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE=debian 2023-10-08T11:44:42.348 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-08T11:44:42.348 INFO:teuthology.orchestra.run.smithi062.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-08T11:44:42.348 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-08T11:44:42.348 INFO:teuthology.orchestra.run.smithi062.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-08T11:44:42.348 INFO:teuthology.orchestra.run.smithi062.stdout:UBUNTU_CODENAME=jammy 2023-10-08T11:44:42.349 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server 2023-10-08T11:44:42.375 DEBUG:teuthology.orchestra.run.smithi130:> uname -m 2023-10-08T11:44:42.380 INFO:teuthology.orchestra.run.smithi130.stdout:x86_64 2023-10-08T11:44:42.381 DEBUG:teuthology.orchestra.run.smithi130:> cat /etc/os-release 2023-10-08T11:44:42.428 INFO:teuthology.orchestra.run.smithi130.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-10-08T11:44:42.428 INFO:teuthology.orchestra.run.smithi130.stdout:NAME="Ubuntu" 2023-10-08T11:44:42.428 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION_ID="22.04" 2023-10-08T11:44:42.428 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-10-08T11:44:42.428 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION_CODENAME=jammy 2023-10-08T11:44:42.429 INFO:teuthology.orchestra.run.smithi130.stdout:ID=ubuntu 2023-10-08T11:44:42.429 INFO:teuthology.orchestra.run.smithi130.stdout:ID_LIKE=debian 2023-10-08T11:44:42.429 INFO:teuthology.orchestra.run.smithi130.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-08T11:44:42.429 INFO:teuthology.orchestra.run.smithi130.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-08T11:44:42.429 INFO:teuthology.orchestra.run.smithi130.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-08T11:44:42.429 INFO:teuthology.orchestra.run.smithi130.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-08T11:44:42.429 INFO:teuthology.orchestra.run.smithi130.stdout:UBUNTU_CODENAME=jammy 2023-10-08T11:44:42.429 INFO:teuthology.lock.ops:Updating smithi130.front.sepia.ceph.com on lock server 2023-10-08T11:44:42.449 DEBUG:teuthology.orchestra.run.smithi156:> uname -m 2023-10-08T11:44:42.455 INFO:teuthology.orchestra.run.smithi156.stdout:x86_64 2023-10-08T11:44:42.455 DEBUG:teuthology.orchestra.run.smithi156:> cat /etc/os-release 2023-10-08T11:44:42.503 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-10-08T11:44:42.503 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="Ubuntu" 2023-10-08T11:44:42.503 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="22.04" 2023-10-08T11:44:42.503 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-10-08T11:44:42.503 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_CODENAME=jammy 2023-10-08T11:44:42.503 INFO:teuthology.orchestra.run.smithi156.stdout:ID=ubuntu 2023-10-08T11:44:42.503 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE=debian 2023-10-08T11:44:42.503 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-08T11:44:42.503 INFO:teuthology.orchestra.run.smithi156.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-08T11:44:42.504 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-08T11:44:42.504 INFO:teuthology.orchestra.run.smithi156.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-08T11:44:42.504 INFO:teuthology.orchestra.run.smithi156.stdout:UBUNTU_CODENAME=jammy 2023-10-08T11:44:42.504 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server 2023-10-08T11:44:42.524 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-08T11:44:42.535 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-08T11:44:42.539 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-08T11:44:42.539 DEBUG:teuthology.orchestra.run.smithi062:> test '!' -e /home/ubuntu/cephtest 2023-10-08T11:44:42.542 DEBUG:teuthology.orchestra.run.smithi130:> test '!' -e /home/ubuntu/cephtest 2023-10-08T11:44:42.544 DEBUG:teuthology.orchestra.run.smithi156:> test '!' -e /home/ubuntu/cephtest 2023-10-08T11:44:42.550 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-08T11:44:42.558 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-08T11:44:42.559 DEBUG:teuthology.orchestra.run.smithi062:> test -z $(ls -A /var/lib/ceph) 2023-10-08T11:44:42.589 DEBUG:teuthology.orchestra.run.smithi130:> test -z $(ls -A /var/lib/ceph) 2023-10-08T11:44:42.591 DEBUG:teuthology.orchestra.run.smithi156:> test -z $(ls -A /var/lib/ceph) 2023-10-08T11:44:42.692 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-08T11:44:42.762 INFO:teuthology.run_tasks:Running task kernel... 2023-10-08T11:44:42.777 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2023-10-08T11:44:42.778 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2023-10-08T11:44:42.778 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2023-10-08T11:44:42.778 DEBUG:teuthology.orchestra.run.smithi156:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-08T11:44:42.783 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T11:44:42.783 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2023-10-08T11:44:43.038 DEBUG:teuthology.task.kernel:sha1 for client.0 is fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-08T11:44:43.038 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c"... 2023-10-08T11:44:43.038 DEBUG:teuthology.orchestra.run.smithi156:> uname -r 2023-10-08T11:44:43.043 INFO:teuthology.orchestra.run.smithi156.stdout:5.15.0-56-generic 2023-10-08T11:44:43.044 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-08T11:44:43.044 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-10-08T11:44:43.044 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2023-10-08T11:44:43.044 DEBUG:teuthology.orchestra.run.smithi156:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-10-08T11:44:43.104 INFO:teuthology.orchestra.run.smithi156.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2023-10-08T11:44:43.244 INFO:teuthology.orchestra.run.smithi156.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2023-10-08T11:44:43.244 INFO:teuthology.orchestra.run.smithi156.stderr:hint: is subject to change. To configure the initial branch name to use in all 2023-10-08T11:44:43.244 INFO:teuthology.orchestra.run.smithi156.stderr:hint: of your new repositories, which will suppress this warning, call: 2023-10-08T11:44:43.244 INFO:teuthology.orchestra.run.smithi156.stderr:hint: 2023-10-08T11:44:43.244 INFO:teuthology.orchestra.run.smithi156.stderr:hint: git config --global init.defaultBranch 2023-10-08T11:44:43.245 INFO:teuthology.orchestra.run.smithi156.stderr:hint: 2023-10-08T11:44:43.245 INFO:teuthology.orchestra.run.smithi156.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2023-10-08T11:44:43.245 INFO:teuthology.orchestra.run.smithi156.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2023-10-08T11:44:43.245 INFO:teuthology.orchestra.run.smithi156.stderr:hint: 2023-10-08T11:44:43.245 INFO:teuthology.orchestra.run.smithi156.stderr:hint: git branch -m 2023-10-08T11:44:43.246 INFO:teuthology.orchestra.run.smithi156.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-10-08T11:44:43.248 DEBUG:teuthology.orchestra.run.smithi156:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-10-08T11:44:43.314 DEBUG:teuthology.orchestra.run.smithi156:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-10-08T11:44:43.367 DEBUG:teuthology.orchestra.run.smithi156:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-10-08T11:45:33.299 INFO:teuthology.orchestra.run.smithi156.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-10-08T11:45:33.299 INFO:teuthology.orchestra.run.smithi156.stderr: * [new branch] main -> origin/main 2023-10-08T11:45:33.330 INFO:teuthology.orchestra.run.smithi156.stderr: * [new tag] 20190312 -> 20190312 2023-10-08T11:45:33.330 INFO:teuthology.orchestra.run.smithi156.stderr: * [new tag] 20190416 -> 20190416 2023-10-08T11:45:33.330 INFO:teuthology.orchestra.run.smithi156.stderr: * [new tag] 20190514 -> 20190514 2023-10-08T11:45:33.330 INFO:teuthology.orchestra.run.smithi156.stderr: * [new tag] 20190618 -> 20190618 2023-10-08T11:45:33.331 INFO:teuthology.orchestra.run.smithi156.stderr: * [new tag] 20190717 -> 20190717 2023-10-08T11:45:33.331 INFO:teuthology.orchestra.run.smithi156.stderr: * [new tag] 20190815 -> 20190815 2023-10-08T11:45:33.331 INFO:teuthology.orchestra.run.smithi156.stderr: * [new tag] 20190923 -> 20190923 2023-10-08T11:45:33.331 INFO:teuthology.orchestra.run.smithi156.stderr: * [new tag] 20191022 -> 20191022 2023-10-08T11:45:33.331 INFO:teuthology.orchestra.run.smithi156.stderr: * [new tag] 20191215 -> 20191215 2023-10-08T11:45:33.338 INFO:teuthology.orchestra.run.smithi156.stderr: * [new tag] 20200122 -> 20200122 2023-10-08T11:45:33.338 INFO:teuthology.orchestra.run.smithi156.stderr: * [new tag] 20200316 -> 20200316 2023-10-08T11:45:33.338 INFO:teuthology.orchestra.run.smithi156.stderr: * [new tag] 20200421 -> 20200421 2023-10-08T11:45:33.338 INFO:teuthology.orchestra.run.smithi156.stderr: * [new tag] 20200519 -> 20200519 2023-10-08T11:45:33.338 INFO:teuthology.orchestra.run.smithi156.stderr: * [new tag] 20200619 -> 20200619 2023-10-08T11:45:33.339 INFO:teuthology.orchestra.run.smithi156.stderr: * [new tag] 20200721 -> 20200721 2023-10-08T11:45:33.339 INFO:teuthology.orchestra.run.smithi156.stderr: * [new tag] 20200817 -> 20200817 2023-10-08T11:45:33.339 INFO:teuthology.orchestra.run.smithi156.stderr: * [new tag] 20200918 -> 20200918 2023-10-08T11:45:33.339 INFO:teuthology.orchestra.run.smithi156.stderr: * [new tag] 20201022 -> 20201022 2023-10-08T11:45:33.339 INFO:teuthology.orchestra.run.smithi156.stderr: * [new tag] 20201118 -> 20201118 2023-10-08T11:45:33.339 INFO:teuthology.orchestra.run.smithi156.stderr: * [new tag] 20201218 -> 20201218 2023-10-08T11:45:33.340 INFO:teuthology.orchestra.run.smithi156.stderr: * [new tag] 20210208 -> 20210208 2023-10-08T11:45:33.340 INFO:teuthology.orchestra.run.smithi156.stderr: * [new tag] 20210315 -> 20210315 2023-10-08T11:45:33.340 INFO:teuthology.orchestra.run.smithi156.stderr: * [new tag] 20210511 -> 20210511 2023-10-08T11:45:33.340 INFO:teuthology.orchestra.run.smithi156.stderr: * [new tag] 20210716 -> 20210716 2023-10-08T11:45:33.340 INFO:teuthology.orchestra.run.smithi156.stderr: * [new tag] 20210818 -> 20210818 2023-10-08T11:45:33.340 INFO:teuthology.orchestra.run.smithi156.stderr: * [new tag] 20210919 -> 20210919 2023-10-08T11:45:33.341 INFO:teuthology.orchestra.run.smithi156.stderr: * [new tag] 20211027 -> 20211027 2023-10-08T11:45:33.341 INFO:teuthology.orchestra.run.smithi156.stderr: * [new tag] 20211216 -> 20211216 2023-10-08T11:45:33.341 INFO:teuthology.orchestra.run.smithi156.stderr: * [new tag] 20220209 -> 20220209 2023-10-08T11:45:33.341 INFO:teuthology.orchestra.run.smithi156.stderr: * [new tag] 20220310 -> 20220310 2023-10-08T11:45:33.341 INFO:teuthology.orchestra.run.smithi156.stderr: * [new tag] 20220411 -> 20220411 2023-10-08T11:45:33.341 INFO:teuthology.orchestra.run.smithi156.stderr: * [new tag] 20220509 -> 20220509 2023-10-08T11:45:33.342 INFO:teuthology.orchestra.run.smithi156.stderr: * [new tag] 20220610 -> 20220610 2023-10-08T11:45:33.342 INFO:teuthology.orchestra.run.smithi156.stderr: * [new tag] 20220708 -> 20220708 2023-10-08T11:45:33.342 INFO:teuthology.orchestra.run.smithi156.stderr: * [new tag] 20220815 -> 20220815 2023-10-08T11:45:33.342 INFO:teuthology.orchestra.run.smithi156.stderr: * [new tag] 20220913 -> 20220913 2023-10-08T11:45:33.342 INFO:teuthology.orchestra.run.smithi156.stderr: * [new tag] 20221012 -> 20221012 2023-10-08T11:45:33.342 INFO:teuthology.orchestra.run.smithi156.stderr: * [new tag] 20221109 -> 20221109 2023-10-08T11:45:33.343 INFO:teuthology.orchestra.run.smithi156.stderr: * [new tag] 20221214 -> 20221214 2023-10-08T11:45:33.343 INFO:teuthology.orchestra.run.smithi156.stderr: * [new tag] 20230117 -> 20230117 2023-10-08T11:45:33.343 INFO:teuthology.orchestra.run.smithi156.stderr: * [new tag] 20230210 -> 20230210 2023-10-08T11:45:33.343 INFO:teuthology.orchestra.run.smithi156.stderr: * [new tag] 20230310 -> 20230310 2023-10-08T11:45:33.343 INFO:teuthology.orchestra.run.smithi156.stderr: * [new tag] 20230404 -> 20230404 2023-10-08T11:45:33.343 INFO:teuthology.orchestra.run.smithi156.stderr: * [new tag] 20230515 -> 20230515 2023-10-08T11:45:33.344 INFO:teuthology.orchestra.run.smithi156.stderr: * [new tag] 20230625 -> 20230625 2023-10-08T11:45:33.344 INFO:teuthology.orchestra.run.smithi156.stderr: * [new tag] 20230804 -> 20230804 2023-10-08T11:45:33.344 INFO:teuthology.orchestra.run.smithi156.stderr: * [new tag] 20230919 -> 20230919 2023-10-08T11:45:37.034 INFO:teuthology.orchestra.run.smithi156.stderr:Updating files: 51% (1622/3158) Updating files: 52% (1643/3158) Updating files: 53% (1674/3158) Updating files: 54% (1706/3158) Updating files: 55% (1737/3158) Updating files: 56% (1769/3158) Updating files: 57% (1801/3158) Updating files: 58% (1832/3158) Updating files: 59% (1864/3158) Updating files: 60% (1895/3158) Updating files: 61% (1927/3158) Updating files: 62% (1958/3158) Updating files: 63% (1990/3158) Updating files: 64% (2022/3158) Updating files: 65% (2053/3158) Updating files: 66% (2085/3158) Updating files: 66% (2103/3158) Updating files: 67% (2116/3158) Updating files: 68% (2148/3158) Updating files: 69% (2180/3158) Updating files: 70% (2211/3158) Updating files: 71% (2243/3158) Updating files: 72% (2274/3158) Updating files: 73% (2306/3158) Updating files: 74% (2337/3158) Updating files: 75% (2369/3158) Updating files: 76% (2401/3158) Updating files: 77% (2432/3158) Updating files: 78% (2464/3158) Updating files: 79% (2495/3158) Updating files: 80% (2527/3158) Updating files: 81% (2558/3158) Updating files: 81% (2586/3158) Updating files: 82% (2590/3158) Updating files: 83% (2622/3158) Updating files: 84% (2653/3158) Updating files: 85% (2685/3158) Updating files: 86% (2716/3158) Updating files: 87% (2748/3158) Updating files: 88% (2780/3158) Updating files: 89% (2811/3158) Updating files: 90% (2843/3158) Updating files: 91% (2874/3158) Updating files: 92% (2906/3158) Updating files: 93% (2937/3158) Updating files: 94% (2969/3158) Updating files: 95% (3001/3158) Updating files: 96% (3032/3158) Updating files: 97% (3064/3158) Updating files: 98% (3095/3158) Updating files: 99% (3127/3158) Updating files: 100% (3158/3158) Updating files: 100% (3158/3158), done. 2023-10-08T11:45:37.039 INFO:teuthology.orchestra.run.smithi156.stdout:HEAD is now at 7727f7e3 Merge branch 'patch-1696561325' into 'main' 2023-10-08T11:45:37.059 INFO:teuthology.task.kernel:Downloading kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on client.0... 2023-10-08T11:45:37.059 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-08T11:45:37.213 INFO:teuthology.task.kernel:fetching, builder baseurl is https://1.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/ubuntu/jammy/flavors/default/pool/main/l/linux-6.5.0-rc7-gfef64f93da2b/ 2023-10-08T11:45:37.214 DEBUG:teuthology.orchestra.run.smithi156:> rm -f /tmp/linux-image.deb && echo linux-image-6.5.0-rc7-gfef64f93da2b_6.5.0-rc7-gfef64f93da2b-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://1.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/ubuntu/jammy/flavors/default/pool/main/l/linux-6.5.0-rc7-gfef64f93da2b/ --input-file=- 2023-10-08T11:45:37.223 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi156.front.sepia.ceph.com to complete... 2023-10-08T11:45:38.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-08 11:45:39 URL:https://1.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/ubuntu/jammy/flavors/default/pool/main/l/linux-6.5.0-rc7-gfef64f93da2b/linux-image-6.5.0-rc7-gfef64f93da2b_6.5.0-rc7-gfef64f93da2b-1_amd64.deb [38830450/38830450] -> "/tmp/linux-image.deb" [1] 2023-10-08T11:45:38.992 INFO:teuthology.orchestra.run.smithi156.stderr:FINISHED --2023-10-08 11:45:39-- 2023-10-08T11:45:38.992 INFO:teuthology.orchestra.run.smithi156.stderr:Total wall clock time: 1.7s 2023-10-08T11:45:38.992 INFO:teuthology.orchestra.run.smithi156.stderr:Downloaded: 1 files, 37M in 1.6s (22.9 MB/s) 2023-10-08T11:45:38.995 INFO:teuthology.task.kernel:Installing kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on client.0... 2023-10-08T11:45:38.995 DEBUG:teuthology.orchestra.run.smithi156:> sudo dpkg -i /tmp/linux-image.deb 2023-10-08T11:45:39.248 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package linux-image-6.5.0-rc7-gfef64f93da2b. 2023-10-08T11:45:41.257 INFO:teuthology.orchestra.run.smithi156.stdout:(Reading database ... 129542 files and directories currently installed.) 2023-10-08T11:45:41.262 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-10-08T11:45:41.473 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking linux-image-6.5.0-rc7-gfef64f93da2b (6.5.0-rc7-gfef64f93da2b-1) ... 2023-10-08T11:45:44.464 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up linux-image-6.5.0-rc7-gfef64f93da2b (6.5.0-rc7-gfef64f93da2b-1) ... 2023-10-08T11:45:44.573 INFO:teuthology.orchestra.run.smithi156.stderr:update-initramfs: Generating /boot/initrd.img-6.5.0-rc7-gfef64f93da2b 2023-10-08T11:46:03.804 INFO:teuthology.orchestra.run.smithi156.stderr:Sourcing file `/etc/default/grub' 2023-10-08T11:46:03.812 INFO:teuthology.orchestra.run.smithi156.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-08T11:46:03.837 INFO:teuthology.orchestra.run.smithi156.stderr:Generating grub configuration file ... 2023-10-08T11:46:04.153 INFO:teuthology.orchestra.run.smithi156.stderr:Found linux image: /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b 2023-10-08T11:46:04.167 INFO:teuthology.orchestra.run.smithi156.stderr:Found initrd image: /boot/initrd.img-6.5.0-rc7-gfef64f93da2b 2023-10-08T11:46:04.449 INFO:teuthology.orchestra.run.smithi156.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-10-08T11:46:04.456 INFO:teuthology.orchestra.run.smithi156.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-10-08T11:46:04.520 INFO:teuthology.orchestra.run.smithi156.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-10-08T11:46:04.525 INFO:teuthology.orchestra.run.smithi156.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-10-08T11:46:04.685 INFO:teuthology.orchestra.run.smithi156.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-10-08T11:46:04.685 INFO:teuthology.orchestra.run.smithi156.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-10-08T11:46:04.685 INFO:teuthology.orchestra.run.smithi156.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-10-08T11:46:04.730 INFO:teuthology.orchestra.run.smithi156.stderr:done 2023-10-08T11:46:04.915 DEBUG:teuthology.orchestra.run.smithi156:> dpkg-deb -c /tmp/linux-image.deb 2023-10-08T11:46:04.923 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./ 2023-10-08T11:46:04.923 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./boot/ 2023-10-08T11:46:04.923 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 4382168 2023-09-11 01:59 ./boot/System.map-6.5.0-rc7-gfef64f93da2b 2023-10-08T11:46:04.934 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 168454 2023-09-11 01:59 ./boot/config-6.5.0-rc7-gfef64f93da2b 2023-10-08T11:46:04.935 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11294016 2023-09-11 01:59 ./boot/vmlinuz-6.5.0-rc7-gfef64f93da2b 2023-10-08T11:46:04.956 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./etc/ 2023-10-08T11:46:04.956 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./etc/kernel/ 2023-10-08T11:46:04.957 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./etc/kernel/postinst.d/ 2023-10-08T11:46:04.957 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./etc/kernel/postrm.d/ 2023-10-08T11:46:04.957 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./etc/kernel/preinst.d/ 2023-10-08T11:46:04.957 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./etc/kernel/prerm.d/ 2023-10-08T11:46:04.957 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/ 2023-10-08T11:46:04.957 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/ 2023-10-08T11:46:04.957 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/ 2023-10-08T11:46:04.957 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/ 2023-10-08T11:46:04.957 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/ 2023-10-08T11:46:04.957 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/ 2023-10-08T11:46:04.957 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/ 2023-10-08T11:46:04.958 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 490385 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/aesni-intel.ko 2023-10-08T11:46:04.958 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 25329 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-10-08T11:46:04.958 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 29529 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-10-08T11:46:04.958 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 30313 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-10-08T11:46:04.958 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 93113 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-10-08T11:46:04.959 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 106729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-10-08T11:46:04.959 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 152241 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-10-08T11:46:04.959 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 12553 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-10-08T11:46:04.959 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13777 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-10-08T11:46:04.959 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 83889 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-10-08T11:46:04.959 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 18625 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-10-08T11:46:04.960 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 47225 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-10-08T11:46:04.960 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 47209 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx2.ko 2023-10-08T11:46:04.960 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 51801 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-10-08T11:46:04.960 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 38937 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-10-08T11:46:04.960 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 40529 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-10-08T11:46:04.960 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 58585 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-10-08T11:46:04.960 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 50497 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-10-08T11:46:04.961 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 32065 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-10-08T11:46:04.961 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13625 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-10-08T11:46:04.961 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/ 2023-10-08T11:46:04.961 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/ 2023-10-08T11:46:04.961 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce/ 2023-10-08T11:46:04.961 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 40113 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-10-08T11:46:04.962 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13281 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpuid.ko 2023-10-08T11:46:04.962 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 17865 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/msr.ko 2023-10-08T11:46:04.962 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/ 2023-10-08T11:46:04.962 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 348201 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-amd.ko 2023-10-08T11:46:05.050 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 882105 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-intel.ko 2023-10-08T11:46:05.051 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 2277369 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm.ko 2023-10-08T11:46:05.051 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ 2023-10-08T11:46:05.051 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 53585 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/af_alg.ko 2023-10-08T11:46:05.051 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 23097 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/algif_hash.ko 2023-10-08T11:46:05.051 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 20049 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/algif_skcipher.ko 2023-10-08T11:46:05.051 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 17209 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ansi_cprng.ko 2023-10-08T11:46:05.051 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 19641 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/anubis.ko 2023-10-08T11:46:05.051 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 10145 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/arc4.ko 2023-10-08T11:46:05.051 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/asymmetric_keys/ 2023-10-08T11:46:05.051 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 10185 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-10-08T11:46:05.052 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/ 2023-10-08T11:46:05.052 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11249 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_memcpy.ko 2023-10-08T11:46:05.052 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 19473 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_pq.ko 2023-10-08T11:46:05.052 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 21561 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_raid6_recov.ko 2023-10-08T11:46:05.052 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13825 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_tx.ko 2023-10-08T11:46:05.052 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 17745 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_xor.ko 2023-10-08T11:46:05.052 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 17921 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/raid6test.ko 2023-10-08T11:46:05.052 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 20489 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authenc.ko 2023-10-08T11:46:05.052 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 22641 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authencesn.ko 2023-10-08T11:46:05.052 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 21817 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blake2b_generic.ko 2023-10-08T11:46:05.052 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 12729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_common.ko 2023-10-08T11:46:05.052 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 10537 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_generic.ko 2023-10-08T11:46:05.053 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 38873 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/camellia_generic.ko 2023-10-08T11:46:05.053 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 27321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast5_generic.ko 2023-10-08T11:46:05.053 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 17745 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast6_generic.ko 2023-10-08T11:46:05.053 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 10537 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast_common.ko 2023-10-08T11:46:05.053 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 35097 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ccm.ko 2023-10-08T11:46:05.053 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 14769 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cmac.ko 2023-10-08T11:46:05.053 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 9585 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crc32_generic.ko 2023-10-08T11:46:05.053 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 46961 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cryptd.ko 2023-10-08T11:46:05.053 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 25249 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_engine.ko 2023-10-08T11:46:05.053 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 26953 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_simd.ko 2023-10-08T11:46:05.053 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 24737 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_user.ko 2023-10-08T11:46:05.054 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 17729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cts.ko 2023-10-08T11:46:05.054 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 10913 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/des_generic.ko 2023-10-08T11:46:05.054 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 15681 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/dh_generic.ko 2023-10-08T11:46:05.054 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11001 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/echainiv.ko 2023-10-08T11:46:05.054 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 25321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/essiv.ko 2023-10-08T11:46:05.054 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 17993 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/fcrypt.ko 2023-10-08T11:46:05.054 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 26897 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/khazad.ko 2023-10-08T11:46:05.054 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 15649 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lrw.ko 2023-10-08T11:46:05.054 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11513 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4.ko 2023-10-08T11:46:05.054 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11529 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4hc.ko 2023-10-08T11:46:05.054 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11761 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/md4.ko 2023-10-08T11:46:05.054 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 9729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/michael_mic.ko 2023-10-08T11:46:05.055 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 10673 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcbc.ko 2023-10-08T11:46:05.055 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 18745 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcrypt.ko 2023-10-08T11:46:05.055 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 16049 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/rmd160.ko 2023-10-08T11:46:05.055 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 29393 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/seed.ko 2023-10-08T11:46:05.055 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 27081 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/serpent_generic.ko 2023-10-08T11:46:05.055 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 149193 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tcrypt.ko 2023-10-08T11:46:05.055 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 10881 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tea.ko 2023-10-08T11:46:05.055 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 28777 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_common.ko 2023-10-08T11:46:05.055 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13233 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_generic.ko 2023-10-08T11:46:05.055 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 17401 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/vmac.ko 2023-10-08T11:46:05.055 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 36185 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/wp512.ko 2023-10-08T11:46:05.055 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 14105 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xcbc.ko 2023-10-08T11:46:05.056 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 26665 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xor.ko 2023-10-08T11:46:05.056 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 18713 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xts.ko 2023-10-08T11:46:05.056 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 9481 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xxhash_generic.ko 2023-10-08T11:46:05.056 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ 2023-10-08T11:46:05.056 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/ 2023-10-08T11:46:05.056 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 18249 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_extlog.ko 2023-10-08T11:46:05.056 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 26969 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_ipmi.ko 2023-10-08T11:46:05.056 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 28793 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_pad.ko 2023-10-08T11:46:05.056 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/apei/ 2023-10-08T11:46:05.056 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 31241 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/apei/einj.ko 2023-10-08T11:46:05.056 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 12801 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/ec_sys.ko 2023-10-08T11:46:05.056 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 14937 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/platform_profile.ko 2023-10-08T11:46:05.057 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 24401 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbs.ko 2023-10-08T11:46:05.057 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 19521 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbshc.ko 2023-10-08T11:46:05.057 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 100401 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/video.ko 2023-10-08T11:46:05.057 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ 2023-10-08T11:46:05.057 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 21473 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/acard-ahci.ko 2023-10-08T11:46:05.057 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 88625 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ahci.ko 2023-10-08T11:46:05.057 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 14593 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ahci_platform.ko 2023-10-08T11:46:05.057 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 87841 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/libahci.ko 2023-10-08T11:46:05.057 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 35049 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/libahci_platform.ko 2023-10-08T11:46:05.057 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 17009 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_acpi.ko 2023-10-08T11:46:05.057 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 30553 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ali.ko 2023-10-08T11:46:05.057 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 33625 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_amd.ko 2023-10-08T11:46:05.058 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 21201 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_artop.ko 2023-10-08T11:46:05.058 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 21049 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atiixp.ko 2023-10-08T11:46:05.058 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 24809 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atp867x.ko 2023-10-08T11:46:05.058 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 17585 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd640.ko 2023-10-08T11:46:05.058 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 25241 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd64x.ko 2023-10-08T11:46:05.058 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 14921 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cypress.ko 2023-10-08T11:46:05.058 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 17721 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_efar.ko 2023-10-08T11:46:05.058 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 21809 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt366.ko 2023-10-08T11:46:05.058 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 34033 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt37x.ko 2023-10-08T11:46:05.058 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 23057 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x2n.ko 2023-10-08T11:46:05.058 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 16793 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x3.ko 2023-10-08T11:46:05.059 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 16857 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it8213.ko 2023-10-08T11:46:05.059 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 35177 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it821x.ko 2023-10-08T11:46:05.059 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 12753 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_jmicron.ko 2023-10-08T11:46:05.059 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 51737 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_legacy.ko 2023-10-08T11:46:05.059 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 15057 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_marvell.ko 2023-10-08T11:46:05.059 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 16153 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_mpiix.ko 2023-10-08T11:46:05.059 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 12705 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_netcell.ko 2023-10-08T11:46:05.059 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 16681 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ninja32.ko 2023-10-08T11:46:05.059 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 14969 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87410.ko 2023-10-08T11:46:05.059 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 17225 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87415.ko 2023-10-08T11:46:05.059 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 16433 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_oldpiix.ko 2023-10-08T11:46:05.059 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 15249 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_opti.ko 2023-10-08T11:46:05.059 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 20609 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_optidma.ko 2023-10-08T11:46:05.060 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 32521 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pcmcia.ko 2023-10-08T11:46:05.060 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 37729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc2027x.ko 2023-10-08T11:46:05.060 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 20489 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-10-08T11:46:05.060 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 14097 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_piccolo.ko 2023-10-08T11:46:05.060 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 15321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_radisys.ko 2023-10-08T11:46:05.060 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 19449 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_rdc.ko 2023-10-08T11:46:05.060 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 15201 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_rz1000.ko 2023-10-08T11:46:05.060 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13809 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sch.ko 2023-10-08T11:46:05.060 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 23001 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_serverworks.ko 2023-10-08T11:46:05.060 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 23385 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sil680.ko 2023-10-08T11:46:05.060 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 19569 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sl82c105.ko 2023-10-08T11:46:05.060 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 15881 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_triflex.ko 2023-10-08T11:46:05.061 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 30425 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_via.ko 2023-10-08T11:46:05.061 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 22729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pdc_adma.ko 2023-10-08T11:46:05.061 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 28993 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_inic162x.ko 2023-10-08T11:46:05.061 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 83225 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_mv.ko 2023-10-08T11:46:05.061 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 70537 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_nv.ko 2023-10-08T11:46:05.061 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 37369 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_promise.ko 2023-10-08T11:46:05.061 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 22969 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_qstor.ko 2023-10-08T11:46:05.061 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 29201 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil.ko 2023-10-08T11:46:05.061 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 38273 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil24.ko 2023-10-08T11:46:05.061 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 17873 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sis.ko 2023-10-08T11:46:05.061 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 20305 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_svw.ko 2023-10-08T11:46:05.061 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 44721 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sx4.ko 2023-10-08T11:46:05.062 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 15465 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_uli.ko 2023-10-08T11:46:05.062 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 35121 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_via.ko 2023-10-08T11:46:05.062 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 20001 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_vsc.ko 2023-10-08T11:46:05.062 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay/ 2023-10-08T11:46:05.062 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 16289 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay/ks0108.ko 2023-10-08T11:46:05.062 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma/ 2023-10-08T11:46:05.062 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 124457 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma/bcma.ko 2023-10-08T11:46:05.062 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/ 2023-10-08T11:46:05.062 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe/ 2023-10-08T11:46:05.062 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 113705 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe/aoe.ko 2023-10-08T11:46:05.062 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd/ 2023-10-08T11:46:05.063 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 968433 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd/drbd.ko 2023-10-08T11:46:05.063 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 173201 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/floppy.ko 2023-10-08T11:46:05.063 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx/ 2023-10-08T11:46:05.063 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 94297 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-10-08T11:46:05.063 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 115345 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/nbd.ko 2023-10-08T11:46:05.063 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk/ 2023-10-08T11:46:05.063 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 110361 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk/null_blk.ko 2023-10-08T11:46:05.063 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 98225 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/pktcdvd.ko 2023-10-08T11:46:05.063 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 259401 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/rbd.ko 2023-10-08T11:46:05.063 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback/ 2023-10-08T11:46:05.063 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 98129 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-10-08T11:46:05.063 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram/ 2023-10-08T11:46:05.064 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 60265 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram/zram.ko 2023-10-08T11:46:05.064 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ 2023-10-08T11:46:05.064 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 30849 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/applicom.ko 2023-10-08T11:46:05.064 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 12009 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hangcheck-timer.ko 2023-10-08T11:46:05.064 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/ 2023-10-08T11:46:05.064 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13889 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/amd-rng.ko 2023-10-08T11:46:05.064 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 18809 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/intel-rng.ko 2023-10-08T11:46:05.064 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13385 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-10-08T11:46:05.064 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 10673 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/via-rng.ko 2023-10-08T11:46:05.064 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 15633 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/virtio-rng.ko 2023-10-08T11:46:05.064 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ 2023-10-08T11:46:05.064 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 30857 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-10-08T11:46:05.065 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 150665 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-10-08T11:46:05.065 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 26561 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-10-08T11:46:05.065 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 139057 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_si.ko 2023-10-08T11:46:05.065 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 70833 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-10-08T11:46:05.065 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 53609 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-10-08T11:46:05.065 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 36321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/lp.ko 2023-10-08T11:46:05.065 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave/ 2023-10-08T11:46:05.065 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 84121 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave/mwave.ko 2023-10-08T11:46:05.065 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 25873 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/nvram.ko 2023-10-08T11:46:05.065 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 32169 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ppdev.ko 2023-10-08T11:46:05.065 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 51113 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tlclk.ko 2023-10-08T11:46:05.065 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/ 2023-10-08T11:46:05.066 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 16401 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_atmel.ko 2023-10-08T11:46:05.066 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 15881 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-10-08T11:46:05.066 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 23473 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-10-08T11:46:05.066 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 32985 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-10-08T11:46:05.066 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 30121 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_infineon.ko 2023-10-08T11:46:05.066 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 22697 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_nsc.ko 2023-10-08T11:46:05.066 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 23561 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-10-08T11:46:05.066 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/xillybus/ 2023-10-08T11:46:05.066 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 16985 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/xillybus/xillybus_class.ko 2023-10-08T11:46:05.066 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 50945 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/xillybus/xillybus_core.ko 2023-10-08T11:46:05.066 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 12393 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-10-08T11:46:05.066 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/clk/ 2023-10-08T11:46:05.067 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 12489 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/clk/clk-palmas.ko 2023-10-08T11:46:05.067 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 47849 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/clk/clk-si5351.ko 2023-10-08T11:46:05.067 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11457 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/clk/clk-twl6040.ko 2023-10-08T11:46:05.067 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 19313 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/clk/clk-wm831x.ko 2023-10-08T11:46:05.067 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/ 2023-10-08T11:46:05.067 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 10097 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-10-08T11:46:05.067 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 16833 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/p4-clockmod.ko 2023-10-08T11:46:05.067 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 25297 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/speedstep-lib.ko 2023-10-08T11:46:05.067 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ 2023-10-08T11:46:05.067 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ 2023-10-08T11:46:05.067 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 70785 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-10-08T11:46:05.067 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 234473 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp.ko 2023-10-08T11:46:05.068 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/ 2023-10-08T11:46:05.068 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/ 2023-10-08T11:46:05.068 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common/ 2023-10-08T11:46:05.068 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 408489 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-10-08T11:46:05.068 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-10-08T11:46:05.068 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 23657 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-10-08T11:46:05.068 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 19937 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-aes.ko 2023-10-08T11:46:05.068 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 21537 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-sha.ko 2023-10-08T11:46:05.068 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio/ 2023-10-08T11:46:05.068 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 68937 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-10-08T11:46:05.068 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca/ 2023-10-08T11:46:05.069 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 29785 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca/dca.ko 2023-10-08T11:46:05.069 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ 2023-10-08T11:46:05.069 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw/ 2023-10-08T11:46:05.069 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 15857 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw/dw_dmac.ko 2023-10-08T11:46:05.069 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat/ 2023-10-08T11:46:05.069 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 122641 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat/ioatdma.ko 2023-10-08T11:46:05.069 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/ 2023-10-08T11:46:05.069 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 80273 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/amd64_edac.ko 2023-10-08T11:46:05.069 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 35769 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/e752x_edac.ko 2023-10-08T11:46:05.069 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 63617 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/edac_mce_amd.ko 2023-10-08T11:46:05.069 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 18105 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3000_edac.ko 2023-10-08T11:46:05.069 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 18065 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3200_edac.ko 2023-10-08T11:46:05.069 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 22537 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5100_edac.ko 2023-10-08T11:46:05.070 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 25657 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5400_edac.ko 2023-10-08T11:46:05.070 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 24913 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7300_edac.ko 2023-10-08T11:46:05.070 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 52025 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7core_edac.ko 2023-10-08T11:46:05.070 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 18433 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i82975x_edac.ko 2023-10-08T11:46:05.070 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 20017 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/ie31200_edac.ko 2023-10-08T11:46:05.070 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 56809 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/sb_edac.ko 2023-10-08T11:46:05.070 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 17529 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/x38_edac.ko 2023-10-08T11:46:05.070 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/extcon/ 2023-10-08T11:46:05.070 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 12673 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/extcon/extcon-gpio.ko 2023-10-08T11:46:05.070 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 27185 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/extcon/extcon-max14577.ko 2023-10-08T11:46:05.070 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 29569 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/extcon/extcon-max77693.ko 2023-10-08T11:46:05.071 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 24745 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/extcon/extcon-max8997.ko 2023-10-08T11:46:05.071 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 26537 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/extcon/extcon-palmas.ko 2023-10-08T11:46:05.071 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 23713 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/extcon/extcon-rt8973a.ko 2023-10-08T11:46:05.071 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 27785 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/extcon/extcon-sm5502.ko 2023-10-08T11:46:05.071 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/ 2023-10-08T11:46:05.071 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 34953 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/dmi-sysfs.ko 2023-10-08T11:46:05.071 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/efi/ 2023-10-08T11:46:05.071 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 15521 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/efi/efi-pstore.ko 2023-10-08T11:46:05.071 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 20889 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/iscsi_ibft.ko 2023-10-08T11:46:05.071 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/ 2023-10-08T11:46:05.071 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 12305 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-adp5520.ko 2023-10-08T11:46:05.071 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 20153 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-amd8111.ko 2023-10-08T11:46:05.072 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 14993 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-arizona.ko 2023-10-08T11:46:05.072 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13841 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-da9052.ko 2023-10-08T11:46:05.072 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11921 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-da9055.ko 2023-10-08T11:46:05.072 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 22065 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-dln2.ko 2023-10-08T11:46:05.072 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 77849 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-f7188x.ko 2023-10-08T11:46:05.072 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 28649 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-generic.ko 2023-10-08T11:46:05.072 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 19569 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-ich.ko 2023-10-08T11:46:05.072 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11969 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-10-08T11:46:05.072 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 14113 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-kempld.ko 2023-10-08T11:46:05.072 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 12673 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-lp3943.ko 2023-10-08T11:46:05.072 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 9505 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-max7300.ko 2023-10-08T11:46:05.072 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11969 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-max730x.ko 2023-10-08T11:46:05.073 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 18577 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-max732x.ko 2023-10-08T11:46:05.073 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 25145 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-10-08T11:46:05.073 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 46761 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-pca953x.ko 2023-10-08T11:46:05.073 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 26833 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-pcf857x.ko 2023-10-08T11:46:05.073 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 14377 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-rdc321x.ko 2023-10-08T11:46:05.073 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 20593 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-sch.ko 2023-10-08T11:46:05.073 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 19505 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-sch311x.ko 2023-10-08T11:46:05.073 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 12145 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-tps65912.ko 2023-10-08T11:46:05.073 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 21057 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-twl4030.ko 2023-10-08T11:46:05.073 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11425 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-twl6040.ko 2023-10-08T11:46:05.073 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 20601 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-viperboard.ko 2023-10-08T11:46:05.073 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 15449 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-vx855.ko 2023-10-08T11:46:05.073 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 16281 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-wm831x.ko 2023-10-08T11:46:05.074 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11617 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-wm8350.ko 2023-10-08T11:46:05.074 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 16753 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-wm8994.ko 2023-10-08T11:46:05.074 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/ 2023-10-08T11:46:05.074 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11577 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-a4tech.ko 2023-10-08T11:46:05.074 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 39081 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-apple.ko 2023-10-08T11:46:05.074 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 14481 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-appleir.ko 2023-10-08T11:46:05.074 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 8353 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-aureal.ko 2023-10-08T11:46:05.074 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 15169 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-axff.ko 2023-10-08T11:46:05.074 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11049 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-belkin.ko 2023-10-08T11:46:05.074 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 10313 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-cherry.ko 2023-10-08T11:46:05.075 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 16041 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-chicony.ko 2023-10-08T11:46:05.075 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 59145 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-cp2112.ko 2023-10-08T11:46:05.075 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11049 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-cypress.ko 2023-10-08T11:46:05.075 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 16385 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-dr.ko 2023-10-08T11:46:05.075 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 10697 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elecom.ko 2023-10-08T11:46:05.075 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 17665 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elo.ko 2023-10-08T11:46:05.075 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13457 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-emsff.ko 2023-10-08T11:46:05.075 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 10105 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-ezkey.ko 2023-10-08T11:46:05.075 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 14305 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gaff.ko 2023-10-08T11:46:05.075 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 9225 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-generic.ko 2023-10-08T11:46:05.075 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 17129 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gt683r.ko 2023-10-08T11:46:05.075 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 12681 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gyration.ko 2023-10-08T11:46:05.075 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 9881 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-kbd.ko 2023-10-08T11:46:05.076 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 10457 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-mouse.ko 2023-10-08T11:46:05.076 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 14449 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtekff.ko 2023-10-08T11:46:05.076 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 19105 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-hyperv.ko 2023-10-08T11:46:05.076 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 10489 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-icade.ko 2023-10-08T11:46:05.076 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 9241 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-kensington.ko 2023-10-08T11:46:05.076 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 8545 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-keytouch.ko 2023-10-08T11:46:05.076 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 17201 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-kye.ko 2023-10-08T11:46:05.076 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 10809 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lcpower.ko 2023-10-08T11:46:05.076 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 20497 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-led.ko 2023-10-08T11:46:05.076 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 42297 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lenovo.ko 2023-10-08T11:46:05.076 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 30761 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lg-g15.ko 2023-10-08T11:46:05.076 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 57809 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-dj.ko 2023-10-08T11:46:05.077 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 101009 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-10-08T11:46:05.077 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 80993 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech.ko 2023-10-08T11:46:05.077 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 30801 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-magicmouse.ko 2023-10-08T11:46:05.077 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 21969 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-microsoft.ko 2023-10-08T11:46:05.077 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 10361 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-monterey.ko 2023-10-08T11:46:05.077 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 50153 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-multitouch.ko 2023-10-08T11:46:05.077 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 32593 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-ntrig.ko 2023-10-08T11:46:05.077 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 8857 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-ortek.ko 2023-10-08T11:46:05.077 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 9121 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-penmount.ko 2023-10-08T11:46:05.077 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 12289 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-petalynx.ko 2023-10-08T11:46:05.077 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 72937 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-picolcd.ko 2023-10-08T11:46:05.077 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 14225 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-pl.ko 2023-10-08T11:46:05.078 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 15105 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-plantronics.ko 2023-10-08T11:46:05.078 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 8417 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-primax.ko 2023-10-08T11:46:05.078 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 35457 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-rmi.ko 2023-10-08T11:46:05.078 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 20761 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-arvo.ko 2023-10-08T11:46:05.078 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 14065 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-common.ko 2023-10-08T11:46:05.078 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 31361 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-isku.ko 2023-10-08T11:46:05.078 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 29657 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kone.ko 2023-10-08T11:46:05.078 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 31065 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-10-08T11:46:05.078 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 21097 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-konepure.ko 2023-10-08T11:46:05.078 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 29417 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-10-08T11:46:05.078 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13305 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-lua.ko 2023-10-08T11:46:05.079 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 29241 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-pyra.ko 2023-10-08T11:46:05.079 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 27889 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-ryos.ko 2023-10-08T11:46:05.079 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 19473 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-savu.ko 2023-10-08T11:46:05.079 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 23393 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat.ko 2023-10-08T11:46:05.079 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13681 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-saitek.ko 2023-10-08T11:46:05.079 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 15193 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-samsung.ko 2023-10-08T11:46:05.079 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 36801 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sensor-hub.ko 2023-10-08T11:46:05.079 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13601 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sjoy.ko 2023-10-08T11:46:05.079 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 51201 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sony.ko 2023-10-08T11:46:05.079 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 8313 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-speedlink.ko 2023-10-08T11:46:05.079 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 14881 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-steelseries.ko 2023-10-08T11:46:05.079 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 9817 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sunplus.ko 2023-10-08T11:46:05.079 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 16993 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-thrustmaster.ko 2023-10-08T11:46:05.080 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 10537 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tivo.ko 2023-10-08T11:46:05.080 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 15089 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tmff.ko 2023-10-08T11:46:05.080 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 14385 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-topseed.ko 2023-10-08T11:46:05.080 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 16473 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-twinhan.ko 2023-10-08T11:46:05.080 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 71457 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-uclogic.ko 2023-10-08T11:46:05.080 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 10921 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-waltop.ko 2023-10-08T11:46:05.080 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 143585 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-wiimote.ko 2023-10-08T11:46:05.080 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 8153 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-xinmo.ko 2023-10-08T11:46:05.080 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zpff.ko 2023-10-08T11:46:05.080 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 16665 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zydacron.ko 2023-10-08T11:46:05.080 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 267689 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid.ko 2023-10-08T11:46:05.080 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 32321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/uhid.ko 2023-10-08T11:46:05.081 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/usbhid/ 2023-10-08T11:46:05.081 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 125721 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/usbhid/usbhid.ko 2023-10-08T11:46:05.081 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 19137 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/usbhid/usbkbd.ko 2023-10-08T11:46:05.081 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 14953 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/usbhid/usbmouse.ko 2023-10-08T11:46:05.081 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 217401 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/wacom.ko 2023-10-08T11:46:05.081 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/ 2023-10-08T11:46:05.081 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 63497 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_balloon.ko 2023-10-08T11:46:05.081 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 89609 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_utils.ko 2023-10-08T11:46:05.081 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 301449 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_vmbus.ko 2023-10-08T11:46:05.081 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ 2023-10-08T11:46:05.081 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 66593 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru.ko 2023-10-08T11:46:05.081 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 61393 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru3.ko 2023-10-08T11:46:05.082 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 34745 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/acpi_power_meter.ko 2023-10-08T11:46:05.082 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 17505 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7414.ko 2023-10-08T11:46:05.082 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 19313 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7418.ko 2023-10-08T11:46:05.082 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 25257 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adc128d818.ko 2023-10-08T11:46:05.082 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 31729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1025.ko 2023-10-08T11:46:05.082 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 97977 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1026.ko 2023-10-08T11:46:05.082 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 19745 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1029.ko 2023-10-08T11:46:05.082 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 45553 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1031.ko 2023-10-08T11:46:05.082 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 26289 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm9240.ko 2023-10-08T11:46:05.082 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 14769 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ads7828.ko 2023-10-08T11:46:05.082 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 10769 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7410.ko 2023-10-08T11:46:05.083 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 22049 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7411.ko 2023-10-08T11:46:05.083 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 74433 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7462.ko 2023-10-08T11:46:05.083 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 39585 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7470.ko 2023-10-08T11:46:05.083 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 67929 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7475.ko 2023-10-08T11:46:05.083 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 19625 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7x10.ko 2023-10-08T11:46:05.083 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 39073 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/amc6821.ko 2023-10-08T11:46:05.083 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 55265 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/applesmc.ko 2023-10-08T11:46:05.083 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 49913 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asb100.ko 2023-10-08T11:46:05.083 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 58617 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asc7621.ko 2023-10-08T11:46:05.083 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 40881 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asus_atk0110.ko 2023-10-08T11:46:05.083 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 17225 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/atxp1.ko 2023-10-08T11:46:05.083 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 28281 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/coretemp.ko 2023-10-08T11:46:05.083 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 24657 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/da9052-hwmon.ko 2023-10-08T11:46:05.084 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 17265 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/da9055-hwmon.ko 2023-10-08T11:46:05.084 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 44465 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-10-08T11:46:05.084 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 99601 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dme1737.ko 2023-10-08T11:46:05.084 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 19489 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds1621.ko 2023-10-08T11:46:05.084 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 15321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds620.ko 2023-10-08T11:46:05.084 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 29777 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc1403.ko 2023-10-08T11:46:05.084 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 33185 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc2103.ko 2023-10-08T11:46:05.084 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 30321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc6w201.ko 2023-10-08T11:46:05.084 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 66985 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71805f.ko 2023-10-08T11:46:05.084 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 94457 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71882fg.ko 2023-10-08T11:46:05.084 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 41401 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f75375s.ko 2023-10-08T11:46:05.084 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 21305 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fam15h_power.ko 2023-10-08T11:46:05.085 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 55433 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fschmd.ko 2023-10-08T11:46:05.085 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 14481 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g760a.ko 2023-10-08T11:46:05.085 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 24017 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g762.ko 2023-10-08T11:46:05.085 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 46801 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl518sm.ko 2023-10-08T11:46:05.085 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 45529 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl520sm.ko 2023-10-08T11:46:05.085 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13273 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/hih6130.ko 2023-10-08T11:46:05.085 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 9745 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/hwmon-vid.ko 2023-10-08T11:46:05.085 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11553 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5500_temp.ko 2023-10-08T11:46:05.085 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 22601 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5k_amb.ko 2023-10-08T11:46:05.085 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 34505 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmaem.ko 2023-10-08T11:46:05.085 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 21297 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmpex.ko 2023-10-08T11:46:05.085 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 24873 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina209.ko 2023-10-08T11:46:05.085 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13401 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina2xx.ko 2023-10-08T11:46:05.086 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 129217 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/it87.ko 2023-10-08T11:46:05.086 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 18841 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/jc42.ko 2023-10-08T11:46:05.086 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 24025 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k10temp.ko 2023-10-08T11:46:05.086 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13553 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k8temp.ko 2023-10-08T11:46:05.086 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 18929 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lineage-pem.ko 2023-10-08T11:46:05.086 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 48601 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm63.ko 2023-10-08T11:46:05.086 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 16761 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm73.ko 2023-10-08T11:46:05.086 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 36777 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm75.ko 2023-10-08T11:46:05.086 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 19537 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm77.ko 2023-10-08T11:46:05.086 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 34657 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm78.ko 2023-10-08T11:46:05.086 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 31745 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm80.ko 2023-10-08T11:46:05.087 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 16889 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm83.ko 2023-10-08T11:46:05.087 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 72833 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm85.ko 2023-10-08T11:46:05.087 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 46153 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm87.ko 2023-10-08T11:46:05.087 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 37913 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm90.ko 2023-10-08T11:46:05.087 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 19745 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm92.ko 2023-10-08T11:46:05.087 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 108841 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm93.ko 2023-10-08T11:46:05.087 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 33393 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95234.ko 2023-10-08T11:46:05.087 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 16265 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95241.ko 2023-10-08T11:46:05.087 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 18113 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95245.ko 2023-10-08T11:46:05.087 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 24017 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc2945.ko 2023-10-08T11:46:05.087 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13793 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4151.ko 2023-10-08T11:46:05.087 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 15193 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4215.ko 2023-10-08T11:46:05.088 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 14953 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4222.ko 2023-10-08T11:46:05.088 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 14825 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4245.ko 2023-10-08T11:46:05.088 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13249 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4260.ko 2023-10-08T11:46:05.088 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 14993 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4261.ko 2023-10-08T11:46:05.088 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 33489 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max16065.ko 2023-10-08T11:46:05.088 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 18433 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1619.ko 2023-10-08T11:46:05.088 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 24353 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1668.ko 2023-10-08T11:46:05.088 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 19969 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max197.ko 2023-10-08T11:46:05.088 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 26617 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6639.ko 2023-10-08T11:46:05.088 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 23321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6650.ko 2023-10-08T11:46:05.088 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 35777 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6697.ko 2023-10-08T11:46:05.088 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 18585 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/mc13783-adc.ko 2023-10-08T11:46:05.088 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 10585 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/mcp3021.ko 2023-10-08T11:46:05.089 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 15937 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-10-08T11:46:05.089 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 44129 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6683.ko 2023-10-08T11:46:05.089 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 116697 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775-core.ko 2023-10-08T11:46:05.089 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 60705 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775.ko 2023-10-08T11:46:05.089 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 59737 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct7802.ko 2023-10-08T11:46:05.089 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 82337 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87360.ko 2023-10-08T11:46:05.089 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 54433 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87427.ko 2023-10-08T11:46:05.089 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 18473 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pcf8591.ko 2023-10-08T11:46:05.089 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ 2023-10-08T11:46:05.089 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 21353 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-10-08T11:46:05.089 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 17065 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-10-08T11:46:05.089 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 28329 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-10-08T11:46:05.090 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 9577 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max16064.ko 2023-10-08T11:46:05.090 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 17657 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max34440.ko 2023-10-08T11:46:05.090 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 10169 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max8688.ko 2023-10-08T11:46:05.090 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 15505 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-10-08T11:46:05.090 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 81841 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-10-08T11:46:05.090 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 8729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-10-08T11:46:05.090 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 30729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-10-08T11:46:05.090 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 15073 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-10-08T11:46:05.090 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 20681 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-10-08T11:46:05.090 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13017 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/powr1220.ko 2023-10-08T11:46:05.090 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 18705 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5627.ko 2023-10-08T11:46:05.090 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 28817 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5636.ko 2023-10-08T11:46:05.091 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 27145 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch56xx-common.ko 2023-10-08T11:46:05.091 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 32137 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht15.ko 2023-10-08T11:46:05.091 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13505 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht21.ko 2023-10-08T11:46:05.091 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 16833 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/shtc1.ko 2023-10-08T11:46:05.091 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 40105 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sis5595.ko 2023-10-08T11:46:05.091 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 31929 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smm665.ko 2023-10-08T11:46:05.091 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 19577 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47b397.ko 2023-10-08T11:46:05.091 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 39193 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m1.ko 2023-10-08T11:46:05.091 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 37385 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m192.ko 2023-10-08T11:46:05.091 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 26553 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/thmc50.ko 2023-10-08T11:46:05.091 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 17057 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp102.ko 2023-10-08T11:46:05.091 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 14097 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp103.ko 2023-10-08T11:46:05.092 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 21257 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp401.ko 2023-10-08T11:46:05.092 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 19537 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp421.ko 2023-10-08T11:46:05.092 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 19697 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via-cputemp.ko 2023-10-08T11:46:05.092 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 41945 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via686a.ko 2023-10-08T11:46:05.092 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 52457 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt1211.ko 2023-10-08T11:46:05.092 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 51545 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt8231.ko 2023-10-08T11:46:05.092 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 57513 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627ehf.ko 2023-10-08T11:46:05.092 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 78873 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627hf.ko 2023-10-08T11:46:05.092 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 71345 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83781d.ko 2023-10-08T11:46:05.092 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 63289 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83791d.ko 2023-10-08T11:46:05.092 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 71321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83792d.ko 2023-10-08T11:46:05.092 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 101457 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83793.ko 2023-10-08T11:46:05.093 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 119505 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83795.ko 2023-10-08T11:46:05.093 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 17313 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l785ts.ko 2023-10-08T11:46:05.093 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 35625 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l786ng.ko 2023-10-08T11:46:05.093 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13825 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-10-08T11:46:05.093 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 10625 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-10-08T11:46:05.093 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/ 2023-10-08T11:46:05.093 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/ 2023-10-08T11:46:05.093 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 20049 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-10-08T11:46:05.093 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 19345 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-10-08T11:46:05.093 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/ 2023-10-08T11:46:05.093 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 27969 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-10-08T11:46:05.093 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 28801 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-10-08T11:46:05.094 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 27777 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-10-08T11:46:05.094 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 17937 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-10-08T11:46:05.094 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 26193 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-10-08T11:46:05.094 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 16201 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-10-08T11:46:05.094 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 15153 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-10-08T11:46:05.094 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 6929 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-10-08T11:46:05.094 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13961 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-10-08T11:46:05.094 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 48641 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-10-08T11:46:05.094 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 23905 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-10-08T11:46:05.094 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 20001 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-10-08T11:46:05.094 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 17337 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-10-08T11:46:05.094 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 12393 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-10-08T11:46:05.095 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 17585 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-10-08T11:46:05.095 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 62729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-i801.ko 2023-10-08T11:46:05.095 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 22433 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-isch.ko 2023-10-08T11:46:05.095 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 47889 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-10-08T11:46:05.095 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 17369 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-10-08T11:46:05.095 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 17881 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-10-08T11:46:05.095 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 22337 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-10-08T11:46:05.095 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 26329 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-10-08T11:46:05.095 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 25121 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-parport.ko 2023-10-08T11:46:05.095 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 16497 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-10-08T11:46:05.095 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 47241 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-10-08T11:46:05.095 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 15289 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-10-08T11:46:05.095 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 18649 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-10-08T11:46:05.096 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11809 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-10-08T11:46:05.096 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 22313 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-10-08T11:46:05.096 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 29361 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-10-08T11:46:05.096 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 20329 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-10-08T11:46:05.096 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 19241 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-10-08T11:46:05.096 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 19809 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-10-08T11:46:05.096 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13801 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-via.ko 2023-10-08T11:46:05.096 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 26081 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-10-08T11:46:05.096 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 19041 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-10-08T11:46:05.096 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 47593 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-10-08T11:46:05.096 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 22385 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-mux.ko 2023-10-08T11:46:05.097 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 18825 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-smbus.ko 2023-10-08T11:46:05.097 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 27065 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-stub.ko 2023-10-08T11:46:05.097 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/muxes/ 2023-10-08T11:46:05.097 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 14785 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-10-08T11:46:05.097 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13457 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-10-08T11:46:05.097 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 26865 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-10-08T11:46:05.097 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ 2023-10-08T11:46:05.097 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ 2023-10-08T11:46:05.097 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 273641 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_cm.ko 2023-10-08T11:46:05.097 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 876913 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_core.ko 2023-10-08T11:46:05.097 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 69321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_umad.ko 2023-10-08T11:46:05.097 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 324145 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-10-08T11:46:05.098 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 97961 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/iw_cm.ko 2023-10-08T11:46:05.098 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 279345 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_cm.ko 2023-10-08T11:46:05.098 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 66177 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-10-08T11:46:05.098 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/ 2023-10-08T11:46:05.098 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4/ 2023-10-08T11:46:05.098 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 492569 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-10-08T11:46:05.098 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4/ 2023-10-08T11:46:05.098 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 419193 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-10-08T11:46:05.098 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5/ 2023-10-08T11:46:05.098 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 739705 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-10-08T11:46:05.098 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca/ 2023-10-08T11:46:05.098 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 296649 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-10-08T11:46:05.099 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/ocrdma/ 2023-10-08T11:46:05.099 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 153681 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-10-08T11:46:05.099 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/usnic/ 2023-10-08T11:46:05.099 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 169017 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-10-08T11:46:05.099 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ 2023-10-08T11:46:05.099 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib/ 2023-10-08T11:46:05.099 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 263177 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-10-08T11:46:05.099 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser/ 2023-10-08T11:46:05.099 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 100225 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-10-08T11:46:05.099 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert/ 2023-10-08T11:46:05.099 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 111993 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-10-08T11:46:05.099 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp/ 2023-10-08T11:46:05.099 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 129081 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-10-08T11:46:05.100 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt/ 2023-10-08T11:46:05.100 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 129553 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-10-08T11:46:05.100 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/ 2023-10-08T11:46:05.100 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 10745 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/evbug.ko 2023-10-08T11:46:05.100 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 24129 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/ff-memless.ko 2023-10-08T11:46:05.100 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/ 2023-10-08T11:46:05.100 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11881 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-10-08T11:46:05.100 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 12145 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/fm801-gp.ko 2023-10-08T11:46:05.100 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 41217 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/gameport.ko 2023-10-08T11:46:05.100 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 12497 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/lightning.ko 2023-10-08T11:46:05.100 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 17529 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/ns558.ko 2023-10-08T11:46:05.100 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 41825 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/joydev.ko 2023-10-08T11:46:05.101 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/ 2023-10-08T11:46:05.101 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13313 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-10-08T11:46:05.101 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 30441 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-10-08T11:46:05.101 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 26905 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-10-08T11:46:05.101 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 24761 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-10-08T11:46:05.101 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 36649 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/gpio_keys.ko 2023-10-08T11:46:05.101 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 18273 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-10-08T11:46:05.101 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 21257 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/lkkbd.ko 2023-10-08T11:46:05.101 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 28121 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/lm8323.ko 2023-10-08T11:46:05.101 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 15113 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/lm8333.ko 2023-10-08T11:46:05.101 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 24265 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-10-08T11:46:05.101 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 18217 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-10-08T11:46:05.101 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 15897 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-10-08T11:46:05.102 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 16489 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-10-08T11:46:05.102 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11585 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/newtonkbd.ko 2023-10-08T11:46:05.102 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11073 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-10-08T11:46:05.102 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 15209 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/qt1070.ko 2023-10-08T11:46:05.102 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 21121 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/qt2160.ko 2023-10-08T11:46:05.102 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 23817 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-10-08T11:46:05.102 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11481 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/stowaway.ko 2023-10-08T11:46:05.102 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 18289 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/sunkbd.ko 2023-10-08T11:46:05.102 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 20729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-10-08T11:46:05.102 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 16177 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-10-08T11:46:05.102 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 16801 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-10-08T11:46:05.102 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11753 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/xtkbd.ko 2023-10-08T11:46:05.103 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11465 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/matrix-keymap.ko 2023-10-08T11:46:05.103 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/ 2023-10-08T11:46:05.103 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 34329 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/appletouch.ko 2023-10-08T11:46:05.103 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 34177 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/bcm5974.ko 2023-10-08T11:46:05.103 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 123681 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/cyapatp.ko 2023-10-08T11:46:05.103 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 89449 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/elan_i2c.ko 2023-10-08T11:46:05.103 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 14025 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/gpio_mouse.ko 2023-10-08T11:46:05.103 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 335849 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/psmouse.ko 2023-10-08T11:46:05.103 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 14681 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/sermouse.ko 2023-10-08T11:46:05.103 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 23881 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-10-08T11:46:05.103 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 22569 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_usb.ko 2023-10-08T11:46:05.103 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 15665 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/vsxxxaa.ko 2023-10-08T11:46:05.104 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4/ 2023-10-08T11:46:05.104 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 109849 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4/rmi_core.ko 2023-10-08T11:46:05.104 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/ 2023-10-08T11:46:05.104 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11665 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/altera_ps2.ko 2023-10-08T11:46:05.104 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 16289 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/arc_ps2.ko 2023-10-08T11:46:05.104 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 16425 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/ct82c710.ko 2023-10-08T11:46:05.104 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 16953 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-10-08T11:46:05.104 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 15833 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/parkbd.ko 2023-10-08T11:46:05.104 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13225 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/pcips2.ko 2023-10-08T11:46:05.104 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 20153 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/ps2mult.ko 2023-10-08T11:46:05.104 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 24129 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/serio_raw.ko 2023-10-08T11:46:05.104 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 17977 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/serport.ko 2023-10-08T11:46:05.104 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13337 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/sparse-keymap.ko 2023-10-08T11:46:05.105 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/ 2023-10-08T11:46:05.105 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd/ 2023-10-08T11:46:05.105 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 38857 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd/iommu_v2.ko 2023-10-08T11:46:05.105 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/ 2023-10-08T11:46:05.105 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13817 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-88pm860x.ko 2023-10-08T11:46:05.105 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11385 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-adp5520.ko 2023-10-08T11:46:05.105 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 59753 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-bd2802.ko 2023-10-08T11:46:05.105 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 24785 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-blinkm.ko 2023-10-08T11:46:05.105 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 10473 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-da903x.ko 2023-10-08T11:46:05.105 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 12241 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-da9052.ko 2023-10-08T11:46:05.105 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 16561 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-gpio.ko 2023-10-08T11:46:05.105 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 15793 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lm3530.ko 2023-10-08T11:46:05.105 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 30505 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lm3533.ko 2023-10-08T11:46:05.106 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 19353 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lm355x.ko 2023-10-08T11:46:05.106 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 19961 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lm3642.ko 2023-10-08T11:46:05.106 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 16241 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lp3944.ko 2023-10-08T11:46:05.106 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11233 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lp8788.ko 2023-10-08T11:46:05.106 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 14929 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-max8997.ko 2023-10-08T11:46:05.106 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 12609 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-mc13783.ko 2023-10-08T11:46:05.106 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13385 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-menf21bmc.ko 2023-10-08T11:46:05.106 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 20721 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-pca9532.ko 2023-10-08T11:46:05.106 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 20481 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-pca955x.ko 2023-10-08T11:46:05.106 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 17857 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-pca963x.ko 2023-10-08T11:46:05.106 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 34433 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-ss4200.ko 2023-10-08T11:46:05.106 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 24865 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-tca6507.ko 2023-10-08T11:46:05.107 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 15665 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-wm831x-status.ko 2023-10-08T11:46:05.107 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11841 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-wm8350.ko 2023-10-08T11:46:05.107 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ 2023-10-08T11:46:05.107 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 10049 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-10-08T11:46:05.107 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 10873 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-10-08T11:46:05.107 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 9089 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-10-08T11:46:05.107 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 7617 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-10-08T11:46:05.107 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 14249 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-10-08T11:46:05.107 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 14073 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-10-08T11:46:05.107 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11889 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-10-08T11:46:05.107 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 14073 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-10-08T11:46:05.107 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/ 2023-10-08T11:46:05.108 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache/ 2023-10-08T11:46:05.108 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 655473 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache/bcache.ko 2023-10-08T11:46:05.108 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 40569 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-bio-prison.ko 2023-10-08T11:46:05.108 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 89601 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-bufio.ko 2023-10-08T11:46:05.108 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 47529 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache-smq.ko 2023-10-08T11:46:05.108 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 155993 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache.ko 2023-10-08T11:46:05.108 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 107049 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-crypt.ko 2023-10-08T11:46:05.108 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 21521 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-delay.ko 2023-10-08T11:46:05.108 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 53897 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-era.ko 2023-10-08T11:46:05.108 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 28529 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-flakey.ko 2023-10-08T11:46:05.108 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 41593 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-log-userspace.ko 2023-10-08T11:46:05.108 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 32721 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-log.ko 2023-10-08T11:46:05.109 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 49545 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-mirror.ko 2023-10-08T11:46:05.109 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 78017 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-multipath.ko 2023-10-08T11:46:05.109 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 16457 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-queue-length.ko 2023-10-08T11:46:05.109 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 70953 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-raid.ko 2023-10-08T11:46:05.109 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 36273 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-region-hash.ko 2023-10-08T11:46:05.109 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 15857 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-round-robin.ko 2023-10-08T11:46:05.109 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 16785 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-service-time.ko 2023-10-08T11:46:05.109 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 109593 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-snapshot.ko 2023-10-08T11:46:05.109 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 19361 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-switch.ko 2023-10-08T11:46:05.109 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 181585 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-thin-pool.ko 2023-10-08T11:46:05.109 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 51737 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-verity.ko 2023-10-08T11:46:05.109 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 8441 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-zero.ko 2023-10-08T11:46:05.109 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 15105 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/faulty.ko 2023-10-08T11:46:05.110 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 19433 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/linear.ko 2023-10-08T11:46:05.110 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 32305 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/multipath.ko 2023-10-08T11:46:05.110 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data/ 2023-10-08T11:46:05.110 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 199937 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-10-08T11:46:05.110 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 37321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid0.ko 2023-10-08T11:46:05.110 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 112609 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid1.ko 2023-10-08T11:46:05.110 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 160553 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid10.ko 2023-10-08T11:46:05.110 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 396153 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid456.ko 2023-10-08T11:46:05.110 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/ 2023-10-08T11:46:05.110 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/ 2023-10-08T11:46:05.110 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 178113 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptbase.ko 2023-10-08T11:46:05.110 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 63385 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptctl.ko 2023-10-08T11:46:05.111 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 44649 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptfc.ko 2023-10-08T11:46:05.111 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 37161 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptlan.ko 2023-10-08T11:46:05.111 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 123353 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptsas.ko 2023-10-08T11:46:05.111 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 79017 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptscsih.ko 2023-10-08T11:46:05.111 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 53081 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptspi.ko 2023-10-08T11:46:05.111 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/ 2023-10-08T11:46:05.111 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 17305 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/88pm800.ko 2023-10-08T11:46:05.111 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 12761 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/88pm805.ko 2023-10-08T11:46:05.111 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11193 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/88pm80x.ko 2023-10-08T11:46:05.111 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11865 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/arizona-i2c.ko 2023-10-08T11:46:05.111 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 123721 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/arizona.ko 2023-10-08T11:46:05.111 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11961 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/bcm590xx.ko 2023-10-08T11:46:05.112 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 17465 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/cros_ec_dev.ko 2023-10-08T11:46:05.112 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 34993 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/dln2.ko 2023-10-08T11:46:05.112 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 16689 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/janz-cmodio.ko 2023-10-08T11:46:05.112 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 53585 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/kempld-core.ko 2023-10-08T11:46:05.112 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 27529 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lm3533-core.ko 2023-10-08T11:46:05.112 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 14993 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-10-08T11:46:05.112 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13009 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lp3943.ko 2023-10-08T11:46:05.112 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 54569 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_ich.ko 2023-10-08T11:46:05.113 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 12113 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_sch.ko 2023-10-08T11:46:05.113 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 17409 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/max8907.ko 2023-10-08T11:46:05.113 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 29857 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/mc13xxx-core.ko 2023-10-08T11:46:05.113 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11809 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-10-08T11:46:05.113 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11593 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/menf21bmc.ko 2023-10-08T11:46:05.113 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 17329 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/pcf50633-adc.ko 2023-10-08T11:46:05.113 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 9153 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/pcf50633-gpio.ko 2023-10-08T11:46:05.114 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 34873 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/pcf50633.ko 2023-10-08T11:46:05.114 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 10105 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-10-08T11:46:05.114 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 20289 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/retu-mfd.ko 2023-10-08T11:46:05.114 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 80425 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/si476x-core.ko 2023-10-08T11:46:05.114 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 48441 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/sm501.ko 2023-10-08T11:46:05.114 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 19825 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-10-08T11:46:05.115 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 51137 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/tps65010.ko 2023-10-08T11:46:05.115 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 10417 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/tps6507x.ko 2023-10-08T11:46:05.115 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13329 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/viperboard.ko 2023-10-08T11:46:05.115 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 10537 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/vx855.ko 2023-10-08T11:46:05.115 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 17953 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/wl1273-core.ko 2023-10-08T11:46:05.115 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 44345 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/wm8994.ko 2023-10-08T11:46:05.116 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/ 2023-10-08T11:46:05.116 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13833 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-10-08T11:46:05.116 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 48489 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/ad525x_dpot.ko 2023-10-08T11:46:05.116 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl/ 2023-10-08T11:46:05.116 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 46585 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-10-08T11:46:05.116 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 18393 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds9802als.ko 2023-10-08T11:46:05.116 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 36729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds990x.ko 2023-10-08T11:46:05.117 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 45593 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/bh1770glc.ko 2023-10-08T11:46:05.117 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/c2port/ 2023-10-08T11:46:05.117 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11145 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-10-08T11:46:05.117 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 35305 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/c2port/core.ko 2023-10-08T11:46:05.117 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710/ 2023-10-08T11:46:05.117 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 25161 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710/cb710.ko 2023-10-08T11:46:05.117 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 17801 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/ds1682.ko 2023-10-08T11:46:05.118 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 8897 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/dummy-irq.ko 2023-10-08T11:46:05.118 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/echo/ 2023-10-08T11:46:05.118 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13657 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/echo/echo.ko 2023-10-08T11:46:05.118 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/ 2023-10-08T11:46:05.118 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 37849 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/at24.ko 2023-10-08T11:46:05.118 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 14321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom.ko 2023-10-08T11:46:05.118 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 14769 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-10-08T11:46:05.119 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13537 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/max6875.ko 2023-10-08T11:46:05.119 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 32993 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/enclosure.ko 2023-10-08T11:46:05.119 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/genwqe/ 2023-10-08T11:46:05.119 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 152137 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-10-08T11:46:05.119 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 14129 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/hmc6352.ko 2023-10-08T11:46:05.119 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 31193 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/hpilo.ko 2023-10-08T11:46:05.120 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/ibmasm/ 2023-10-08T11:46:05.120 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 72601 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-10-08T11:46:05.120 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 19785 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/ics932s401.ko 2023-10-08T11:46:05.120 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 21681 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29003.ko 2023-10-08T11:46:05.120 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 15753 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29020.ko 2023-10-08T11:46:05.120 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/ 2023-10-08T11:46:05.121 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 42585 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-10-08T11:46:05.121 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13857 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-10-08T11:46:05.121 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/ 2023-10-08T11:46:05.121 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 125209 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-me.ko 2023-10-08T11:46:05.121 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 56521 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-txe.ko 2023-10-08T11:46:05.121 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 309857 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei.ko 2023-10-08T11:46:05.122 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 31329 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/phantom.ko 2023-10-08T11:46:05.122 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/ti-st/ 2023-10-08T11:46:05.122 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 74905 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/ti-st/st_drv.ko 2023-10-08T11:46:05.122 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 24305 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_7xx1.ko 2023-10-08T11:46:05.122 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 28873 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_core.ko 2023-10-08T11:46:05.122 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 18729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tsl2550.ko 2023-10-08T11:46:05.122 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 48673 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_balloon.ko 2023-10-08T11:46:05.122 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci/ 2023-10-08T11:46:05.122 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 183857 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-10-08T11:46:05.123 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ 2023-10-08T11:46:05.123 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding/ 2023-10-08T11:46:05.123 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 487865 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding/bonding.ko 2023-10-08T11:46:05.123 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/ 2023-10-08T11:46:05.123 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53/ 2023-10-08T11:46:05.123 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 106009 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53/b53_common.ko 2023-10-08T11:46:05.123 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 40281 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/bcm-sf2.ko 2023-10-08T11:46:05.123 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 14689 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6060.ko 2023-10-08T11:46:05.123 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx/ 2023-10-08T11:46:05.123 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 452681 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-10-08T11:46:05.123 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 16929 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dummy.ko 2023-10-08T11:46:05.123 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 17945 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/eql.ko 2023-10-08T11:46:05.124 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ 2023-10-08T11:46:05.124 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/ 2023-10-08T11:46:05.124 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 45785 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-10-08T11:46:05.124 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 42105 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-10-08T11:46:05.124 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 130489 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-10-08T11:46:05.124 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 68785 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-10-08T11:46:05.124 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/ 2023-10-08T11:46:05.124 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 37649 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/8390.ko 2023-10-08T11:46:05.124 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 59689 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-10-08T11:46:05.124 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 27193 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-10-08T11:46:05.124 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 99113 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-10-08T11:46:05.124 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec/ 2023-10-08T11:46:05.125 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 54521 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-10-08T11:46:05.125 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere/ 2023-10-08T11:46:05.125 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 69145 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere/et131x.ko 2023-10-08T11:46:05.125 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon/ 2023-10-08T11:46:05.125 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 59521 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-10-08T11:46:05.125 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera/ 2023-10-08T11:46:05.125 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 41393 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-10-08T11:46:05.125 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/ 2023-10-08T11:46:05.125 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 54545 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-10-08T11:46:05.125 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 49225 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-10-08T11:46:05.125 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 87345 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-10-08T11:46:05.125 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/ 2023-10-08T11:46:05.126 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx/ 2023-10-08T11:46:05.126 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 97321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-10-08T11:46:05.126 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-10-08T11:46:05.126 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 104609 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-10-08T11:46:05.126 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-10-08T11:46:05.126 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 90257 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-10-08T11:46:05.126 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/ 2023-10-08T11:46:05.126 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 81505 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-10-08T11:46:05.126 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 69713 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-10-08T11:46:05.126 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/ 2023-10-08T11:46:05.126 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 78401 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-10-08T11:46:05.126 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 176881 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-10-08T11:46:05.127 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-10-08T11:46:05.127 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 1422209 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-10-08T11:46:05.127 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 128377 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-10-08T11:46:05.127 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet/ 2023-10-08T11:46:05.127 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 132289 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-10-08T11:46:05.127 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 312145 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-10-08T11:46:05.127 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/ 2023-10-08T11:46:05.127 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna/ 2023-10-08T11:46:05.127 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 323553 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-10-08T11:46:05.127 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/ 2023-10-08T11:46:05.127 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-10-08T11:46:05.128 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 193433 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-10-08T11:46:05.128 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-10-08T11:46:05.128 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 347641 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-10-08T11:46:05.128 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-10-08T11:46:05.128 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 1044145 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-10-08T11:46:05.128 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-10-08T11:46:05.128 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 166113 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-10-08T11:46:05.128 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-10-08T11:46:05.128 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 34881 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-10-08T11:46:05.128 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/ 2023-10-08T11:46:05.128 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic/ 2023-10-08T11:46:05.128 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 204329 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-10-08T11:46:05.129 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/ 2023-10-08T11:46:05.129 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/ 2023-10-08T11:46:05.129 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 69449 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-10-08T11:46:05.129 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 61489 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-10-08T11:46:05.129 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 141161 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-10-08T11:46:05.129 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 51433 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-10-08T11:46:05.129 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 62865 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-10-08T11:46:05.129 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 31305 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-10-08T11:46:05.129 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/ 2023-10-08T11:46:05.129 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 60873 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-10-08T11:46:05.129 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 62833 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-10-08T11:46:05.130 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 45721 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dnet.ko 2023-10-08T11:46:05.130 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 25233 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ec_bhf.ko 2023-10-08T11:46:05.130 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/ 2023-10-08T11:46:05.130 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet/ 2023-10-08T11:46:05.130 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 281329 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-10-08T11:46:05.130 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 49505 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ethoc.ko 2023-10-08T11:46:05.130 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 51737 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/fealnx.ko 2023-10-08T11:46:05.130 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/fujitsu/ 2023-10-08T11:46:05.130 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 45281 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-10-08T11:46:05.130 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ 2023-10-08T11:46:05.130 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 90465 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e100.ko 2023-10-08T11:46:05.130 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000/ 2023-10-08T11:46:05.131 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 295713 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-10-08T11:46:05.131 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e/ 2023-10-08T11:46:05.131 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 584249 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-10-08T11:46:05.131 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k/ 2023-10-08T11:46:05.131 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 246321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-10-08T11:46:05.131 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e/ 2023-10-08T11:46:05.131 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 924017 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-10-08T11:46:05.131 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf/ 2023-10-08T11:46:05.131 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 302577 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-10-08T11:46:05.132 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb/ 2023-10-08T11:46:05.132 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 514889 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-10-08T11:46:05.132 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf/ 2023-10-08T11:46:05.132 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 93593 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-10-08T11:46:05.132 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-10-08T11:46:05.132 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 734297 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-10-08T11:46:05.281 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-10-08T11:46:05.281 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 151841 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-10-08T11:46:05.281 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 86921 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/jme.ko 2023-10-08T11:46:05.281 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/ 2023-10-08T11:46:05.281 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 20977 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-10-08T11:46:05.281 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 102385 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/skge.ko 2023-10-08T11:46:05.282 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 122681 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-10-08T11:46:05.282 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/ 2023-10-08T11:46:05.282 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-10-08T11:46:05.282 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 727433 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-10-08T11:46:05.282 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 280513 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-10-08T11:46:05.282 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-10-08T11:46:05.282 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-10-08T11:46:05.282 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 1097537 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-10-08T11:46:05.282 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel/ 2023-10-08T11:46:05.282 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 53041 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-10-08T11:46:05.283 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 40993 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-10-08T11:46:05.283 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 19489 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-10-08T11:46:05.283 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 95665 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-10-08T11:46:05.283 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/ 2023-10-08T11:46:05.283 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-10-08T11:46:05.283 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 108809 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-10-08T11:46:05.283 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/ 2023-10-08T11:46:05.283 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 73377 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-10-08T11:46:05.283 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 47713 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-10-08T11:46:05.283 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion/ 2023-10-08T11:46:05.283 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 150905 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-10-08T11:46:05.283 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia/ 2023-10-08T11:46:05.284 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 136785 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-10-08T11:46:05.284 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/ 2023-10-08T11:46:05.284 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 50481 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-10-08T11:46:05.284 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 43145 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-10-08T11:46:05.284 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/ 2023-10-08T11:46:05.284 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-10-08T11:46:05.284 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 227113 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-10-08T11:46:05.284 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 87081 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-10-08T11:46:05.284 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-10-08T11:46:05.284 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 671393 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-10-08T11:46:05.284 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc/ 2023-10-08T11:46:05.284 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 43017 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-10-08T11:46:05.284 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/ 2023-10-08T11:46:05.285 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 67385 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-10-08T11:46:05.285 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 83921 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-10-08T11:46:05.285 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 29321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/atp.ko 2023-10-08T11:46:05.285 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 189817 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-10-08T11:46:05.285 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/samsung/ 2023-10-08T11:46:05.285 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-10-08T11:46:05.285 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 104241 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-10-08T11:46:05.285 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc/ 2023-10-08T11:46:05.285 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 952929 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-10-08T11:46:05.285 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan/ 2023-10-08T11:46:05.285 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 47177 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-10-08T11:46:05.286 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/ 2023-10-08T11:46:05.286 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 54809 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis190.ko 2023-10-08T11:46:05.286 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 63273 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis900.ko 2023-10-08T11:46:05.286 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/ 2023-10-08T11:46:05.286 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 61537 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-10-08T11:46:05.286 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 67129 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-10-08T11:46:05.286 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 73345 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-10-08T11:46:05.286 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 68209 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-10-08T11:46:05.286 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/ 2023-10-08T11:46:05.286 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-10-08T11:46:05.286 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13441 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-10-08T11:46:05.287 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 40137 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-10-08T11:46:05.287 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 20769 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-10-08T11:46:05.287 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 481681 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-10-08T11:46:05.287 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/ 2023-10-08T11:46:05.287 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 103321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/cassini.ko 2023-10-08T11:46:05.287 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 166121 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/niu.ko 2023-10-08T11:46:05.287 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 66473 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sungem.ko 2023-10-08T11:46:05.287 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 78737 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-10-08T11:46:05.287 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti/ 2023-10-08T11:46:05.287 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 49993 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-10-08T11:46:05.288 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti/ 2023-10-08T11:46:05.288 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 86465 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti/tlan.ko 2023-10-08T11:46:05.288 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/ 2023-10-08T11:46:05.288 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 80257 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-10-08T11:46:05.288 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 83681 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-10-08T11:46:05.288 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/ 2023-10-08T11:46:05.288 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 46241 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-10-08T11:46:05.288 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 30849 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-10-08T11:46:05.288 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom/ 2023-10-08T11:46:05.289 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 60041 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-10-08T11:46:05.289 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/fddi/ 2023-10-08T11:46:05.289 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 41001 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/fddi/defxx.ko 2023-10-08T11:46:05.289 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/fddi/skfp/ 2023-10-08T11:46:05.289 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 216977 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/fddi/skfp/skfp.ko 2023-10-08T11:46:05.289 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 77401 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/geneve.ko 2023-10-08T11:46:05.289 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv/ 2023-10-08T11:46:05.289 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 235593 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-10-08T11:46:05.289 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154/ 2023-10-08T11:46:05.289 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 18257 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154/fakelb.ko 2023-10-08T11:46:05.289 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 25073 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ifb.ko 2023-10-08T11:46:05.289 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan/ 2023-10-08T11:46:05.290 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 83993 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan/ipvlan.ko 2023-10-08T11:46:05.290 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 62065 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvlan.ko 2023-10-08T11:46:05.290 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 15865 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvtap.ko 2023-10-08T11:46:05.290 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/ 2023-10-08T11:46:05.290 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 19817 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-10-08T11:46:05.290 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 14185 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-10-08T11:46:05.290 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13745 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-gpio.ko 2023-10-08T11:46:05.290 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 8825 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-regmap.ko 2023-10-08T11:46:05.290 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 16025 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio.ko 2023-10-08T11:46:05.290 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 20513 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mii.ko 2023-10-08T11:46:05.291 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 41697 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/netconsole.ko 2023-10-08T11:46:05.291 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13145 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/nlmon.ko 2023-10-08T11:46:05.291 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/ 2023-10-08T11:46:05.291 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 17897 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs-lynx.ko 2023-10-08T11:46:05.291 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 32329 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-10-08T11:46:05.291 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/ 2023-10-08T11:46:05.291 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 9737 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/amd.ko 2023-10-08T11:46:05.291 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 50097 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-10-08T11:46:05.291 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 43273 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm7xxx.ko 2023-10-08T11:46:05.291 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11521 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm87xx.ko 2023-10-08T11:46:05.291 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 41793 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/broadcom.ko 2023-10-08T11:46:05.292 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 10561 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/cicada.ko 2023-10-08T11:46:05.292 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 12961 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/davicom.ko 2023-10-08T11:46:05.292 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 9449 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/et1011c.ko 2023-10-08T11:46:05.292 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 24905 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/icplus.ko 2023-10-08T11:46:05.292 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 15785 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/lxt.ko 2023-10-08T11:46:05.292 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 78185 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/marvell.ko 2023-10-08T11:46:05.292 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 75713 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/micrel.ko 2023-10-08T11:46:05.292 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 12033 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/national.ko 2023-10-08T11:46:05.292 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 97265 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/phylink.ko 2023-10-08T11:46:05.292 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 10001 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/qsemi.ko 2023-10-08T11:46:05.293 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 49553 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/realtek.ko 2023-10-08T11:46:05.293 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 25753 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/smsc.ko 2023-10-08T11:46:05.293 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 10793 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/ste10Xp.ko 2023-10-08T11:46:05.293 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 24033 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/vitesse.ko 2023-10-08T11:46:05.293 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/plip/ 2023-10-08T11:46:05.293 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 43465 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/plip/plip.ko 2023-10-08T11:46:05.293 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ 2023-10-08T11:46:05.293 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 15857 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/bsd_comp.ko 2023-10-08T11:46:05.293 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 29929 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_async.ko 2023-10-08T11:46:05.293 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 17665 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_deflate.ko 2023-10-08T11:46:05.293 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 18625 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_mppe.ko 2023-10-08T11:46:05.294 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 28945 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_synctty.ko 2023-10-08T11:46:05.294 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 42545 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppoe.ko 2023-10-08T11:46:05.294 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13441 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppox.ko 2023-10-08T11:46:05.294 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 31969 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pptp.ko 2023-10-08T11:46:05.294 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 28225 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/sb1000.ko 2023-10-08T11:46:05.294 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/ 2023-10-08T11:46:05.294 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 42513 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/slip.ko 2023-10-08T11:46:05.294 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 26929 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/sungem_phy.ko 2023-10-08T11:46:05.294 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 64937 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/tap.ko 2023-10-08T11:46:05.294 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/ 2023-10-08T11:46:05.294 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 106025 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team.ko 2023-10-08T11:46:05.295 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13497 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_activebackup.ko 2023-10-08T11:46:05.295 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 10209 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_broadcast.ko 2023-10-08T11:46:05.295 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 28993 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-10-08T11:46:05.295 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 9641 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_random.ko 2023-10-08T11:46:05.295 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 9321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-10-08T11:46:05.295 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 88257 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/veth.ko 2023-10-08T11:46:05.295 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3/ 2023-10-08T11:46:05.295 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 120497 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-10-08T11:46:05.295 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan/ 2023-10-08T11:46:05.295 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 293441 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan/vxlan.ko 2023-10-08T11:46:05.295 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback/ 2023-10-08T11:46:05.296 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 143889 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback/xen-netback.ko 2023-10-08T11:46:05.296 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb/ 2023-10-08T11:46:05.296 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 20969 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb/ntb.ko 2023-10-08T11:46:05.296 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/ 2023-10-08T11:46:05.296 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/ 2023-10-08T11:46:05.296 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 264585 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme-core.ko 2023-10-08T11:46:05.296 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 102393 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme.ko 2023-10-08T11:46:05.296 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/ 2023-10-08T11:46:05.296 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 133817 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport.ko 2023-10-08T11:46:05.296 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 14561 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_cs.ko 2023-10-08T11:46:05.297 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 84337 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_pc.ko 2023-10-08T11:46:05.297 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 26121 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_serial.ko 2023-10-08T11:46:05.297 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/ 2023-10-08T11:46:05.297 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug/ 2023-10-08T11:46:05.297 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 25009 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-10-08T11:46:05.297 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 17849 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-10-08T11:46:05.297 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 20137 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-10-08T11:46:05.297 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11857 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/pci-stub.ko 2023-10-08T11:46:05.297 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 47377 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/xen-pcifront.ko 2023-10-08T11:46:05.297 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/ 2023-10-08T11:46:05.297 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 26793 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/i82092.ko 2023-10-08T11:46:05.298 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 145785 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/pcmcia.ko 2023-10-08T11:46:05.298 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 62081 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/pcmcia_core.ko 2023-10-08T11:46:05.298 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 34345 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-10-08T11:46:05.298 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 34265 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/pd6729.ko 2023-10-08T11:46:05.298 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 112913 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/yenta_socket.ko 2023-10-08T11:46:05.298 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/phy/ 2023-10-08T11:46:05.298 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/phy/broadcom/ 2023-10-08T11:46:05.298 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 10841 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-10-08T11:46:05.298 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/phy/samsung/ 2023-10-08T11:46:05.298 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 8441 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-10-08T11:46:05.298 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/ 2023-10-08T11:46:05.299 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel/ 2023-10-08T11:46:05.299 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 71521 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-10-08T11:46:05.299 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/ 2023-10-08T11:46:05.299 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/chrome/ 2023-10-08T11:46:05.299 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 50889 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-10-08T11:46:05.299 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 20849 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/chrome/cros_ec.ko 2023-10-08T11:46:05.299 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 21433 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-10-08T11:46:05.299 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 25417 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-10-08T11:46:05.299 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 26225 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-10-08T11:46:05.299 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 18201 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-10-08T11:46:05.299 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 17425 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-10-08T11:46:05.300 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/ 2023-10-08T11:46:05.300 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 67097 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acer-wmi.ko 2023-10-08T11:46:05.300 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 39145 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acerhdf.ko 2023-10-08T11:46:05.300 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 36913 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/apple-gmux.ko 2023-10-08T11:46:05.300 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 59665 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-laptop.ko 2023-10-08T11:46:05.300 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 30705 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-10-08T11:46:05.300 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 106873 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-wmi.ko 2023-10-08T11:46:05.300 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 36913 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/classmate-laptop.ko 2023-10-08T11:46:05.300 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 49121 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-10-08T11:46:05.300 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13961 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-10-08T11:46:05.300 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 40265 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-10-08T11:46:05.300 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 22521 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-10-08T11:46:05.301 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 36657 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/hdaps.ko 2023-10-08T11:46:05.301 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 19449 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/ibm_rtl.ko 2023-10-08T11:46:05.301 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel/ 2023-10-08T11:46:05.301 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 12073 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-10-08T11:46:05.301 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 8985 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-10-08T11:46:05.301 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 43521 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel_ips.ko 2023-10-08T11:46:05.301 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 20273 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/msi-wmi.ko 2023-10-08T11:46:05.301 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 10377 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/mxm-wmi.ko 2023-10-08T11:46:05.301 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 34801 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-10-08T11:46:05.301 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 42329 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-laptop.ko 2023-10-08T11:46:05.301 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 14169 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-q10.ko 2023-10-08T11:46:05.302 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 17321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/topstar-laptop.ko 2023-10-08T11:46:05.302 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13721 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-10-08T11:46:05.302 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 17081 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_haps.ko 2023-10-08T11:46:05.302 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 10161 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi-bmof.ko 2023-10-08T11:46:05.302 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 57545 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi.ko 2023-10-08T11:46:05.302 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/ 2023-10-08T11:46:05.302 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/ 2023-10-08T11:46:05.302 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 30345 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/88pm860x_battery.ko 2023-10-08T11:46:05.302 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 33985 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/88pm860x_charger.ko 2023-10-08T11:46:05.302 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 55057 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/bq2415x_charger.ko 2023-10-08T11:46:05.302 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 53993 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/bq24190_charger.ko 2023-10-08T11:46:05.302 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 21553 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/bq24735-charger.ko 2023-10-08T11:46:05.303 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 17337 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-10-08T11:46:05.303 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 19609 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/da9030_battery.ko 2023-10-08T11:46:05.303 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 19841 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/da9052-battery.ko 2023-10-08T11:46:05.303 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 29281 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/ds2760_battery.ko 2023-10-08T11:46:05.303 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 23217 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/ds2780_battery.ko 2023-10-08T11:46:05.303 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 23353 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/ds2781_battery.ko 2023-10-08T11:46:05.303 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 23649 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/ds2782_battery.ko 2023-10-08T11:46:05.303 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 20353 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/gpio-charger.ko 2023-10-08T11:46:05.303 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 18041 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/isp1704_charger.ko 2023-10-08T11:46:05.303 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 20273 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/lp8727_charger.ko 2023-10-08T11:46:05.303 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 12577 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/max14577_charger.ko 2023-10-08T11:46:05.303 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 25897 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/max17040_battery.ko 2023-10-08T11:46:05.304 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 30289 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/max17042_battery.ko 2023-10-08T11:46:05.304 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 18585 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/max8903_charger.ko 2023-10-08T11:46:05.304 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 23729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/max8925_power.ko 2023-10-08T11:46:05.304 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 21657 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/pcf50633-charger.ko 2023-10-08T11:46:05.304 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 38009 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/sbs-battery.ko 2023-10-08T11:46:05.304 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 28385 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/test_power.ko 2023-10-08T11:46:05.304 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 18865 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/tps65090-charger.ko 2023-10-08T11:46:05.304 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11969 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/wm831x_backup.ko 2023-10-08T11:46:05.304 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 24521 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/wm831x_power.ko 2023-10-08T11:46:05.304 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 22417 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/wm8350_power.ko 2023-10-08T11:46:05.304 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/ 2023-10-08T11:46:05.305 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 57737 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_common.ko 2023-10-08T11:46:05.305 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 17345 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_msr.ko 2023-10-08T11:46:05.305 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/ 2023-10-08T11:46:05.305 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/ 2023-10-08T11:46:05.305 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 15521 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-gpio.ko 2023-10-08T11:46:05.305 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13249 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-ldisc.ko 2023-10-08T11:46:05.305 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 15913 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps_parport.ko 2023-10-08T11:46:05.305 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 41921 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/pps_core.ko 2023-10-08T11:46:05.305 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ 2023-10-08T11:46:05.305 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 66385 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp.ko 2023-10-08T11:46:05.305 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 16449 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp_kvm.ko 2023-10-08T11:46:05.306 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/ 2023-10-08T11:46:05.306 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 23497 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-88pm80x.ko 2023-10-08T11:46:05.306 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 24521 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-88pm860x.ko 2023-10-08T11:46:05.306 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 15393 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq32k.ko 2023-10-08T11:46:05.306 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 12961 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq4802.ko 2023-10-08T11:46:05.306 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 20105 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-da9052.ko 2023-10-08T11:46:05.306 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 18505 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-da9055.ko 2023-10-08T11:46:05.306 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 20177 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-da9063.ko 2023-10-08T11:46:05.306 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 16457 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1286.ko 2023-10-08T11:46:05.306 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 68577 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1307.ko 2023-10-08T11:46:05.306 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 20817 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1374.ko 2023-10-08T11:46:05.306 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 18217 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1511.ko 2023-10-08T11:46:05.307 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 16737 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1553.ko 2023-10-08T11:46:05.307 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13953 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1672.ko 2023-10-08T11:46:05.307 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13369 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1742.ko 2023-10-08T11:46:05.307 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 17305 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds2404.ko 2023-10-08T11:46:05.307 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 23705 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds3232.ko 2023-10-08T11:46:05.307 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11081 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-em3027.ko 2023-10-08T11:46:05.307 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 24329 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-fm3130.ko 2023-10-08T11:46:05.307 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 17705 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl12022.ko 2023-10-08T11:46:05.307 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 36057 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl1208.ko 2023-10-08T11:46:05.307 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 14673 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-lp8788.ko 2023-10-08T11:46:05.307 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 38097 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m41t80.ko 2023-10-08T11:46:05.308 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 12089 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t35.ko 2023-10-08T11:46:05.308 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 25945 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t59.ko 2023-10-08T11:46:05.308 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 14177 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t86.ko 2023-10-08T11:46:05.308 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11633 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-max6900.ko 2023-10-08T11:46:05.308 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 14737 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-max8907.ko 2023-10-08T11:46:05.308 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 15409 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-max8925.ko 2023-10-08T11:46:05.308 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 25809 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-max8997.ko 2023-10-08T11:46:05.308 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 16681 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-max8998.ko 2023-10-08T11:46:05.308 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 18513 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-10-08T11:46:05.308 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11409 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-msm6242.ko 2023-10-08T11:46:05.308 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 19625 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-palmas.ko 2023-10-08T11:46:05.308 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 40121 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf2127.ko 2023-10-08T11:46:05.309 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 17977 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf50633.ko 2023-10-08T11:46:05.309 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 26817 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf85063.ko 2023-10-08T11:46:05.309 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 21825 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8523.ko 2023-10-08T11:46:05.309 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 29881 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8563.ko 2023-10-08T11:46:05.309 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 12441 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8583.ko 2023-10-08T11:46:05.309 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 18033 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rc5t583.ko 2023-10-08T11:46:05.309 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13049 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rp5c01.ko 2023-10-08T11:46:05.309 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 33753 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rs5c372.ko 2023-10-08T11:46:05.309 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 27833 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-10-08T11:46:05.309 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 25257 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8025.ko 2023-10-08T11:46:05.309 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 20113 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8581.ko 2023-10-08T11:46:05.310 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 21617 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-s35390a.ko 2023-10-08T11:46:05.310 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 16825 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-10-08T11:46:05.310 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 17889 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-tps6586x.ko 2023-10-08T11:46:05.310 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 21545 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-tps65910.ko 2023-10-08T11:46:05.310 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 20545 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-wm831x.ko 2023-10-08T11:46:05.310 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 21345 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-wm8350.ko 2023-10-08T11:46:05.310 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 27873 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-x1205.ko 2023-10-08T11:46:05.310 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ 2023-10-08T11:46:05.310 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 77617 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-9xxx.ko 2023-10-08T11:46:05.310 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 57665 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-sas.ko 2023-10-08T11:46:05.310 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 55169 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-xxxx.ko 2023-10-08T11:46:05.310 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 135169 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/BusLogic.ko 2023-10-08T11:46:05.311 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 26657 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/a100u2w.ko 2023-10-08T11:46:05.311 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid/ 2023-10-08T11:46:05.311 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 272353 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid/aacraid.ko 2023-10-08T11:46:05.311 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 100617 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/advansys.ko 2023-10-08T11:46:05.311 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/ 2023-10-08T11:46:05.311 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 356265 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-10-08T11:46:05.311 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 295801 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-10-08T11:46:05.311 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic94xx/ 2023-10-08T11:46:05.311 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 189321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-10-08T11:46:05.311 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 24073 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/am53c974.ko 2023-10-08T11:46:05.312 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr/ 2023-10-08T11:46:05.312 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 106569 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-10-08T11:46:05.312 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 38185 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/atp870u.ko 2023-10-08T11:46:05.312 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi/ 2023-10-08T11:46:05.312 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 246897 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-10-08T11:46:05.312 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa/ 2023-10-08T11:46:05.312 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 1172185 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa/bfa.ko 2023-10-08T11:46:05.312 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc/ 2023-10-08T11:46:05.312 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 237169 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-10-08T11:46:05.312 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i/ 2023-10-08T11:46:05.312 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 115393 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-10-08T11:46:05.312 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 40609 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ch.ko 2023-10-08T11:46:05.313 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor/ 2023-10-08T11:46:05.313 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 308889 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor/csiostor.ko 2023-10-08T11:46:05.313 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/ 2023-10-08T11:46:05.313 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-10-08T11:46:05.313 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 76193 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-10-08T11:46:05.313 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-10-08T11:46:05.313 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 101449 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-10-08T11:46:05.313 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 146785 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-10-08T11:46:05.313 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 75529 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dc395x.ko 2023-10-08T11:46:05.313 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 38121 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dmx3191d.ko 2023-10-08T11:46:05.313 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r/ 2023-10-08T11:46:05.314 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 212401 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r/esas2r.ko 2023-10-08T11:46:05.314 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 60489 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esp_scsi.ko 2023-10-08T11:46:05.314 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/ 2023-10-08T11:46:05.314 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 78289 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/fcoe.ko 2023-10-08T11:46:05.314 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 158193 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-10-08T11:46:05.314 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 18945 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fdomain.ko 2023-10-08T11:46:05.314 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic/ 2023-10-08T11:46:05.314 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 262729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic/fnic.ko 2023-10-08T11:46:05.314 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 201793 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hpsa.ko 2023-10-08T11:46:05.314 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 51145 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hptiop.ko 2023-10-08T11:46:05.314 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 49041 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hv_storvsc.ko 2023-10-08T11:46:05.314 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 35321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/imm.ko 2023-10-08T11:46:05.314 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 44057 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/initio.ko 2023-10-08T11:46:05.315 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 266521 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ipr.ko 2023-10-08T11:46:05.315 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 101881 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ips.ko 2023-10-08T11:46:05.315 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci/ 2023-10-08T11:46:05.315 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 317249 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci/isci.ko 2023-10-08T11:46:05.315 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 26361 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-10-08T11:46:05.315 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 52897 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_tcp.ko 2023-10-08T11:46:05.315 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc/ 2023-10-08T11:46:05.315 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 314961 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc/libfc.ko 2023-10-08T11:46:05.315 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 145569 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi.ko 2023-10-08T11:46:05.315 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 53521 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi_tcp.ko 2023-10-08T11:46:05.315 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas/ 2023-10-08T11:46:05.315 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 217209 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas/libsas.ko 2023-10-08T11:46:05.316 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc/ 2023-10-08T11:46:05.316 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 2192585 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc/lpfc.ko 2023-10-08T11:46:05.316 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/ 2023-10-08T11:46:05.316 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 73545 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-10-08T11:46:05.316 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 33505 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-10-08T11:46:05.316 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 310729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-10-08T11:46:05.316 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 84697 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid.ko 2023-10-08T11:46:05.316 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas/ 2023-10-08T11:46:05.316 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 659513 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-10-08T11:46:05.316 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas/ 2023-10-08T11:46:05.316 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 119929 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas/mvsas.ko 2023-10-08T11:46:05.316 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 78153 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvumi.ko 2023-10-08T11:46:05.316 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pcmcia/ 2023-10-08T11:46:05.317 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 81601 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-10-08T11:46:05.317 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11713 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-10-08T11:46:05.317 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 20865 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-10-08T11:46:05.317 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 23857 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-10-08T11:46:05.317 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001/ 2023-10-08T11:46:05.317 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 364257 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-10-08T11:46:05.317 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 123489 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pmcraid.ko 2023-10-08T11:46:05.317 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 33617 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ppa.ko 2023-10-08T11:46:05.317 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 55345 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla1280.ko 2023-10-08T11:46:05.317 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/ 2023-10-08T11:46:05.317 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 1860193 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-10-08T11:46:05.317 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 85313 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-10-08T11:46:05.318 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx/ 2023-10-08T11:46:05.318 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 558865 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-10-08T11:46:05.318 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 19025 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qlogicfas408.ko 2023-10-08T11:46:05.318 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 18985 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/raid_class.ko 2023-10-08T11:46:05.318 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 238801 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_debug.ko 2023-10-08T11:46:05.318 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 173921 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_fc.ko 2023-10-08T11:46:05.318 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 278865 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-10-08T11:46:05.318 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 97705 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_sas.ko 2023-10-08T11:46:05.318 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 73881 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_spi.ko 2023-10-08T11:46:05.318 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 44993 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_srp.ko 2023-10-08T11:46:05.318 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 26249 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ses.ko 2023-10-08T11:46:05.319 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 115849 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/st.ko 2023-10-08T11:46:05.319 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 46825 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/stex.ko 2023-10-08T11:46:05.319 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2/ 2023-10-08T11:46:05.319 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 162121 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-10-08T11:46:05.319 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 42361 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/virtio_scsi.ko 2023-10-08T11:46:05.319 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 50297 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/vmw_pvscsi.ko 2023-10-08T11:46:05.319 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 40001 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/wd719x.ko 2023-10-08T11:46:05.319 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 50025 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/xen-scsifront.ko 2023-10-08T11:46:05.319 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb/ 2023-10-08T11:46:05.319 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 129417 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb/ssb.ko 2023-10-08T11:46:05.319 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/ 2023-10-08T11:46:05.319 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi/ 2023-10-08T11:46:05.319 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 739089 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-10-08T11:46:05.320 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback/ 2023-10-08T11:46:05.320 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 49985 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback/tcm_loop.ko 2023-10-08T11:46:05.320 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 39713 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_file.ko 2023-10-08T11:46:05.320 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 42961 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_iblock.ko 2023-10-08T11:46:05.320 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 931721 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_mod.ko 2023-10-08T11:46:05.320 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 44321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_pscsi.ko 2023-10-08T11:46:05.320 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 122545 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_user.ko 2023-10-08T11:46:05.320 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc/ 2023-10-08T11:46:05.320 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 75641 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-10-08T11:46:05.320 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/ 2023-10-08T11:46:05.320 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/ 2023-10-08T11:46:05.320 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/ 2023-10-08T11:46:05.321 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 23481 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-10-08T11:46:05.321 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 29153 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-10-08T11:46:05.321 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 9953 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-10-08T11:46:05.321 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 10257 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-10-08T11:46:05.321 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 15081 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-10-08T11:46:05.321 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 16497 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-10-08T11:46:05.321 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 26809 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-10-08T11:46:05.321 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 20281 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-10-08T11:46:05.321 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 14865 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-10-08T11:46:05.321 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 14393 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-10-08T11:46:05.321 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13001 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-10-08T11:46:05.321 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 37065 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-10-08T11:46:05.322 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 30729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-10-08T11:46:05.322 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 21673 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-10-08T11:46:05.322 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 12001 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-10-08T11:46:05.322 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 26489 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-10-08T11:46:05.322 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ 2023-10-08T11:46:05.322 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless/ 2023-10-08T11:46:05.322 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 78073 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-10-08T11:46:05.322 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 57881 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/moxa.ko 2023-10-08T11:46:05.322 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 50793 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/mxser.ko 2023-10-08T11:46:05.322 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 107545 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_gsm.ko 2023-10-08T11:46:05.322 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 32041 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_hdlc.ko 2023-10-08T11:46:05.322 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 68137 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/nozomi.ko 2023-10-08T11:46:05.323 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/ 2023-10-08T11:46:05.323 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250/ 2023-10-08T11:46:05.323 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 35745 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-10-08T11:46:05.323 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 59497 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-10-08T11:46:05.323 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 18281 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-10-08T11:46:05.323 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 22465 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/altera_uart.ko 2023-10-08T11:46:05.323 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 9489 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/arc_uart.ko 2023-10-08T11:46:05.323 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 72193 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-10-08T11:46:05.323 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm/ 2023-10-08T11:46:05.323 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 103017 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm/jsm.ko 2023-10-08T11:46:05.323 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 28785 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/rp2.ko 2023-10-08T11:46:05.323 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 52073 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/sc16is7xx.ko 2023-10-08T11:46:05.323 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 100185 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/synclink_gt.ko 2023-10-08T11:46:05.324 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/ 2023-10-08T11:46:05.324 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core/ 2023-10-08T11:46:05.324 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 536809 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core/ufshcd-core.ko 2023-10-08T11:46:05.324 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host/ 2023-10-08T11:46:05.324 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 28377 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-10-08T11:46:05.324 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 14433 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-10-08T11:46:05.324 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/ 2023-10-08T11:46:05.324 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 44585 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio.ko 2023-10-08T11:46:05.324 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 12241 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_aec.ko 2023-10-08T11:46:05.324 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11281 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_cif.ko 2023-10-08T11:46:05.324 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 18329 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_dmem_genirq.ko 2023-10-08T11:46:05.324 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13001 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_mf624.ko 2023-10-08T11:46:05.325 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 12177 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_netx.ko 2023-10-08T11:46:05.325 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 10601 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_pci_generic.ko 2023-10-08T11:46:05.325 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 16057 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-10-08T11:46:05.325 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13633 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_sercos3.ko 2023-10-08T11:46:05.325 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/ 2023-10-08T11:46:05.325 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/c67x00/ 2023-10-08T11:46:05.325 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 73273 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/c67x00/c67x00.ko 2023-10-08T11:46:05.325 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/chipidea/ 2023-10-08T11:46:05.325 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 143785 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-10-08T11:46:05.325 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 18505 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-10-08T11:46:05.325 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 12713 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-10-08T11:46:05.325 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13057 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-10-08T11:46:05.326 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/ 2023-10-08T11:46:05.326 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 85457 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-acm.ko 2023-10-08T11:46:05.326 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 51393 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-wdm.ko 2023-10-08T11:46:05.326 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 47465 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usblp.ko 2023-10-08T11:46:05.326 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 89833 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usbtmc.ko 2023-10-08T11:46:05.326 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/common/ 2023-10-08T11:46:05.326 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 22953 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/common/ulpi.ko 2023-10-08T11:46:05.326 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/dwc2/ 2023-10-08T11:46:05.326 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11873 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-10-08T11:46:05.326 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/dwc3/ 2023-10-08T11:46:05.326 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 12089 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-10-08T11:46:05.326 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 30041 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-10-08T11:46:05.327 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 445217 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/dwc3/dwc3.ko 2023-10-08T11:46:05.327 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/ 2023-10-08T11:46:05.327 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/ 2023-10-08T11:46:05.327 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 60089 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/u_ether.ko 2023-10-08T11:46:05.327 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 51753 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/u_serial.ko 2023-10-08T11:46:05.327 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 29049 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-10-08T11:46:05.327 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 42649 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-10-08T11:46:05.327 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 28089 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-10-08T11:46:05.327 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 36585 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-10-08T11:46:05.327 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 92377 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-10-08T11:46:05.327 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 51025 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-10-08T11:46:05.327 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 122073 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-10-08T11:46:05.327 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 57921 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-10-08T11:46:05.328 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 22345 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-10-08T11:46:05.328 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 31265 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-10-08T11:46:05.328 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 57705 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-10-08T11:46:05.328 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 85841 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-10-08T11:46:05.328 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 19521 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-10-08T11:46:05.328 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 58433 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-10-08T11:46:05.328 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 67337 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-10-08T11:46:05.328 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/legacy/ 2023-10-08T11:46:05.328 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 21265 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-10-08T11:46:05.328 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 18057 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-10-08T11:46:05.328 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 18465 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-10-08T11:46:05.328 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 21657 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-10-08T11:46:05.329 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 28401 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-10-08T11:46:05.329 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 18993 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-10-08T11:46:05.329 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 20409 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-10-08T11:46:05.329 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 16977 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-10-08T11:46:05.329 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 32073 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-10-08T11:46:05.329 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 16793 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-10-08T11:46:05.329 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 19393 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-10-08T11:46:05.329 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 27201 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-10-08T11:46:05.329 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 62153 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-10-08T11:46:05.329 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 15201 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-10-08T11:46:05.329 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 161321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/libcomposite.ko 2023-10-08T11:46:05.329 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/udc/ 2023-10-08T11:46:05.329 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 17705 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-10-08T11:46:05.330 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/udc/bdc/ 2023-10-08T11:46:05.330 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 157665 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-10-08T11:46:05.330 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 36065 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-10-08T11:46:05.330 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 52993 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-10-08T11:46:05.330 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 69689 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-10-08T11:46:05.330 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 56009 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-10-08T11:46:05.330 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 76033 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/udc/net2272.ko 2023-10-08T11:46:05.330 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 75057 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/udc/net2280.ko 2023-10-08T11:46:05.330 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 73153 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-10-08T11:46:05.330 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 65793 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-10-08T11:46:05.330 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 66073 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-10-08T11:46:05.330 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 81489 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-10-08T11:46:05.331 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 156057 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-10-08T11:46:05.331 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/ 2023-10-08T11:46:05.331 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11585 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/bcma-hcd.ko 2023-10-08T11:46:05.331 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 80097 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/isp116x-hcd.ko 2023-10-08T11:46:05.331 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 87337 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-10-08T11:46:05.331 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 78849 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-10-08T11:46:05.331 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 51305 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/sl811-hcd.ko 2023-10-08T11:46:05.331 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 15593 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/sl811_cs.ko 2023-10-08T11:46:05.331 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13305 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/ssb-hcd.ko 2023-10-08T11:46:05.331 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 25945 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-10-08T11:46:05.331 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/ 2023-10-08T11:46:05.331 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 34585 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/mdc800.ko 2023-10-08T11:46:05.332 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 21081 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/microtek.ko 2023-10-08T11:46:05.332 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ 2023-10-08T11:46:05.332 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 41841 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/adutux.ko 2023-10-08T11:46:05.332 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 20713 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/appledisplay.ko 2023-10-08T11:46:05.332 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 17721 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-10-08T11:46:05.332 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 23049 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/cytherm.ko 2023-10-08T11:46:05.332 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ehset.ko 2023-10-08T11:46:05.332 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 15057 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi26.ko 2023-10-08T11:46:05.332 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 15985 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi62.ko 2023-10-08T11:46:05.332 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11433 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ezusb.ko 2023-10-08T11:46:05.332 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 19297 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/idmouse.ko 2023-10-08T11:46:05.332 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 36617 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/iowarrior.ko 2023-10-08T11:46:05.332 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11593 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/isight_firmware.ko 2023-10-08T11:46:05.333 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 36529 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ldusb.ko 2023-10-08T11:46:05.333 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 36265 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/legousbtower.ko 2023-10-08T11:46:05.333 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 27793 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/lvstest.ko 2023-10-08T11:46:05.333 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga/ 2023-10-08T11:46:05.333 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 64841 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-10-08T11:46:05.333 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13001 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/trancevibrator.ko 2023-10-08T11:46:05.333 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 20473 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usb3503.ko 2023-10-08T11:46:05.333 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 25145 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usblcd.ko 2023-10-08T11:46:05.333 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 22753 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usbsevseg.ko 2023-10-08T11:46:05.333 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 70873 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usbtest.ko 2023-10-08T11:46:05.333 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 41945 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/uss720.ko 2023-10-08T11:46:05.333 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 27617 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/yurex.ko 2023-10-08T11:46:05.334 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/mon/ 2023-10-08T11:46:05.334 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 73185 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/mon/usbmon.ko 2023-10-08T11:46:05.334 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/musb/ 2023-10-08T11:46:05.334 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 301521 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/musb/musb_hdrc.ko 2023-10-08T11:46:05.334 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy/ 2023-10-08T11:46:05.334 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 21105 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy/phy-generic.ko 2023-10-08T11:46:05.334 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 20177 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-10-08T11:46:05.334 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 12257 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy/phy-isp1301.ko 2023-10-08T11:46:05.334 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 21745 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy/phy-tahvo.ko 2023-10-08T11:46:05.334 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ 2023-10-08T11:46:05.334 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13249 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/aircable.ko 2023-10-08T11:46:05.334 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 33433 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ark3116.ko 2023-10-08T11:46:05.335 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 26737 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/belkin_sa.ko 2023-10-08T11:46:05.335 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 38105 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ch341.ko 2023-10-08T11:46:05.335 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 70209 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cp210x.ko 2023-10-08T11:46:05.335 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 31169 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cyberjack.ko 2023-10-08T11:46:05.335 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 57937 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cypress_m8.ko 2023-10-08T11:46:05.335 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 49753 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/digi_acceleport.ko 2023-10-08T11:46:05.335 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 9617 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/empeg.ko 2023-10-08T11:46:05.335 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 43897 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/f81232.ko 2023-10-08T11:46:05.335 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 175145 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ftdi_sio.ko 2023-10-08T11:46:05.335 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 52713 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/garmin_gps.ko 2023-10-08T11:46:05.335 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 137105 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_edgeport.ko 2023-10-08T11:46:05.335 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 124673 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_ti.ko 2023-10-08T11:46:05.335 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 67769 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipaq.ko 2023-10-08T11:46:05.336 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 19161 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipw.ko 2023-10-08T11:46:05.336 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 26601 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ir-usb.ko 2023-10-08T11:46:05.336 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 57937 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-10-08T11:46:05.336 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 107417 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan.ko 2023-10-08T11:46:05.336 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 35497 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan_pda.ko 2023-10-08T11:46:05.336 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 25449 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kl5kusb105.ko 2023-10-08T11:46:05.336 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 33521 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kobil_sct.ko 2023-10-08T11:46:05.336 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 32841 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mct_u232.ko 2023-10-08T11:46:05.336 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 21993 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/metro-usb.ko 2023-10-08T11:46:05.336 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 66489 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7720.ko 2023-10-08T11:46:05.336 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 78113 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7840.ko 2023-10-08T11:46:05.336 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 56593 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mxuport.ko 2023-10-08T11:46:05.337 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13833 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/navman.ko 2023-10-08T11:46:05.337 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11617 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/omninet.ko 2023-10-08T11:46:05.337 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 24281 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/opticon.ko 2023-10-08T11:46:05.337 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 190233 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/option.ko 2023-10-08T11:46:05.337 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 38905 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/oti6858.ko 2023-10-08T11:46:05.337 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 54313 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/pl2303.ko 2023-10-08T11:46:05.337 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 9801 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcaux.ko 2023-10-08T11:46:05.337 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 37825 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcserial.ko 2023-10-08T11:46:05.337 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 34561 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/quatech2.ko 2023-10-08T11:46:05.337 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 14745 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/safe_serial.ko 2023-10-08T11:46:05.337 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 51297 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/sierra.ko 2023-10-08T11:46:05.337 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 21673 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/spcp8x5.ko 2023-10-08T11:46:05.338 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 29913 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ssu100.ko 2023-10-08T11:46:05.338 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 16913 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/symbolserial.ko 2023-10-08T11:46:05.338 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 61337 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-10-08T11:46:05.338 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 23729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-10-08T11:46:05.338 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 10241 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_debug.ko 2023-10-08T11:46:05.338 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 33313 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_wwan.ko 2023-10-08T11:46:05.338 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 125505 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usbserial.ko 2023-10-08T11:46:05.338 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 28753 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/visor.ko 2023-10-08T11:46:05.338 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 37409 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/whiteheat.ko 2023-10-08T11:46:05.338 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 10537 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/wishbone-serial.ko 2023-10-08T11:46:05.338 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 9289 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/xsens_mt.ko 2023-10-08T11:46:05.339 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ 2023-10-08T11:46:05.339 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 52913 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/uas.ko 2023-10-08T11:46:05.339 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 26017 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-alauda.ko 2023-10-08T11:46:05.339 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13049 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-cypress.ko 2023-10-08T11:46:05.339 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 22049 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-datafab.ko 2023-10-08T11:46:05.339 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 33497 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-10-08T11:46:05.339 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13745 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-freecom.ko 2023-10-08T11:46:05.339 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 19769 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-isd200.ko 2023-10-08T11:46:05.339 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 19361 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-10-08T11:46:05.339 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13713 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-karma.ko 2023-10-08T11:46:05.339 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 17841 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-onetouch.ko 2023-10-08T11:46:05.339 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 28441 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-realtek.ko 2023-10-08T11:46:05.340 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 28905 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr09.ko 2023-10-08T11:46:05.340 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 19521 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr55.ko 2023-10-08T11:46:05.340 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 35337 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-usbat.ko 2023-10-08T11:46:05.340 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 180017 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/usb-storage.ko 2023-10-08T11:46:05.340 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/ 2023-10-08T11:46:05.340 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 67457 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-core.ko 2023-10-08T11:46:05.340 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 71345 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-host.ko 2023-10-08T11:46:05.340 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 105401 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-10-08T11:46:05.340 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/ 2023-10-08T11:46:05.340 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/ 2023-10-08T11:46:05.340 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 153697 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-10-08T11:46:05.340 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 29537 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci.ko 2023-10-08T11:46:05.341 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 100569 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio.ko 2023-10-08T11:46:05.341 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 75137 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-10-08T11:46:05.341 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/ 2023-10-08T11:46:05.341 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 113889 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost.ko 2023-10-08T11:46:05.341 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 16985 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_iotlb.ko 2023-10-08T11:46:05.341 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 58137 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_net.ko 2023-10-08T11:46:05.341 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 89289 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_scsi.ko 2023-10-08T11:46:05.341 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/ 2023-10-08T11:46:05.341 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/ 2023-10-08T11:46:05.341 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 15417 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-10-08T11:46:05.341 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 12393 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/aat2870_bl.ko 2023-10-08T11:46:05.341 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 23305 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/adp5520_bl.ko 2023-10-08T11:46:05.342 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 32609 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/adp8860_bl.ko 2023-10-08T11:46:05.342 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 39993 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/adp8870_bl.ko 2023-10-08T11:46:05.342 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 16921 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/apple_bl.ko 2023-10-08T11:46:05.342 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 16777 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/as3711_bl.ko 2023-10-08T11:46:05.342 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 12097 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/bd6107.ko 2023-10-08T11:46:05.342 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11409 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/da903x_bl.ko 2023-10-08T11:46:05.342 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11273 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/da9052_bl.ko 2023-10-08T11:46:05.342 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11945 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/gpio_backlight.ko 2023-10-08T11:46:05.342 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 14769 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/kb3886_bl.ko 2023-10-08T11:46:05.342 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 22017 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/lcd.ko 2023-10-08T11:46:05.342 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 23657 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/lm3533_bl.ko 2023-10-08T11:46:05.342 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 19337 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/lm3639_bl.ko 2023-10-08T11:46:05.343 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11425 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/lv5207lp.ko 2023-10-08T11:46:05.343 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 14345 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/max8925_bl.ko 2023-10-08T11:46:05.343 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11313 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/pandora_bl.ko 2023-10-08T11:46:05.343 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 10865 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-10-08T11:46:05.343 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 10897 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/platform_lcd.ko 2023-10-08T11:46:05.343 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 12721 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/wm831x_bl.ko 2023-10-08T11:46:05.343 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/ 2023-10-08T11:46:05.343 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ 2023-10-08T11:46:05.343 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 18785 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2482.ko 2023-10-08T11:46:05.343 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 38961 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2490.ko 2023-10-08T11:46:05.343 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11265 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/matrox_w1.ko 2023-10-08T11:46:05.343 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 12417 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/w1-gpio.ko 2023-10-08T11:46:05.344 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/ 2023-10-08T11:46:05.344 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 12041 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-10-08T11:46:05.344 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 22809 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-10-08T11:46:05.344 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 15113 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-10-08T11:46:05.344 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 10825 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-10-08T11:46:05.344 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 14153 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-10-08T11:46:05.344 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11929 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-10-08T11:46:05.344 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 14113 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-10-08T11:46:05.344 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 14049 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-10-08T11:46:05.344 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 17921 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-10-08T11:46:05.344 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 7385 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_smem.ko 2023-10-08T11:46:05.344 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 56425 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_therm.ko 2023-10-08T11:46:05.345 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 102657 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/wire.ko 2023-10-08T11:46:05.345 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ 2023-10-08T11:46:05.345 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 18793 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/acquirewdt.ko 2023-10-08T11:46:05.345 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 19977 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/advantechwdt.ko 2023-10-08T11:46:05.345 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 18561 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim1535_wdt.ko 2023-10-08T11:46:05.345 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 22969 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim7101_wdt.ko 2023-10-08T11:46:05.345 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 19113 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/cpu5wdt.ko 2023-10-08T11:46:05.345 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13617 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/da9052_wdt.ko 2023-10-08T11:46:05.345 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 12777 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/da9055_wdt.ko 2023-10-08T11:46:05.345 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 17409 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/da9063_wdt.ko 2023-10-08T11:46:05.345 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 20169 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/dw_wdt.ko 2023-10-08T11:46:05.345 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 20265 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/eurotechwdt.ko 2023-10-08T11:46:05.346 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 23865 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/f71808e_wdt.ko 2023-10-08T11:46:05.346 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 27401 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/hpwdt.ko 2023-10-08T11:46:05.346 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 15577 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/i6300esb.ko 2023-10-08T11:46:05.346 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 10833 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-10-08T11:46:05.346 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 21913 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_wdt.ko 2023-10-08T11:46:05.346 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 19241 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ib700wdt.ko 2023-10-08T11:46:05.346 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 18689 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ibmasr.ko 2023-10-08T11:46:05.346 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 19713 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-10-08T11:46:05.346 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 21225 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it8712f_wdt.ko 2023-10-08T11:46:05.346 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13841 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it87_wdt.ko 2023-10-08T11:46:05.346 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 21489 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/kempld_wdt.ko 2023-10-08T11:46:05.346 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 18617 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/machzwd.ko 2023-10-08T11:46:05.347 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 14721 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/mena21_wdt.ko 2023-10-08T11:46:05.347 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13217 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-10-08T11:46:05.347 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 24673 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/nv_tco.ko 2023-10-08T11:46:05.347 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 17737 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-10-08T11:46:05.347 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 22265 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pc87413_wdt.ko 2023-10-08T11:46:05.347 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 38657 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_pci.ko 2023-10-08T11:46:05.347 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 31825 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_usb.ko 2023-10-08T11:46:05.347 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13129 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/retu_wdt.ko 2023-10-08T11:46:05.347 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 20449 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-10-08T11:46:05.347 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 14129 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-10-08T11:46:05.347 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 17321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-10-08T11:46:05.347 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 23809 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sc1200wdt.ko 2023-10-08T11:46:05.347 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 23321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sch311x_wdt.ko 2023-10-08T11:46:05.348 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 21577 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-10-08T11:46:05.348 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 17273 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/softdog.ko 2023-10-08T11:46:05.348 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 22273 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sp5100_tco.ko 2023-10-08T11:46:05.348 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 12817 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/twl4030_wdt.ko 2023-10-08T11:46:05.348 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 17649 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/via_wdt.ko 2023-10-08T11:46:05.348 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 19161 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-10-08T11:46:05.348 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 20681 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83877f_wdt.ko 2023-10-08T11:46:05.348 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 25409 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83977f_wdt.ko 2023-10-08T11:46:05.348 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 18497 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/wafer5823wdt.ko 2023-10-08T11:46:05.348 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 28089 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/wdt_pci.ko 2023-10-08T11:46:05.348 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 16257 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/wm831x_wdt.ko 2023-10-08T11:46:05.348 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13785 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/wm8350_wdt.ko 2023-10-08T11:46:05.348 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 15697 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/xen_wdt.ko 2023-10-08T11:46:05.349 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/ 2023-10-08T11:46:05.349 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 24729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-evtchn.ko 2023-10-08T11:46:05.349 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 26745 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntalloc.ko 2023-10-08T11:46:05.349 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 47841 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntdev.ko 2023-10-08T11:46:05.349 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback/ 2023-10-08T11:46:05.349 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 176417 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-10-08T11:46:05.349 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 40105 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-privcmd.ko 2023-10-08T11:46:05.349 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 71321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-scsiback.ko 2023-10-08T11:46:05.349 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs/ 2023-10-08T11:46:05.349 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 19425 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs/xenfs.ko 2023-10-08T11:46:05.349 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ 2023-10-08T11:46:05.349 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p/ 2023-10-08T11:46:05.350 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 165625 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p/9p.ko 2023-10-08T11:46:05.350 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/adfs/ 2023-10-08T11:46:05.350 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 60881 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/adfs/adfs.ko 2023-10-08T11:46:05.350 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs/ 2023-10-08T11:46:05.350 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 162617 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs/affs.ko 2023-10-08T11:46:05.350 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/afs/ 2023-10-08T11:46:05.350 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 931937 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/afs/kafs.ko 2023-10-08T11:46:05.350 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/autofs/ 2023-10-08T11:46:05.350 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 100937 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/autofs/autofs4.ko 2023-10-08T11:46:05.350 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs/ 2023-10-08T11:46:05.350 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 64481 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs/befs.ko 2023-10-08T11:46:05.350 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/bfs/ 2023-10-08T11:46:05.350 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 40993 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/bfs/bfs.ko 2023-10-08T11:46:05.351 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 34625 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/binfmt_misc.ko 2023-10-08T11:46:05.351 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs/ 2023-10-08T11:46:05.351 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 3474249 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs/btrfs.ko 2023-10-08T11:46:05.351 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles/ 2023-10-08T11:46:05.351 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 305745 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles/cachefiles.ko 2023-10-08T11:46:05.351 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph/ 2023-10-08T11:46:05.351 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 1316257 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph/ceph.ko 2023-10-08T11:46:05.351 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda/ 2023-10-08T11:46:05.351 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 100497 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda/coda.ko 2023-10-08T11:46:05.351 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/configfs/ 2023-10-08T11:46:05.351 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 108073 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/configfs/configfs.ko 2023-10-08T11:46:05.351 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs/ 2023-10-08T11:46:05.352 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 29273 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs/cramfs.ko 2023-10-08T11:46:05.352 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm/ 2023-10-08T11:46:05.352 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 633825 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm/dlm.ko 2023-10-08T11:46:05.352 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/efs/ 2023-10-08T11:46:05.352 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 36585 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/efs/efs.ko 2023-10-08T11:46:05.352 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs/ 2023-10-08T11:46:05.352 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 1500513 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs/f2fs.ko 2023-10-08T11:46:05.352 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/ 2023-10-08T11:46:05.352 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 27865 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/msdos.ko 2023-10-08T11:46:05.352 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/freevxfs/ 2023-10-08T11:46:05.352 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 42457 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/freevxfs/freevxfs.ko 2023-10-08T11:46:05.352 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache/ 2023-10-08T11:46:05.353 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 226505 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache/fscache.ko 2023-10-08T11:46:05.353 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/ 2023-10-08T11:46:05.353 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 24473 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/cuse.ko 2023-10-08T11:46:05.353 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2/ 2023-10-08T11:46:05.353 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 1226385 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2/gfs2.ko 2023-10-08T11:46:05.353 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs/ 2023-10-08T11:46:05.353 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 141241 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs/hfs.ko 2023-10-08T11:46:05.353 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus/ 2023-10-08T11:46:05.353 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 221553 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus/hfsplus.ko 2023-10-08T11:46:05.353 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hpfs/ 2023-10-08T11:46:05.353 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 193577 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hpfs/hpfs.ko 2023-10-08T11:46:05.353 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs/ 2023-10-08T11:46:05.353 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 74393 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs/isofs.ko 2023-10-08T11:46:05.354 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs/ 2023-10-08T11:46:05.354 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 421097 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs/jfs.ko 2023-10-08T11:46:05.354 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd/ 2023-10-08T11:46:05.354 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 279041 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd/lockd.ko 2023-10-08T11:46:05.354 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix/ 2023-10-08T11:46:05.354 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 87833 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix/minix.ko 2023-10-08T11:46:05.354 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs/ 2023-10-08T11:46:05.354 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 124697 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs/netfs.ko 2023-10-08T11:46:05.354 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/ 2023-10-08T11:46:05.354 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout/ 2023-10-08T11:46:05.354 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 81521 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-10-08T11:46:05.354 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout/ 2023-10-08T11:46:05.355 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 59425 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-10-08T11:46:05.355 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout/ 2023-10-08T11:46:05.355 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 117705 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-10-08T11:46:05.355 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 1053889 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfs.ko 2023-10-08T11:46:05.355 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 66089 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv2.ko 2023-10-08T11:46:05.355 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 119801 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv3.ko 2023-10-08T11:46:05.355 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 2041809 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv4.ko 2023-10-08T11:46:05.355 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/ 2023-10-08T11:46:05.355 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 16937 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/grace.ko 2023-10-08T11:46:05.355 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 16145 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/nfs_acl.ko 2023-10-08T11:46:05.355 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd/ 2023-10-08T11:46:05.355 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 1504929 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd/nfsd.ko 2023-10-08T11:46:05.356 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2/ 2023-10-08T11:46:05.356 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 591401 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2/nilfs2.ko 2023-10-08T11:46:05.356 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/ 2023-10-08T11:46:05.356 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13793 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-celtic.ko 2023-10-08T11:46:05.356 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13169 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-centeuro.ko 2023-10-08T11:46:05.356 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13793 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-croatian.ko 2023-10-08T11:46:05.356 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 12865 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-cyrillic.ko 2023-10-08T11:46:05.356 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13481 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-gaelic.ko 2023-10-08T11:46:05.356 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 12857 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-greek.ko 2023-10-08T11:46:05.356 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13793 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-iceland.ko 2023-10-08T11:46:05.356 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13169 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-inuit.ko 2023-10-08T11:46:05.356 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 14097 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-roman.ko 2023-10-08T11:46:05.357 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13793 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-romanian.ko 2023-10-08T11:46:05.357 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13793 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-turkish.ko 2023-10-08T11:46:05.357 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11297 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_ascii.ko 2023-10-08T11:46:05.357 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 12537 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1250.ko 2023-10-08T11:46:05.357 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 12233 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1251.ko 2023-10-08T11:46:05.357 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 12921 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1255.ko 2023-10-08T11:46:05.357 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 12537 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp737.ko 2023-10-08T11:46:05.357 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 12537 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp775.ko 2023-10-08T11:46:05.357 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 12225 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp850.ko 2023-10-08T11:46:05.357 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 12225 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp852.ko 2023-10-08T11:46:05.357 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 12225 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp855.ko 2023-10-08T11:46:05.357 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11913 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp857.ko 2023-10-08T11:46:05.358 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 12849 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp860.ko 2023-10-08T11:46:05.358 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13161 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp861.ko 2023-10-08T11:46:05.358 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13473 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp862.ko 2023-10-08T11:46:05.358 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13161 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp863.ko 2023-10-08T11:46:05.358 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 12849 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp864.ko 2023-10-08T11:46:05.358 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13161 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp865.ko 2023-10-08T11:46:05.358 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 12537 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp866.ko 2023-10-08T11:46:05.358 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 12225 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp869.ko 2023-10-08T11:46:05.358 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11985 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp874.ko 2023-10-08T11:46:05.358 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 94137 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp932.ko 2023-10-08T11:46:05.358 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 142673 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp936.ko 2023-10-08T11:46:05.358 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 165745 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp949.ko 2023-10-08T11:46:05.359 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 118121 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp950.ko 2023-10-08T11:46:05.359 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 12457 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_euc-jp.ko 2023-10-08T11:46:05.359 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11305 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-1.ko 2023-10-08T11:46:05.359 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11929 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-13.ko 2023-10-08T11:46:05.359 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11929 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-14.ko 2023-10-08T11:46:05.359 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11929 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-15.ko 2023-10-08T11:46:05.359 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11921 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-2.ko 2023-10-08T11:46:05.359 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11921 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-3.ko 2023-10-08T11:46:05.359 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11921 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-4.ko 2023-10-08T11:46:05.359 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11921 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-5.ko 2023-10-08T11:46:05.359 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11617 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-6.ko 2023-10-08T11:46:05.359 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 12233 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-7.ko 2023-10-08T11:46:05.360 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11617 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-9.ko 2023-10-08T11:46:05.360 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 12537 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-r.ko 2023-10-08T11:46:05.360 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 8017 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-ru.ko 2023-10-08T11:46:05.360 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 12537 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-u.ko 2023-10-08T11:46:05.360 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 8337 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_utf8.ko 2023-10-08T11:46:05.360 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ntfs/ 2023-10-08T11:46:05.360 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 219361 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ntfs/ntfs.ko 2023-10-08T11:46:05.360 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ 2023-10-08T11:46:05.360 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster/ 2023-10-08T11:46:05.360 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 244177 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-10-08T11:46:05.360 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm/ 2023-10-08T11:46:05.360 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 440785 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-10-08T11:46:05.360 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs/ 2023-10-08T11:46:05.361 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 53841 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-10-08T11:46:05.361 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 2589873 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2.ko 2023-10-08T11:46:05.361 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 17905 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-10-08T11:46:05.361 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 31585 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-10-08T11:46:05.361 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 35881 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-10-08T11:46:05.361 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/omfs/ 2023-10-08T11:46:05.361 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 52569 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/omfs/omfs.ko 2023-10-08T11:46:05.361 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs/ 2023-10-08T11:46:05.361 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 336889 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs/overlay.ko 2023-10-08T11:46:05.361 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore/ 2023-10-08T11:46:05.361 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 54609 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore/ramoops.ko 2023-10-08T11:46:05.361 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/qnx4/ 2023-10-08T11:46:05.362 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 26801 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/qnx4/qnx4.ko 2023-10-08T11:46:05.362 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/qnx6/ 2023-10-08T11:46:05.362 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 46649 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/qnx6/qnx6.ko 2023-10-08T11:46:05.362 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/quota/ 2023-10-08T11:46:05.362 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 30881 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/quota/quota_tree.ko 2023-10-08T11:46:05.362 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 14361 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/quota/quota_v1.ko 2023-10-08T11:46:05.362 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 22017 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/quota/quota_v2.ko 2023-10-08T11:46:05.362 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs/ 2023-10-08T11:46:05.362 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 530697 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs/reiserfs.ko 2023-10-08T11:46:05.362 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs/ 2023-10-08T11:46:05.362 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 28505 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs/romfs.ko 2023-10-08T11:46:05.362 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/ 2023-10-08T11:46:05.363 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client/ 2023-10-08T11:46:05.363 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 2661209 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client/cifs.ko 2023-10-08T11:46:05.363 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/ 2023-10-08T11:46:05.363 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 7161 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_arc4.ko 2023-10-08T11:46:05.363 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11257 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_md4.ko 2023-10-08T11:46:05.363 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs/ 2023-10-08T11:46:05.363 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 134313 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs/squashfs.ko 2023-10-08T11:46:05.363 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv/ 2023-10-08T11:46:05.363 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 89737 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv/sysv.ko 2023-10-08T11:46:05.363 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf/ 2023-10-08T11:46:05.363 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 248049 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf/udf.ko 2023-10-08T11:46:05.363 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs/ 2023-10-08T11:46:05.363 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 160857 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs/ufs.ko 2023-10-08T11:46:05.364 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs/ 2023-10-08T11:46:05.364 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 3998129 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs/xfs.ko 2023-10-08T11:46:05.364 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/ 2023-10-08T11:46:05.364 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/locking/ 2023-10-08T11:46:05.364 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 74865 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/locking/locktorture.ko 2023-10-08T11:46:05.364 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/time/ 2023-10-08T11:46:05.364 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13737 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/time/test_udelay.ko 2023-10-08T11:46:05.364 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 58473 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/torture.ko 2023-10-08T11:46:05.364 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ 2023-10-08T11:46:05.364 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 6833 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc-itu-t.ko 2023-10-08T11:46:05.364 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 6529 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc7.ko 2023-10-08T11:46:05.364 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 7025 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc8.ko 2023-10-08T11:46:05.365 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/ 2023-10-08T11:46:05.365 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 7097 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libarc4.ko 2023-10-08T11:46:05.365 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 37081 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libdes.ko 2023-10-08T11:46:05.365 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13313 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/interval_tree_test.ko 2023-10-08T11:46:05.365 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 8425 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/libcrc32c.ko 2023-10-08T11:46:05.365 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 24929 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lru_cache.ko 2023-10-08T11:46:05.365 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/ 2023-10-08T11:46:05.365 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 33801 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4_compress.ko 2023-10-08T11:46:05.365 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 22633 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4hc_compress.ko 2023-10-08T11:46:05.365 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math/ 2023-10-08T11:46:05.365 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 6617 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math/cordic.ko 2023-10-08T11:46:05.365 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 8233 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/memory-notifier-error-inject.ko 2023-10-08T11:46:05.365 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 10929 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/notifier-error-inject.ko 2023-10-08T11:46:05.366 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 14089 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/percpu_test.ko 2023-10-08T11:46:05.366 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 8305 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/pm-notifier-error-inject.ko 2023-10-08T11:46:05.366 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6/ 2023-10-08T11:46:05.366 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 143433 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6/raid6_pq.ko 2023-10-08T11:46:05.366 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 21105 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/rbtree_test.ko 2023-10-08T11:46:05.366 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon/ 2023-10-08T11:46:05.366 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 18737 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon/reed_solomon.ko 2023-10-08T11:46:05.366 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 38841 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/test-kstrtox.ko 2023-10-08T11:46:05.366 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 26321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/test-string_helpers.ko 2023-10-08T11:46:05.366 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 4760825 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/test_bpf.ko 2023-10-08T11:46:05.366 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 49081 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/test_firmware.ko 2023-10-08T11:46:05.366 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 6369 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/test_module.ko 2023-10-08T11:46:05.367 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 20801 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/test_user_copy.ko 2023-10-08T11:46:05.367 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 9585 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_bm.ko 2023-10-08T11:46:05.367 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11121 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_fsm.ko 2023-10-08T11:46:05.367 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 9689 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_kmp.ko 2023-10-08T11:46:05.367 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/xz/ 2023-10-08T11:46:05.367 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13545 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/xz/xz_dec_test.ko 2023-10-08T11:46:05.367 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm/ 2023-10-08T11:46:05.367 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 15489 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm/hwpoison-inject.ko 2023-10-08T11:46:05.367 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ 2023-10-08T11:46:05.367 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/ 2023-10-08T11:46:05.367 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 55737 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/6lowpan.ko 2023-10-08T11:46:05.367 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 7049 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_dest.ko 2023-10-08T11:46:05.368 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 7065 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_fragment.ko 2023-10-08T11:46:05.368 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 7049 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_hop.ko 2023-10-08T11:46:05.368 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 6985 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_ipv6.ko 2023-10-08T11:46:05.368 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 7065 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_mobility.ko 2023-10-08T11:46:05.368 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 7065 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_routing.ko 2023-10-08T11:46:05.368 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 15329 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_udp.ko 2023-10-08T11:46:05.368 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/ 2023-10-08T11:46:05.368 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 30385 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/garp.ko 2023-10-08T11:46:05.368 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 34785 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/mrp.ko 2023-10-08T11:46:05.368 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 8545 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/p8022.ko 2023-10-08T11:46:05.368 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 15841 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/psnap.ko 2023-10-08T11:46:05.368 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11537 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/stp.ko 2023-10-08T11:46:05.369 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q/ 2023-10-08T11:46:05.369 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 81017 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q/8021q.ko 2023-10-08T11:46:05.369 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/ 2023-10-08T11:46:05.369 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 198465 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet.ko 2023-10-08T11:46:05.369 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 35961 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_fd.ko 2023-10-08T11:46:05.369 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 26345 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_rdma.ko 2023-10-08T11:46:05.369 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 32321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_virtio.ko 2023-10-08T11:46:05.369 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv/ 2023-10-08T11:46:05.369 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 652553 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv/batman-adv.ko 2023-10-08T11:46:05.369 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/ 2023-10-08T11:46:05.369 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 63825 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/br_netfilter.ko 2023-10-08T11:46:05.369 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 772505 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/bridge.ko 2023-10-08T11:46:05.369 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ 2023-10-08T11:46:05.370 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 7657 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-10-08T11:46:05.370 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 12385 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_among.ko 2023-10-08T11:46:05.370 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 9169 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arp.ko 2023-10-08T11:46:05.370 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 9073 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-10-08T11:46:05.370 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 9625 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-10-08T11:46:05.370 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 8737 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip.ko 2023-10-08T11:46:05.370 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 9145 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-10-08T11:46:05.370 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 9825 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_limit.ko 2023-10-08T11:46:05.370 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13217 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_log.ko 2023-10-08T11:46:05.370 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 7585 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark.ko 2023-10-08T11:46:05.370 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 7593 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-10-08T11:46:05.370 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 8385 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-10-08T11:46:05.371 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 7537 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-10-08T11:46:05.371 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 9593 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-10-08T11:46:05.371 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 8649 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_snat.ko 2023-10-08T11:46:05.371 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 8889 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_stp.ko 2023-10-08T11:46:05.371 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 12401 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-10-08T11:46:05.371 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11529 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-10-08T11:46:05.371 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 9817 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-10-08T11:46:05.371 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 9793 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-10-08T11:46:05.371 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 55937 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtables.ko 2023-10-08T11:46:05.371 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 14041 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-10-08T11:46:05.371 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13945 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-10-08T11:46:05.372 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph/ 2023-10-08T11:46:05.372 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 1046921 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph/libceph.ko 2023-10-08T11:46:05.372 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/ 2023-10-08T11:46:05.372 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 124793 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/pktgen.ko 2023-10-08T11:46:05.372 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/ 2023-10-08T11:46:05.372 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 194321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp.ko 2023-10-08T11:46:05.372 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 8665 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_diag.ko 2023-10-08T11:46:05.372 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 56945 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv4.ko 2023-10-08T11:46:05.372 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 59457 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv6.ko 2023-10-08T11:46:05.372 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/ 2023-10-08T11:46:05.372 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 390297 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/dsa_core.ko 2023-10-08T11:46:05.372 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13337 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_brcm.ko 2023-10-08T11:46:05.373 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 12577 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_dsa.ko 2023-10-08T11:46:05.373 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 7721 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_none.ko 2023-10-08T11:46:05.373 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 8953 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_trailer.ko 2023-10-08T11:46:05.373 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/hsr/ 2023-10-08T11:46:05.373 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 100257 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/hsr/hsr.ko 2023-10-08T11:46:05.373 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ 2023-10-08T11:46:05.373 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan/ 2023-10-08T11:46:05.373 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 45169 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-10-08T11:46:05.373 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 254601 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154.ko 2023-10-08T11:46:05.373 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 47265 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154_socket.ko 2023-10-08T11:46:05.373 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ 2023-10-08T11:46:05.374 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 24729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ah4.ko 2023-10-08T11:46:05.374 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 38905 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/esp4.ko 2023-10-08T11:46:05.374 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 48345 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/fou.ko 2023-10-08T11:46:05.374 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 18241 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/gre.ko 2023-10-08T11:46:05.374 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 48529 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/inet_diag.ko 2023-10-08T11:46:05.374 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 60593 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_gre.ko 2023-10-08T11:46:05.374 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 61281 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_tunnel.ko 2023-10-08T11:46:05.374 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 34457 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_vti.ko 2023-10-08T11:46:05.374 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 14001 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipcomp.ko 2023-10-08T11:46:05.374 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 28889 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipip.ko 2023-10-08T11:46:05.374 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ 2023-10-08T11:46:05.374 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 37689 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arp_tables.ko 2023-10-08T11:46:05.375 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 8873 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-10-08T11:46:05.375 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 10409 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-10-08T11:46:05.375 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 41601 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ip_tables.ko 2023-10-08T11:46:05.375 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 10057 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-10-08T11:46:05.375 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 9681 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-10-08T11:46:05.375 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 14145 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-10-08T11:46:05.375 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11177 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-10-08T11:46:05.375 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 14929 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-10-08T11:46:05.375 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11305 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-10-08T11:46:05.375 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11649 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-10-08T11:46:05.375 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 14929 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-10-08T11:46:05.375 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11545 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-10-08T11:46:05.376 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 10409 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_security.ko 2023-10-08T11:46:05.376 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 12169 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-10-08T11:46:05.376 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 8817 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-10-08T11:46:05.376 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 27625 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-10-08T11:46:05.376 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 18225 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-10-08T11:46:05.376 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13337 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-10-08T11:46:05.376 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 20561 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-10-08T11:46:05.376 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 9329 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-10-08T11:46:05.376 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 15225 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-10-08T11:46:05.376 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 9961 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-10-08T11:46:05.376 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 17161 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-10-08T11:46:05.376 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 9009 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-10-08T11:46:05.377 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13073 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_bic.ko 2023-10-08T11:46:05.377 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13737 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_dctcp.ko 2023-10-08T11:46:05.377 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 15121 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_diag.ko 2023-10-08T11:46:05.377 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 9537 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_highspeed.ko 2023-10-08T11:46:05.377 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 12401 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_htcp.ko 2023-10-08T11:46:05.377 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 10449 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_hybla.ko 2023-10-08T11:46:05.377 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11473 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_illinois.ko 2023-10-08T11:46:05.377 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 10433 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_lp.ko 2023-10-08T11:46:05.377 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 8329 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_scalable.ko 2023-10-08T11:46:05.377 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 14425 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_vegas.ko 2023-10-08T11:46:05.377 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 10089 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_veno.ko 2023-10-08T11:46:05.377 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 10953 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_westwood.ko 2023-10-08T11:46:05.377 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 10185 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_yeah.ko 2023-10-08T11:46:05.378 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 22601 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tunnel4.ko 2023-10-08T11:46:05.378 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 16361 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_diag.ko 2023-10-08T11:46:05.378 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 41577 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_tunnel.ko 2023-10-08T11:46:05.378 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11425 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/xfrm4_tunnel.ko 2023-10-08T11:46:05.378 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ 2023-10-08T11:46:05.378 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 26441 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ah6.ko 2023-10-08T11:46:05.378 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 39537 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/esp6.ko 2023-10-08T11:46:05.378 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 14425 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/fou6.ko 2023-10-08T11:46:05.378 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 80793 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_gre.ko 2023-10-08T11:46:05.378 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 92817 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_tunnel.ko 2023-10-08T11:46:05.378 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 10609 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-10-08T11:46:05.379 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 54089 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_vti.ko 2023-10-08T11:46:05.379 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13785 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ipcomp6.ko 2023-10-08T11:46:05.379 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 19017 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/mip6.ko 2023-10-08T11:46:05.379 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ 2023-10-08T11:46:05.379 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 42209 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-10-08T11:46:05.379 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11753 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-10-08T11:46:05.379 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 9753 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-10-08T11:46:05.379 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 14161 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-10-08T11:46:05.379 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 14337 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-10-08T11:46:05.379 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 7801 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-10-08T11:46:05.379 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 16209 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-10-08T11:46:05.379 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 16033 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-10-08T11:46:05.380 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 8913 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-10-08T11:46:05.380 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 9897 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-10-08T11:46:05.380 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 10937 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-10-08T11:46:05.380 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 10897 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-10-08T11:46:05.380 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-10-08T11:46:05.380 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11121 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-10-08T11:46:05.380 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 14969 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-10-08T11:46:05.380 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11617 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-10-08T11:46:05.380 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 10433 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-10-08T11:46:05.380 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 38833 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-10-08T11:46:05.380 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 8449 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-10-08T11:46:05.380 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 26057 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-10-08T11:46:05.381 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 9801 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-10-08T11:46:05.381 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 15441 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-10-08T11:46:05.381 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 9633 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-10-08T11:46:05.381 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 16025 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-10-08T11:46:05.381 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 9009 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-10-08T11:46:05.381 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 73161 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/sit.ko 2023-10-08T11:46:05.381 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 24193 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/tunnel6.ko 2023-10-08T11:46:05.381 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 23305 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/xfrm6_tunnel.ko 2023-10-08T11:46:05.381 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key/ 2023-10-08T11:46:05.381 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 82929 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key/af_key.ko 2023-10-08T11:46:05.381 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/ 2023-10-08T11:46:05.381 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 125873 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_core.ko 2023-10-08T11:46:05.381 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 20273 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_debugfs.ko 2023-10-08T11:46:05.382 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 25865 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_eth.ko 2023-10-08T11:46:05.382 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 35049 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip.ko 2023-10-08T11:46:05.382 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 36745 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip6.ko 2023-10-08T11:46:05.382 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 33001 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_netlink.ko 2023-10-08T11:46:05.382 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 53153 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ppp.ko 2023-10-08T11:46:05.382 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/lapb/ 2023-10-08T11:46:05.382 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 48065 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/lapb/lapb.ko 2023-10-08T11:46:05.382 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc/ 2023-10-08T11:46:05.382 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 23225 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc/llc.ko 2023-10-08T11:46:05.382 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 267257 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc/llc2.ko 2023-10-08T11:46:05.382 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154/ 2023-10-08T11:46:05.383 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 291041 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154/mac802154.ko 2023-10-08T11:46:05.383 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls/ 2023-10-08T11:46:05.383 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 9393 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls/mpls_gso.ko 2023-10-08T11:46:05.383 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ 2023-10-08T11:46:05.383 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ 2023-10-08T11:46:05.383 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 119649 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set.ko 2023-10-08T11:46:05.383 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 28449 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-10-08T11:46:05.383 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 27033 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-10-08T11:46:05.383 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 26465 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-10-08T11:46:05.383 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 102033 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-10-08T11:46:05.383 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 103121 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-10-08T11:46:05.383 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 104593 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-10-08T11:46:05.384 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 105129 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-10-08T11:46:05.384 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 114393 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-10-08T11:46:05.384 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 61161 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-10-08T11:46:05.384 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 111161 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-10-08T11:46:05.384 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 114673 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-10-08T11:46:05.384 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 114329 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-10-08T11:46:05.384 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 113217 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-10-08T11:46:05.384 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 116217 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-10-08T11:46:05.384 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 30145 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-10-08T11:46:05.384 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ 2023-10-08T11:46:05.384 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 412889 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs.ko 2023-10-08T11:46:05.384 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11961 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-10-08T11:46:05.384 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 7625 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-10-08T11:46:05.385 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 17729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-10-08T11:46:05.385 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 17905 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-10-08T11:46:05.385 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 20657 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-10-08T11:46:05.385 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 7689 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-10-08T11:46:05.385 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 7689 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-10-08T11:46:05.385 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 10681 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-10-08T11:46:05.385 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 9233 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-10-08T11:46:05.385 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 7697 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-10-08T11:46:05.385 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13521 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-10-08T11:46:05.385 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 7697 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-10-08T11:46:05.385 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 10993 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-10-08T11:46:05.386 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 48897 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conncount.ko 2023-10-08T11:46:05.386 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 408665 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack.ko 2023-10-08T11:46:05.386 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 15985 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-10-08T11:46:05.386 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 10177 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-10-08T11:46:05.386 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 33761 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-10-08T11:46:05.386 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 118145 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_h323.ko 2023-10-08T11:46:05.386 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 22185 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_irc.ko 2023-10-08T11:46:05.386 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 8817 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-10-08T11:46:05.386 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 108393 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-10-08T11:46:05.386 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 33825 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-10-08T11:46:05.386 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 17401 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sane.ko 2023-10-08T11:46:05.386 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 66641 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sip.ko 2023-10-08T11:46:05.387 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11233 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-10-08T11:46:05.387 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 19185 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-10-08T11:46:05.387 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 10113 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_dup_netdev.ko 2023-10-08T11:46:05.387 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 88513 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table.ko 2023-10-08T11:46:05.387 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 9593 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table_inet.ko 2023-10-08T11:46:05.387 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 37129 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_log_syslog.ko 2023-10-08T11:46:05.387 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 95353 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat.ko 2023-10-08T11:46:05.387 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 10129 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_amanda.ko 2023-10-08T11:46:05.387 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 12625 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_ftp.ko 2023-10-08T11:46:05.387 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11857 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_irc.ko 2023-10-08T11:46:05.387 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 28929 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_sip.ko 2023-10-08T11:46:05.387 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 8809 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_tftp.ko 2023-10-08T11:46:05.387 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 44025 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_synproxy_core.ko 2023-10-08T11:46:05.388 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 609257 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_tables.ko 2023-10-08T11:46:05.388 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 43873 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink.ko 2023-10-08T11:46:05.388 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 30273 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_acct.ko 2023-10-08T11:46:05.388 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 30625 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-10-08T11:46:05.388 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 39905 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_log.ko 2023-10-08T11:46:05.388 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 22713 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_osf.ko 2023-10-08T11:46:05.388 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 49673 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_queue.ko 2023-10-08T11:46:05.388 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 10457 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_chain_nat.ko 2023-10-08T11:46:05.388 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 33257 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_compat.ko 2023-10-08T11:46:05.388 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 40721 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_ct.ko 2023-10-08T11:46:05.388 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 9601 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_dup_netdev.ko 2023-10-08T11:46:05.388 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11345 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fib.ko 2023-10-08T11:46:05.389 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13745 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fwd_netdev.ko 2023-10-08T11:46:05.389 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 14185 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_hash.ko 2023-10-08T11:46:05.389 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 20065 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_limit.ko 2023-10-08T11:46:05.389 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 15401 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_log.ko 2023-10-08T11:46:05.389 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 14801 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_masq.ko 2023-10-08T11:46:05.389 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 14441 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_nat.ko 2023-10-08T11:46:05.389 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13673 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_numgen.ko 2023-10-08T11:46:05.389 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11793 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_osf.ko 2023-10-08T11:46:05.389 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 14073 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_queue.ko 2023-10-08T11:46:05.389 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 14257 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_redir.ko 2023-10-08T11:46:05.389 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 10497 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject.ko 2023-10-08T11:46:05.389 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 10081 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject_inet.ko 2023-10-08T11:46:05.390 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 12737 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_socket.ko 2023-10-08T11:46:05.390 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 20393 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_synproxy.ko 2023-10-08T11:46:05.390 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 14849 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_tproxy.ko 2023-10-08T11:46:05.390 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 89329 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/x_tables.ko 2023-10-08T11:46:05.390 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 12097 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_AUDIT.ko 2023-10-08T11:46:05.390 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 9633 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CHECKSUM.ko 2023-10-08T11:46:05.390 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 7729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CLASSIFY.ko 2023-10-08T11:46:05.390 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11521 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-10-08T11:46:05.390 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 18169 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CT.ko 2023-10-08T11:46:05.390 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 10497 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_DSCP.ko 2023-10-08T11:46:05.390 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 9465 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HL.ko 2023-10-08T11:46:05.390 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13433 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HMARK.ko 2023-10-08T11:46:05.391 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 38857 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_IDLETIMER.ko 2023-10-08T11:46:05.391 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13873 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LED.ko 2023-10-08T11:46:05.391 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11489 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LOG.ko 2023-10-08T11:46:05.391 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11753 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_MASQUERADE.ko 2023-10-08T11:46:05.391 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11657 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NETMAP.ko 2023-10-08T11:46:05.391 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 9473 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFLOG.ko 2023-10-08T11:46:05.391 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13289 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFQUEUE.ko 2023-10-08T11:46:05.391 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 19689 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_RATEEST.ko 2023-10-08T11:46:05.391 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11073 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_REDIRECT.ko 2023-10-08T11:46:05.391 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 14337 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_SECMARK.ko 2023-10-08T11:46:05.391 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 16057 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPMSS.ko 2023-10-08T11:46:05.391 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 10433 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-10-08T11:46:05.392 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 17369 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TEE.ko 2023-10-08T11:46:05.392 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 16785 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TPROXY.ko 2023-10-08T11:46:05.392 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 8321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TRACE.ko 2023-10-08T11:46:05.392 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13897 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_addrtype.ko 2023-10-08T11:46:05.392 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13897 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_bpf.ko 2023-10-08T11:46:05.392 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 15577 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cgroup.ko 2023-10-08T11:46:05.392 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11209 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cluster.ko 2023-10-08T11:46:05.392 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 7505 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_comment.ko 2023-10-08T11:46:05.392 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 10465 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connbytes.ko 2023-10-08T11:46:05.392 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11081 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlabel.ko 2023-10-08T11:46:05.392 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 9401 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlimit.ko 2023-10-08T11:46:05.392 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13129 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connmark.ko 2023-10-08T11:46:05.392 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 12401 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_conntrack.ko 2023-10-08T11:46:05.393 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 7817 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cpu.ko 2023-10-08T11:46:05.393 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 10969 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dccp.ko 2023-10-08T11:46:05.393 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 7865 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_devgroup.ko 2023-10-08T11:46:05.393 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 8801 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dscp.ko 2023-10-08T11:46:05.393 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 10657 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ecn.ko 2023-10-08T11:46:05.393 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11473 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_esp.ko 2023-10-08T11:46:05.393 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 43457 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hashlimit.ko 2023-10-08T11:46:05.393 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11313 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_helper.ko 2023-10-08T11:46:05.393 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 7865 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hl.ko 2023-10-08T11:46:05.393 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11921 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipcomp.ko 2023-10-08T11:46:05.393 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11473 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_iprange.ko 2023-10-08T11:46:05.393 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11785 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipvs.ko 2023-10-08T11:46:05.394 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 16041 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_l2tp.ko 2023-10-08T11:46:05.394 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 8001 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_length.ko 2023-10-08T11:46:05.394 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 10273 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_limit.ko 2023-10-08T11:46:05.394 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 7545 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mac.ko 2023-10-08T11:46:05.394 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 8641 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mark.ko 2023-10-08T11:46:05.394 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11825 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_multiport.ko 2023-10-08T11:46:05.394 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13817 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nat.ko 2023-10-08T11:46:05.394 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 10105 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nfacct.ko 2023-10-08T11:46:05.394 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 8297 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_osf.ko 2023-10-08T11:46:05.394 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 9553 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_owner.ko 2023-10-08T11:46:05.394 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 9729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_physdev.ko 2023-10-08T11:46:05.394 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 7633 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_pkttype.ko 2023-10-08T11:46:05.395 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11985 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_policy.ko 2023-10-08T11:46:05.395 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 9473 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_quota.ko 2023-10-08T11:46:05.395 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 10409 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_rateest.ko 2023-10-08T11:46:05.395 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 8257 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_realm.ko 2023-10-08T11:46:05.395 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 36441 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_recent.ko 2023-10-08T11:46:05.395 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13329 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_sctp.ko 2023-10-08T11:46:05.395 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 30089 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_set.ko 2023-10-08T11:46:05.395 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 16089 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_socket.ko 2023-10-08T11:46:05.395 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 9505 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_state.ko 2023-10-08T11:46:05.395 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 9473 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_statistic.ko 2023-10-08T11:46:05.395 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 8809 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_string.ko 2023-10-08T11:46:05.395 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 8553 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_tcpmss.ko 2023-10-08T11:46:05.396 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 15777 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_tcpudp.ko 2023-10-08T11:46:05.396 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11129 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_time.ko 2023-10-08T11:46:05.396 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 9105 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_u32.ko 2023-10-08T11:46:05.396 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink/ 2023-10-08T11:46:05.396 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13969 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink/netlink_diag.ko 2023-10-08T11:46:05.396 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh/ 2023-10-08T11:46:05.396 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 12425 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh/nsh.ko 2023-10-08T11:46:05.396 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/ 2023-10-08T11:46:05.396 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 379545 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/openvswitch.ko 2023-10-08T11:46:05.396 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 10321 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-geneve.ko 2023-10-08T11:46:05.396 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 9449 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-gre.ko 2023-10-08T11:46:05.396 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 11793 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-vxlan.ko 2023-10-08T11:46:05.397 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet/ 2023-10-08T11:46:05.397 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13057 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet/af_packet_diag.ko 2023-10-08T11:46:05.397 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/phonet/ 2023-10-08T11:46:05.397 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 109961 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/phonet/phonet.ko 2023-10-08T11:46:05.397 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 54761 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/phonet/pn_pep.ko 2023-10-08T11:46:05.397 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/ 2023-10-08T11:46:05.397 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 252889 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds.ko 2023-10-08T11:46:05.397 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 165081 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_rdma.ko 2023-10-08T11:46:05.397 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 67241 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_tcp.ko 2023-10-08T11:46:05.397 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rxrpc/ 2023-10-08T11:46:05.397 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 820137 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rxrpc/rxrpc.ko 2023-10-08T11:46:05.397 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/ 2023-10-08T11:46:05.398 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 32249 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_csum.ko 2023-10-08T11:46:05.398 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 23537 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_gact.ko 2023-10-08T11:46:05.398 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 26897 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_ipt.ko 2023-10-08T11:46:05.398 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 34057 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_mirred.ko 2023-10-08T11:46:05.398 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 23425 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_nat.ko 2023-10-08T11:46:05.398 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 43817 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_pedit.ko 2023-10-08T11:46:05.398 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 31985 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_police.ko 2023-10-08T11:46:05.398 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 20313 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_simple.ko 2023-10-08T11:46:05.398 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 36353 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_skbedit.ko 2023-10-08T11:46:05.398 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 36057 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_vlan.ko 2023-10-08T11:46:05.398 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 26145 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_basic.ko 2023-10-08T11:46:05.398 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 33945 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_bpf.ko 2023-10-08T11:46:05.399 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 19233 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_cgroup.ko 2023-10-08T11:46:05.399 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 31377 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_flow.ko 2023-10-08T11:46:05.399 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 31769 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_fw.ko 2023-10-08T11:46:05.399 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 38489 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_route.ko 2023-10-08T11:46:05.399 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 61409 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_u32.ko 2023-10-08T11:46:05.399 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 7441 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_cmp.ko 2023-10-08T11:46:05.399 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 13457 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_ipset.ko 2023-10-08T11:46:05.399 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 33337 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_meta.ko 2023-10-08T11:46:05.399 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 7897 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_nbyte.ko 2023-10-08T11:46:05.399 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 10625 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_text.ko 2023-10-08T11:46:05.399 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 7249 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_u32.ko 2023-10-08T11:46:05.399 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 21649 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_choke.ko 2023-10-08T11:46:05.400 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 20849 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_codel.ko 2023-10-08T11:46:05.400 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 33753 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_drr.ko 2023-10-08T11:46:05.400 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 33609 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_fq.ko 2023-10-08T11:46:05.400 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 31601 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_fq_codel.ko 2023-10-08T11:46:05.400 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 35433 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_gred.ko 2023-10-08T11:46:05.400 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 48409 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hfsc.ko 2023-10-08T11:46:05.400 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 22073 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hhf.ko 2023-10-08T11:46:05.400 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 65793 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_htb.ko 2023-10-08T11:46:05.400 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 16065 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_ingress.ko 2023-10-08T11:46:05.400 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 30273 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio.ko 2023-10-08T11:46:05.400 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 10793 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio_lib.ko 2023-10-08T11:46:05.400 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 26065 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_multiq.ko 2023-10-08T11:46:05.400 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 35601 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_netem.ko 2023-10-08T11:46:05.401 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 27545 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_pie.ko 2023-10-08T11:46:05.401 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 10265 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_plug.ko 2023-10-08T11:46:05.401 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 24729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_prio.ko 2023-10-08T11:46:05.401 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 47849 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_qfq.ko 2023-10-08T11:46:05.401 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 32953 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_red.ko 2023-10-08T11:46:05.401 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 26881 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfb.ko 2023-10-08T11:46:05.401 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 31425 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfq.ko 2023-10-08T11:46:05.401 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 28897 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_tbf.ko 2023-10-08T11:46:05.401 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 27729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_teql.ko 2023-10-08T11:46:05.401 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/ 2023-10-08T11:46:05.401 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 930369 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp.ko 2023-10-08T11:46:05.402 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 19033 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp_diag.ko 2023-10-08T11:46:05.402 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/ 2023-10-08T11:46:05.402 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/ 2023-10-08T11:46:05.402 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 335569 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-10-08T11:46:05.402 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 61833 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-10-08T11:46:05.402 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 1514673 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/sunrpc.ko 2023-10-08T11:46:05.402 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma/ 2023-10-08T11:46:05.402 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 707401 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-10-08T11:46:05.402 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/ 2023-10-08T11:46:05.402 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 10025 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/diag.ko 2023-10-08T11:46:05.402 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 862385 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/tipc.ko 2023-10-08T11:46:05.402 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix/ 2023-10-08T11:46:05.402 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 15729 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix/unix_diag.ko 2023-10-08T11:46:05.403 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/ 2023-10-08T11:46:05.403 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 84841 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-10-08T11:46:05.403 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 68033 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-10-08T11:46:05.403 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 95985 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock.ko 2023-10-08T11:46:05.403 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 10705 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_diag.ko 2023-10-08T11:46:05.403 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 17521 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_loopback.ko 2023-10-08T11:46:05.403 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/x25/ 2023-10-08T11:46:05.403 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 125097 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/x25/x25.ko 2023-10-08T11:46:05.405 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm/ 2023-10-08T11:46:05.405 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 22657 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm/xfrm_algo.ko 2023-10-08T11:46:05.405 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 20705 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm/xfrm_ipcomp.ko 2023-10-08T11:46:05.405 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 102353 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm/xfrm_user.ko 2023-10-08T11:46:05.405 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/ 2023-10-08T11:46:05.405 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib/ 2023-10-08T11:46:05.406 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 15513 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib/irqbypass.ko 2023-10-08T11:46:05.406 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 638591 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias 2023-10-08T11:46:05.406 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 624324 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias.bin 2023-10-08T11:46:05.406 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 7656 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin 2023-10-08T11:46:05.406 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 23361 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.alias.bin 2023-10-08T11:46:05.406 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 9821 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.bin 2023-10-08T11:46:05.406 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 69921 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.modinfo 2023-10-08T11:46:05.406 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 146449 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep 2023-10-08T11:46:05.406 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 232695 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep.bin 2023-10-08T11:46:05.406 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 210 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/modules.devname 2023-10-08T11:46:05.406 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 72754 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/modules.order 2023-10-08T11:46:05.406 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 879 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/modules.softdep 2023-10-08T11:46:05.407 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 252880 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols 2023-10-08T11:46:05.407 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 307898 2023-09-11 01:59 ./lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols.bin 2023-10-08T11:46:05.407 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./usr/ 2023-10-08T11:46:05.407 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./usr/share/ 2023-10-08T11:46:05.407 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./usr/share/doc/ 2023-10-08T11:46:05.407 INFO:teuthology.orchestra.run.smithi156.stdout:drwxr-xr-x root/root 0 2023-09-11 01:59 ./usr/share/doc/linux-image-6.5.0-rc7-gfef64f93da2b/ 2023-10-08T11:46:05.407 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 175 2023-09-11 01:59 ./usr/share/doc/linux-image-6.5.0-rc7-gfef64f93da2b/changelog.Debian.gz 2023-10-08T11:46:05.407 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r-- root/root 691 2023-09-11 01:59 ./usr/share/doc/linux-image-6.5.0-rc7-gfef64f93da2b/copyright 2023-10-08T11:46:05.408 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc7-gfef64f93da2b 2023-10-08T11:46:05.408 INFO:teuthology.task.kernel:searching for kernel 6.5.0-rc7-gfef64f93da2b 2023-10-08T11:46:05.408 DEBUG:teuthology.orchestra.run.smithi156:> egrep '(submenu|menuentry.*6.5.0-rc7-gfef64f93da2b).*{' /boot/grub/grub.cfg 2023-10-08T11:46:05.415 INFO:teuthology.orchestra.run.smithi156.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-10-08T11:46:05.415 INFO:teuthology.orchestra.run.smithi156.stdout: menuentry 'Ubuntu, with Linux 6.5.0-rc7-gfef64f93da2b' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.5.0-rc7-gfef64f93da2b-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-10-08T11:46:05.415 INFO:teuthology.orchestra.run.smithi156.stdout: menuentry 'Ubuntu, with Linux 6.5.0-rc7-gfef64f93da2b (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.5.0-rc7-gfef64f93da2b-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-10-08T11:46:05.416 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-10-08T11:46:05.416 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.5.0-rc7-gfef64f93da2b 2023-10-08T11:46:05.416 DEBUG:teuthology.orchestra.run.smithi156:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-10-08T11:46:05.459 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi156.front.sepia.ceph.com to complete... 2023-10-08T11:46:05.860 INFO:teuthology.orchestra.run.smithi156.stderr:Sourcing file `/etc/default/grub' 2023-10-08T11:46:05.861 INFO:teuthology.orchestra.run.smithi156.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-08T11:46:05.886 INFO:teuthology.orchestra.run.smithi156.stderr:Generating grub configuration file ... 2023-10-08T11:46:06.096 INFO:teuthology.orchestra.run.smithi156.stderr:Found linux image: /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b 2023-10-08T11:46:06.101 INFO:teuthology.orchestra.run.smithi156.stderr:Found initrd image: /boot/initrd.img-6.5.0-rc7-gfef64f93da2b 2023-10-08T11:46:06.321 INFO:teuthology.orchestra.run.smithi156.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-10-08T11:46:06.327 INFO:teuthology.orchestra.run.smithi156.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-10-08T11:46:06.367 INFO:teuthology.orchestra.run.smithi156.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-10-08T11:46:06.372 INFO:teuthology.orchestra.run.smithi156.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-10-08T11:46:06.502 INFO:teuthology.orchestra.run.smithi156.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-10-08T11:46:06.502 INFO:teuthology.orchestra.run.smithi156.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-10-08T11:46:06.502 INFO:teuthology.orchestra.run.smithi156.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-10-08T11:46:06.524 INFO:teuthology.orchestra.run.smithi156.stderr:done 2023-10-08T11:46:37.618 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-10-08T11:46:37.619 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-10-08T11:46:37.619 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T11:47:12.126 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-10-08T11:47:21.127 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-10-08T11:47:21.128 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T11:47:39.514 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-10-08T11:47:51.515 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-10-08T11:47:51.516 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T11:47:51.999 DEBUG:teuthology.orchestra.run.smithi156:> true 2023-10-08T11:47:53.101 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-10-08T11:47:53.101 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.5.0-rc7-gfef64f93da2b"... 2023-10-08T11:47:53.102 DEBUG:teuthology.orchestra.run.smithi156:> uname -r 2023-10-08T11:47:53.156 INFO:teuthology.orchestra.run.smithi156.stdout:6.5.0-rc7-gfef64f93da2b 2023-10-08T11:47:53.157 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc7-gfef64f93da2b vs 6.5.0-rc7-gfef64f93da2b 2023-10-08T11:47:53.157 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-08T11:47:53.157 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-10-08T11:47:54.158 DEBUG:teuthology.parallel:result is None 2023-10-08T11:47:54.158 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-08T11:47:54.166 INFO:teuthology.task.internal:Creating test directory... 2023-10-08T11:47:54.166 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-08T11:47:54.169 DEBUG:teuthology.orchestra.run.smithi130:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-08T11:47:54.171 DEBUG:teuthology.orchestra.run.smithi156:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-08T11:47:54.180 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-08T11:47:54.188 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-08T11:47:54.196 INFO:teuthology.task.internal:Creating archive directory... 2023-10-08T11:47:54.196 DEBUG:teuthology.orchestra.run.smithi062:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-08T11:47:54.215 DEBUG:teuthology.orchestra.run.smithi130:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-08T11:47:54.219 DEBUG:teuthology.orchestra.run.smithi156:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-08T11:47:54.256 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-08T11:47:54.263 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-08T11:47:54.263 DEBUG:teuthology.orchestra.run.smithi062:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-08T11:47:54.273 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T11:47:54.274 DEBUG:teuthology.orchestra.run.smithi130:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-08T11:47:54.278 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T11:47:54.279 DEBUG:teuthology.orchestra.run.smithi062:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-08T11:47:54.319 DEBUG:teuthology.orchestra.run.smithi130:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-08T11:47:54.324 DEBUG:teuthology.orchestra.run.smithi156:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-08T11:47:54.352 INFO:teuthology.orchestra.run.smithi130.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T11:47:54.362 INFO:teuthology.orchestra.run.smithi062.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T11:47:54.366 INFO:teuthology.orchestra.run.smithi130.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T11:47:54.375 INFO:teuthology.orchestra.run.smithi062.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T11:47:54.413 INFO:teuthology.orchestra.run.smithi156.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T11:47:54.433 INFO:teuthology.orchestra.run.smithi156.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T11:47:54.436 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-08T11:47:54.443 INFO:teuthology.task.internal:Configuring sudo... 2023-10-08T11:47:54.443 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-08T11:47:54.446 DEBUG:teuthology.orchestra.run.smithi130:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-08T11:47:54.448 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-08T11:47:54.469 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-08T11:47:54.477 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-08T11:47:54.477 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-08T11:47:54.500 DEBUG:teuthology.orchestra.run.smithi130:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-08T11:47:54.507 DEBUG:teuthology.orchestra.run.smithi156:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-08T11:47:54.520 DEBUG:teuthology.orchestra.run.smithi062:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T11:47:54.550 DEBUG:teuthology.orchestra.run.smithi062:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T11:47:54.598 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-10-08T11:47:54.599 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-08T11:47:54.660 DEBUG:teuthology.orchestra.run.smithi130:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T11:47:54.666 DEBUG:teuthology.orchestra.run.smithi130:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T11:47:54.715 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-08T11:47:54.715 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-08T11:47:54.785 DEBUG:teuthology.orchestra.run.smithi156:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T11:47:54.794 DEBUG:teuthology.orchestra.run.smithi156:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T11:47:54.845 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-10-08T11:47:54.845 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-08T11:47:54.920 DEBUG:teuthology.orchestra.run.smithi062:> sudo service rsyslog restart 2023-10-08T11:47:54.922 DEBUG:teuthology.orchestra.run.smithi130:> sudo service rsyslog restart 2023-10-08T11:47:54.924 DEBUG:teuthology.orchestra.run.smithi156:> sudo service rsyslog restart 2023-10-08T11:47:55.045 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-08T11:47:55.054 INFO:teuthology.task.internal:Starting timer... 2023-10-08T11:47:55.054 INFO:teuthology.run_tasks:Running task pcp... 2023-10-08T11:47:55.067 INFO:teuthology.run_tasks:Running task selinux... 2023-10-08T11:47:55.076 DEBUG:teuthology.task.selinux:Excluding smithi062: OS 'ubuntu' does not support SELinux 2023-10-08T11:47:55.076 DEBUG:teuthology.task.selinux:Excluding smithi130: OS 'ubuntu' does not support SELinux 2023-10-08T11:47:55.076 DEBUG:teuthology.task.selinux:Excluding smithi156: OS 'ubuntu' does not support SELinux 2023-10-08T11:47:55.077 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-08T11:47:55.077 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-10-08T11:47:55.077 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-08T11:47:55.077 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-08T11:47:55.085 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-10-08T11:47:55.090 INFO:teuthology.repo_utils:Fetching main from origin 2023-10-08T11:47:55.230 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-08T11:47:55.248 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-08T11:47:55.249 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi062.front.sepia.ceph.com,smithi130.front.sepia.ceph.com,smithi156.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-08T11:56:21.225 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi062.front.sepia.ceph.com'), Remote(name='ubuntu@smithi130.front.sepia.ceph.com'), Remote(name='ubuntu@smithi156.front.sepia.ceph.com')] 2023-10-08T11:56:21.226 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2023-10-08T11:56:21.227 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T11:56:21.312 DEBUG:teuthology.orchestra.run.smithi062:> true 2023-10-08T11:56:21.426 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi062.front.sepia.ceph.com' 2023-10-08T11:56:21.427 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com' 2023-10-08T11:56:21.427 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T11:56:21.503 DEBUG:teuthology.orchestra.run.smithi130:> true 2023-10-08T11:56:21.607 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi130.front.sepia.ceph.com' 2023-10-08T11:56:21.607 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-10-08T11:56:21.608 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T11:56:21.685 DEBUG:teuthology.orchestra.run.smithi156:> true 2023-10-08T11:56:21.833 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-10-08T11:56:21.835 INFO:teuthology.run_tasks:Running task clock... 2023-10-08T11:56:21.845 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-08T11:56:21.845 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-08T11:56:21.846 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T11:56:21.848 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-08T11:56:21.848 DEBUG:teuthology.orchestra.run.smithi130:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T11:56:21.850 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-08T11:56:21.850 DEBUG:teuthology.orchestra.run.smithi156:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T11:56:21.874 INFO:teuthology.orchestra.run.smithi062.stdout: 8 Oct 11:56:21 ntpd[28422]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-10-08T11:56:21.875 INFO:teuthology.orchestra.run.smithi062.stdout: 8 Oct 11:56:21 ntpd[28422]: Command line: ntpd -gq 2023-10-08T11:56:21.875 INFO:teuthology.orchestra.run.smithi062.stdout: 8 Oct 11:56:21 ntpd[28422]: ---------------------------------------------------- 2023-10-08T11:56:21.875 INFO:teuthology.orchestra.run.smithi062.stdout: 8 Oct 11:56:21 ntpd[28422]: ntp-4 is maintained by Network Time Foundation, 2023-10-08T11:56:21.875 INFO:teuthology.orchestra.run.smithi062.stdout: 8 Oct 11:56:21 ntpd[28422]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-10-08T11:56:21.875 INFO:teuthology.orchestra.run.smithi062.stdout: 8 Oct 11:56:21 ntpd[28422]: corporation. Support and training for ntp-4 are 2023-10-08T11:56:21.875 INFO:teuthology.orchestra.run.smithi062.stdout: 8 Oct 11:56:21 ntpd[28422]: available at https://www.nwtime.org/support 2023-10-08T11:56:21.875 INFO:teuthology.orchestra.run.smithi062.stdout: 8 Oct 11:56:21 ntpd[28422]: ---------------------------------------------------- 2023-10-08T11:56:21.875 INFO:teuthology.orchestra.run.smithi062.stdout: 8 Oct 11:56:21 ntpd[28422]: proto: precision = 0.047 usec (-24) 2023-10-08T11:56:21.876 INFO:teuthology.orchestra.run.smithi062.stdout: 8 Oct 11:56:21 ntpd[28422]: basedate set to 2022-02-04 2023-10-08T11:56:21.876 INFO:teuthology.orchestra.run.smithi062.stdout: 8 Oct 11:56:21 ntpd[28422]: gps base set to 2022-02-06 (week 2196) 2023-10-08T11:56:21.876 INFO:teuthology.orchestra.run.smithi062.stdout: 8 Oct 11:56:21 ntpd[28422]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-08T11:56:21.877 INFO:teuthology.orchestra.run.smithi130.stdout: 8 Oct 11:56:21 ntpd[28413]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-10-08T11:56:21.877 INFO:teuthology.orchestra.run.smithi130.stdout: 8 Oct 11:56:21 ntpd[28413]: Command line: ntpd -gq 2023-10-08T11:56:21.877 INFO:teuthology.orchestra.run.smithi130.stdout: 8 Oct 11:56:21 ntpd[28413]: ---------------------------------------------------- 2023-10-08T11:56:21.877 INFO:teuthology.orchestra.run.smithi130.stdout: 8 Oct 11:56:21 ntpd[28413]: ntp-4 is maintained by Network Time Foundation, 2023-10-08T11:56:21.878 INFO:teuthology.orchestra.run.smithi130.stdout: 8 Oct 11:56:21 ntpd[28413]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-10-08T11:56:21.878 INFO:teuthology.orchestra.run.smithi130.stdout: 8 Oct 11:56:21 ntpd[28413]: corporation. Support and training for ntp-4 are 2023-10-08T11:56:21.878 INFO:teuthology.orchestra.run.smithi130.stdout: 8 Oct 11:56:21 ntpd[28413]: available at https://www.nwtime.org/support 2023-10-08T11:56:21.878 INFO:teuthology.orchestra.run.smithi130.stdout: 8 Oct 11:56:21 ntpd[28413]: ---------------------------------------------------- 2023-10-08T11:56:21.878 INFO:teuthology.orchestra.run.smithi130.stdout: 8 Oct 11:56:21 ntpd[28413]: proto: precision = 0.068 usec (-24) 2023-10-08T11:56:21.878 INFO:teuthology.orchestra.run.smithi130.stdout: 8 Oct 11:56:21 ntpd[28413]: basedate set to 2022-02-04 2023-10-08T11:56:21.878 INFO:teuthology.orchestra.run.smithi130.stdout: 8 Oct 11:56:21 ntpd[28413]: gps base set to 2022-02-06 (week 2196) 2023-10-08T11:56:21.878 INFO:teuthology.orchestra.run.smithi062.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-08T11:56:21.878 INFO:teuthology.orchestra.run.smithi062.stderr:restrict ::: KOD does nothing without LIMITED. 2023-10-08T11:56:21.879 INFO:teuthology.orchestra.run.smithi130.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-08T11:56:21.879 INFO:teuthology.orchestra.run.smithi130.stdout: 8 Oct 11:56:21 ntpd[28413]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-08T11:56:21.879 INFO:teuthology.orchestra.run.smithi130.stdout: 8 Oct 11:56:21 ntpd[28413]: restrict ::: KOD does nothing without LIMITED. 2023-10-08T11:56:21.880 INFO:teuthology.orchestra.run.smithi130.stderr:restrict ::: KOD does nothing without LIMITED. 2023-10-08T11:56:21.881 INFO:teuthology.orchestra.run.smithi062.stdout: 8 Oct 11:56:21 ntpd[28422]: restrict ::: KOD does nothing without LIMITED. 2023-10-08T11:56:21.881 INFO:teuthology.orchestra.run.smithi062.stdout: 8 Oct 11:56:21 ntpd[28422]: Listen and drop on 0 v6wildcard [::]:123 2023-10-08T11:56:21.881 INFO:teuthology.orchestra.run.smithi062.stdout: 8 Oct 11:56:21 ntpd[28422]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-10-08T11:56:21.881 INFO:teuthology.orchestra.run.smithi062.stdout: 8 Oct 11:56:21 ntpd[28422]: Listen normally on 2 lo 127.0.0.1:123 2023-10-08T11:56:21.881 INFO:teuthology.orchestra.run.smithi062.stdout: 8 Oct 11:56:21 ntpd[28422]: Listen normally on 3 enp3s0f1 172.21.15.62:123 2023-10-08T11:56:21.881 INFO:teuthology.orchestra.run.smithi062.stdout: 8 Oct 11:56:21 ntpd[28422]: Listen normally on 4 lo [::1]:123 2023-10-08T11:56:21.882 INFO:teuthology.orchestra.run.smithi062.stdout: 8 Oct 11:56:21 ntpd[28422]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:febb:d1c3%5]:123 2023-10-08T11:56:21.882 INFO:teuthology.orchestra.run.smithi062.stdout: 8 Oct 11:56:21 ntpd[28422]: Listening on routing socket on fd #22 for interface updates 2023-10-08T11:56:21.882 INFO:teuthology.orchestra.run.smithi130.stdout: 8 Oct 11:56:21 ntpd[28413]: Listen and drop on 0 v6wildcard [::]:123 2023-10-08T11:56:21.882 INFO:teuthology.orchestra.run.smithi130.stdout: 8 Oct 11:56:21 ntpd[28413]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-10-08T11:56:21.882 INFO:teuthology.orchestra.run.smithi130.stdout: 8 Oct 11:56:21 ntpd[28413]: Listen normally on 2 lo 127.0.0.1:123 2023-10-08T11:56:21.882 INFO:teuthology.orchestra.run.smithi130.stdout: 8 Oct 11:56:21 ntpd[28413]: Listen normally on 3 enp3s0f1 172.21.15.130:123 2023-10-08T11:56:21.883 INFO:teuthology.orchestra.run.smithi130.stdout: 8 Oct 11:56:21 ntpd[28413]: Listen normally on 4 lo [::1]:123 2023-10-08T11:56:21.883 INFO:teuthology.orchestra.run.smithi130.stdout: 8 Oct 11:56:21 ntpd[28413]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7f37%5]:123 2023-10-08T11:56:21.883 INFO:teuthology.orchestra.run.smithi130.stdout: 8 Oct 11:56:21 ntpd[28413]: Listening on routing socket on fd #22 for interface updates 2023-10-08T11:56:21.921 INFO:teuthology.orchestra.run.smithi156.stdout: 8 Oct 11:56:21 ntpd[27963]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-10-08T11:56:21.922 INFO:teuthology.orchestra.run.smithi156.stdout: 8 Oct 11:56:21 ntpd[27963]: Command line: ntpd -gq 2023-10-08T11:56:21.922 INFO:teuthology.orchestra.run.smithi156.stdout: 8 Oct 11:56:21 ntpd[27963]: ---------------------------------------------------- 2023-10-08T11:56:21.922 INFO:teuthology.orchestra.run.smithi156.stdout: 8 Oct 11:56:21 ntpd[27963]: ntp-4 is maintained by Network Time Foundation, 2023-10-08T11:56:21.922 INFO:teuthology.orchestra.run.smithi156.stdout: 8 Oct 11:56:21 ntpd[27963]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-10-08T11:56:21.922 INFO:teuthology.orchestra.run.smithi156.stdout: 8 Oct 11:56:21 ntpd[27963]: corporation. Support and training for ntp-4 are 2023-10-08T11:56:21.922 INFO:teuthology.orchestra.run.smithi156.stdout: 8 Oct 11:56:21 ntpd[27963]: available at https://www.nwtime.org/support 2023-10-08T11:56:21.922 INFO:teuthology.orchestra.run.smithi156.stdout: 8 Oct 11:56:21 ntpd[27963]: ---------------------------------------------------- 2023-10-08T11:56:21.923 INFO:teuthology.orchestra.run.smithi156.stdout: 8 Oct 11:56:21 ntpd[27963]: proto: precision = 0.040 usec (-24) 2023-10-08T11:56:21.923 INFO:teuthology.orchestra.run.smithi156.stdout: 8 Oct 11:56:21 ntpd[27963]: basedate set to 2022-02-04 2023-10-08T11:56:21.923 INFO:teuthology.orchestra.run.smithi156.stdout: 8 Oct 11:56:21 ntpd[27963]: gps base set to 2022-02-06 (week 2196) 2023-10-08T11:56:21.923 INFO:teuthology.orchestra.run.smithi156.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-08T11:56:21.924 INFO:teuthology.orchestra.run.smithi156.stdout: 8 Oct 11:56:21 ntpd[27963]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-08T11:56:21.924 INFO:teuthology.orchestra.run.smithi156.stdout: 8 Oct 11:56:21 ntpd[27963]: restrict ::: KOD does nothing without LIMITED. 2023-10-08T11:56:21.924 INFO:teuthology.orchestra.run.smithi156.stderr:restrict ::: KOD does nothing without LIMITED. 2023-10-08T11:56:21.925 INFO:teuthology.orchestra.run.smithi156.stdout: 8 Oct 11:56:21 ntpd[27963]: Listen and drop on 0 v6wildcard [::]:123 2023-10-08T11:56:21.925 INFO:teuthology.orchestra.run.smithi156.stdout: 8 Oct 11:56:21 ntpd[27963]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-10-08T11:56:21.925 INFO:teuthology.orchestra.run.smithi156.stdout: 8 Oct 11:56:21 ntpd[27963]: Listen normally on 2 lo 127.0.0.1:123 2023-10-08T11:56:21.925 INFO:teuthology.orchestra.run.smithi156.stdout: 8 Oct 11:56:21 ntpd[27963]: Listen normally on 3 enp3s0f1 172.21.15.156:123 2023-10-08T11:56:21.925 INFO:teuthology.orchestra.run.smithi156.stdout: 8 Oct 11:56:21 ntpd[27963]: Listen normally on 4 lo [::1]:123 2023-10-08T11:56:21.926 INFO:teuthology.orchestra.run.smithi156.stdout: 8 Oct 11:56:21 ntpd[27963]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6dfd%5]:123 2023-10-08T11:56:21.926 INFO:teuthology.orchestra.run.smithi156.stdout: 8 Oct 11:56:21 ntpd[27963]: Listening on routing socket on fd #22 for interface updates 2023-10-08T11:56:22.875 INFO:teuthology.orchestra.run.smithi062.stderr: 8 Oct 11:56:22 ntpd[28422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T11:56:22.875 INFO:teuthology.orchestra.run.smithi062.stderr: 8 Oct 11:56:22 ntpd[28422]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T11:56:22.875 INFO:teuthology.orchestra.run.smithi062.stderr: 8 Oct 11:56:22 ntpd[28422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T11:56:22.875 INFO:teuthology.orchestra.run.smithi062.stderr: 8 Oct 11:56:22 ntpd[28422]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T11:56:22.875 INFO:teuthology.orchestra.run.smithi062.stderr: 8 Oct 11:56:22 ntpd[28422]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T11:56:22.875 INFO:teuthology.orchestra.run.smithi062.stderr: 8 Oct 11:56:22 ntpd[28422]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T11:56:22.877 INFO:teuthology.orchestra.run.smithi130.stderr: 8 Oct 11:56:22 ntpd[28413]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T11:56:22.877 INFO:teuthology.orchestra.run.smithi130.stderr: 8 Oct 11:56:22 ntpd[28413]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T11:56:22.877 INFO:teuthology.orchestra.run.smithi130.stderr: 8 Oct 11:56:22 ntpd[28413]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T11:56:22.877 INFO:teuthology.orchestra.run.smithi130.stderr: 8 Oct 11:56:22 ntpd[28413]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T11:56:22.877 INFO:teuthology.orchestra.run.smithi130.stderr: 8 Oct 11:56:22 ntpd[28413]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T11:56:22.877 INFO:teuthology.orchestra.run.smithi130.stderr: 8 Oct 11:56:22 ntpd[28413]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T11:56:22.877 INFO:teuthology.orchestra.run.smithi130.stderr: 8 Oct 11:56:22 ntpd[28413]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T11:56:22.877 INFO:teuthology.orchestra.run.smithi130.stderr: 8 Oct 11:56:22 ntpd[28413]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T11:56:22.877 INFO:teuthology.orchestra.run.smithi130.stderr: 8 Oct 11:56:22 ntpd[28413]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T11:56:22.877 INFO:teuthology.orchestra.run.smithi130.stderr: 8 Oct 11:56:22 ntpd[28413]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T11:56:22.878 INFO:teuthology.orchestra.run.smithi130.stderr: 8 Oct 11:56:22 ntpd[28413]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T11:56:22.878 INFO:teuthology.orchestra.run.smithi130.stderr: 8 Oct 11:56:22 ntpd[28413]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T11:56:22.922 INFO:teuthology.orchestra.run.smithi156.stderr: 8 Oct 11:56:22 ntpd[27963]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T11:56:22.923 INFO:teuthology.orchestra.run.smithi156.stderr: 8 Oct 11:56:22 ntpd[27963]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T11:56:22.923 INFO:teuthology.orchestra.run.smithi156.stderr: 8 Oct 11:56:22 ntpd[27963]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T11:56:22.923 INFO:teuthology.orchestra.run.smithi156.stderr: 8 Oct 11:56:22 ntpd[27963]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T11:56:22.923 INFO:teuthology.orchestra.run.smithi156.stderr: 8 Oct 11:56:22 ntpd[27963]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T11:56:22.923 INFO:teuthology.orchestra.run.smithi156.stderr: 8 Oct 11:56:22 ntpd[27963]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T11:56:23.922 INFO:teuthology.orchestra.run.smithi156.stderr: 8 Oct 11:56:23 ntpd[27963]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T11:56:23.923 INFO:teuthology.orchestra.run.smithi156.stderr: 8 Oct 11:56:23 ntpd[27963]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T11:56:23.923 INFO:teuthology.orchestra.run.smithi156.stderr: 8 Oct 11:56:23 ntpd[27963]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T11:56:23.923 INFO:teuthology.orchestra.run.smithi156.stderr: 8 Oct 11:56:23 ntpd[27963]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T11:56:23.923 INFO:teuthology.orchestra.run.smithi156.stderr: 8 Oct 11:56:23 ntpd[27963]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T11:56:23.923 INFO:teuthology.orchestra.run.smithi156.stderr: 8 Oct 11:56:23 ntpd[27963]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T11:56:23.923 INFO:teuthology.orchestra.run.smithi156.stderr: 8 Oct 11:56:23 ntpd[27963]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T11:56:23.923 INFO:teuthology.orchestra.run.smithi156.stderr: 8 Oct 11:56:23 ntpd[27963]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T11:56:24.875 INFO:teuthology.orchestra.run.smithi062.stderr: 8 Oct 11:56:24 ntpd[28422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T11:56:24.875 INFO:teuthology.orchestra.run.smithi062.stderr: 8 Oct 11:56:24 ntpd[28422]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T11:56:24.875 INFO:teuthology.orchestra.run.smithi062.stderr: 8 Oct 11:56:24 ntpd[28422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T11:56:24.875 INFO:teuthology.orchestra.run.smithi062.stderr: 8 Oct 11:56:24 ntpd[28422]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T11:56:24.876 INFO:teuthology.orchestra.run.smithi062.stderr: 8 Oct 11:56:24 ntpd[28422]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T11:56:24.876 INFO:teuthology.orchestra.run.smithi062.stderr: 8 Oct 11:56:24 ntpd[28422]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T11:56:24.877 INFO:teuthology.orchestra.run.smithi130.stderr: 8 Oct 11:56:24 ntpd[28413]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T11:56:24.877 INFO:teuthology.orchestra.run.smithi130.stderr: 8 Oct 11:56:24 ntpd[28413]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T11:56:24.877 INFO:teuthology.orchestra.run.smithi130.stderr: 8 Oct 11:56:24 ntpd[28413]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T11:56:24.877 INFO:teuthology.orchestra.run.smithi130.stderr: 8 Oct 11:56:24 ntpd[28413]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T11:56:24.877 INFO:teuthology.orchestra.run.smithi130.stderr: 8 Oct 11:56:24 ntpd[28413]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T11:56:24.877 INFO:teuthology.orchestra.run.smithi130.stderr: 8 Oct 11:56:24 ntpd[28413]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T11:56:24.877 INFO:teuthology.orchestra.run.smithi130.stderr: 8 Oct 11:56:24 ntpd[28413]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T11:56:24.878 INFO:teuthology.orchestra.run.smithi130.stderr: 8 Oct 11:56:24 ntpd[28413]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T11:56:24.878 INFO:teuthology.orchestra.run.smithi130.stderr: 8 Oct 11:56:24 ntpd[28413]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T11:56:24.878 INFO:teuthology.orchestra.run.smithi130.stderr: 8 Oct 11:56:24 ntpd[28413]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T11:56:24.893 INFO:teuthology.orchestra.run.smithi130.stderr: 8 Oct 11:56:24 ntpd[28413]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T11:56:24.893 INFO:teuthology.orchestra.run.smithi130.stderr: 8 Oct 11:56:24 ntpd[28413]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T11:56:24.922 INFO:teuthology.orchestra.run.smithi156.stderr: 8 Oct 11:56:24 ntpd[27963]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T11:56:24.923 INFO:teuthology.orchestra.run.smithi156.stderr: 8 Oct 11:56:24 ntpd[27963]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T11:56:24.923 INFO:teuthology.orchestra.run.smithi156.stderr: 8 Oct 11:56:24 ntpd[27963]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T11:56:24.923 INFO:teuthology.orchestra.run.smithi156.stderr: 8 Oct 11:56:24 ntpd[27963]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T11:56:24.923 INFO:teuthology.orchestra.run.smithi156.stderr: 8 Oct 11:56:24 ntpd[27963]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T11:56:24.923 INFO:teuthology.orchestra.run.smithi156.stderr: 8 Oct 11:56:24 ntpd[27963]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T11:56:25.879 INFO:teuthology.orchestra.run.smithi062.stderr: 8 Oct 11:56:25 ntpd[28422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T11:56:25.879 INFO:teuthology.orchestra.run.smithi062.stderr: 8 Oct 11:56:25 ntpd[28422]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T11:56:25.879 INFO:teuthology.orchestra.run.smithi062.stderr: 8 Oct 11:56:25 ntpd[28422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T11:56:25.879 INFO:teuthology.orchestra.run.smithi062.stderr: 8 Oct 11:56:25 ntpd[28422]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T11:56:25.880 INFO:teuthology.orchestra.run.smithi062.stderr: 8 Oct 11:56:25 ntpd[28422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T11:56:25.881 INFO:teuthology.orchestra.run.smithi062.stderr: 8 Oct 11:56:25 ntpd[28422]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T11:56:25.881 INFO:teuthology.orchestra.run.smithi062.stderr: 8 Oct 11:56:25 ntpd[28422]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T11:56:25.881 INFO:teuthology.orchestra.run.smithi062.stderr: 8 Oct 11:56:25 ntpd[28422]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T11:56:25.882 INFO:teuthology.orchestra.run.smithi130.stderr: 8 Oct 11:56:25 ntpd[28413]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T11:56:25.882 INFO:teuthology.orchestra.run.smithi130.stderr: 8 Oct 11:56:25 ntpd[28413]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T11:56:25.882 INFO:teuthology.orchestra.run.smithi130.stderr: 8 Oct 11:56:25 ntpd[28413]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T11:56:25.882 INFO:teuthology.orchestra.run.smithi130.stderr: 8 Oct 11:56:25 ntpd[28413]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T11:56:25.882 INFO:teuthology.orchestra.run.smithi130.stderr: 8 Oct 11:56:25 ntpd[28413]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T11:56:25.882 INFO:teuthology.orchestra.run.smithi130.stderr: 8 Oct 11:56:25 ntpd[28413]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T11:56:25.882 INFO:teuthology.orchestra.run.smithi130.stderr: 8 Oct 11:56:25 ntpd[28413]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T11:56:25.882 INFO:teuthology.orchestra.run.smithi130.stderr: 8 Oct 11:56:25 ntpd[28413]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T11:56:25.922 INFO:teuthology.orchestra.run.smithi156.stderr: 8 Oct 11:56:25 ntpd[27963]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T11:56:25.923 INFO:teuthology.orchestra.run.smithi156.stderr: 8 Oct 11:56:25 ntpd[27963]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T11:56:25.923 INFO:teuthology.orchestra.run.smithi156.stderr: 8 Oct 11:56:25 ntpd[27963]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T11:56:25.923 INFO:teuthology.orchestra.run.smithi156.stderr: 8 Oct 11:56:25 ntpd[27963]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T11:56:25.923 INFO:teuthology.orchestra.run.smithi156.stderr: 8 Oct 11:56:25 ntpd[27963]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T11:56:25.923 INFO:teuthology.orchestra.run.smithi156.stderr: 8 Oct 11:56:25 ntpd[27963]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T11:56:26.875 INFO:teuthology.orchestra.run.smithi062.stderr: 8 Oct 11:56:26 ntpd[28422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T11:56:26.875 INFO:teuthology.orchestra.run.smithi062.stderr: 8 Oct 11:56:26 ntpd[28422]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T11:56:26.875 INFO:teuthology.orchestra.run.smithi062.stderr: 8 Oct 11:56:26 ntpd[28422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T11:56:26.876 INFO:teuthology.orchestra.run.smithi062.stderr: 8 Oct 11:56:26 ntpd[28422]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T11:56:26.876 INFO:teuthology.orchestra.run.smithi062.stderr: 8 Oct 11:56:26 ntpd[28422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T11:56:26.876 INFO:teuthology.orchestra.run.smithi062.stderr: 8 Oct 11:56:26 ntpd[28422]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T11:56:26.876 INFO:teuthology.orchestra.run.smithi062.stderr: 8 Oct 11:56:26 ntpd[28422]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T11:56:26.876 INFO:teuthology.orchestra.run.smithi062.stderr: 8 Oct 11:56:26 ntpd[28422]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T11:56:26.876 INFO:teuthology.orchestra.run.smithi062.stderr: 8 Oct 11:56:26 ntpd[28422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T11:56:26.876 INFO:teuthology.orchestra.run.smithi062.stderr: 8 Oct 11:56:26 ntpd[28422]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T11:56:26.876 INFO:teuthology.orchestra.run.smithi062.stderr: 8 Oct 11:56:26 ntpd[28422]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T11:56:26.876 INFO:teuthology.orchestra.run.smithi062.stderr: 8 Oct 11:56:26 ntpd[28422]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T11:56:26.877 INFO:teuthology.orchestra.run.smithi130.stderr: 8 Oct 11:56:26 ntpd[28413]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T11:56:26.878 INFO:teuthology.orchestra.run.smithi130.stderr: 8 Oct 11:56:26 ntpd[28413]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T11:56:26.878 INFO:teuthology.orchestra.run.smithi130.stderr: 8 Oct 11:56:26 ntpd[28413]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T11:56:26.878 INFO:teuthology.orchestra.run.smithi130.stderr: 8 Oct 11:56:26 ntpd[28413]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T11:56:26.878 INFO:teuthology.orchestra.run.smithi130.stderr: 8 Oct 11:56:26 ntpd[28413]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T11:56:26.878 INFO:teuthology.orchestra.run.smithi130.stderr: 8 Oct 11:56:26 ntpd[28413]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T11:56:26.878 INFO:teuthology.orchestra.run.smithi130.stderr: 8 Oct 11:56:26 ntpd[28413]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T11:56:26.878 INFO:teuthology.orchestra.run.smithi130.stderr: 8 Oct 11:56:26 ntpd[28413]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T11:56:26.878 INFO:teuthology.orchestra.run.smithi130.stderr: 8 Oct 11:56:26 ntpd[28413]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T11:56:26.878 INFO:teuthology.orchestra.run.smithi130.stderr: 8 Oct 11:56:26 ntpd[28413]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T11:56:26.878 INFO:teuthology.orchestra.run.smithi130.stderr: 8 Oct 11:56:26 ntpd[28413]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T11:56:26.878 INFO:teuthology.orchestra.run.smithi130.stderr: 8 Oct 11:56:26 ntpd[28413]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T11:56:26.923 INFO:teuthology.orchestra.run.smithi156.stderr: 8 Oct 11:56:26 ntpd[27963]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T11:56:26.923 INFO:teuthology.orchestra.run.smithi156.stderr: 8 Oct 11:56:26 ntpd[27963]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T11:56:26.923 INFO:teuthology.orchestra.run.smithi156.stderr: 8 Oct 11:56:26 ntpd[27963]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T11:56:26.923 INFO:teuthology.orchestra.run.smithi156.stderr: 8 Oct 11:56:26 ntpd[27963]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T11:56:26.923 INFO:teuthology.orchestra.run.smithi156.stderr: 8 Oct 11:56:26 ntpd[27963]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T11:56:26.923 INFO:teuthology.orchestra.run.smithi156.stderr: 8 Oct 11:56:26 ntpd[27963]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T11:56:26.923 INFO:teuthology.orchestra.run.smithi156.stderr: 8 Oct 11:56:26 ntpd[27963]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T11:56:26.924 INFO:teuthology.orchestra.run.smithi156.stderr: 8 Oct 11:56:26 ntpd[27963]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T11:56:26.924 INFO:teuthology.orchestra.run.smithi156.stderr: 8 Oct 11:56:26 ntpd[27963]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T11:56:26.924 INFO:teuthology.orchestra.run.smithi156.stderr: 8 Oct 11:56:26 ntpd[27963]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T11:56:26.924 INFO:teuthology.orchestra.run.smithi156.stderr: 8 Oct 11:56:26 ntpd[27963]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T11:56:26.924 INFO:teuthology.orchestra.run.smithi156.stderr: 8 Oct 11:56:26 ntpd[27963]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T11:56:27.875 INFO:teuthology.orchestra.run.smithi062.stderr: 8 Oct 11:56:27 ntpd[28422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T11:56:27.875 INFO:teuthology.orchestra.run.smithi062.stderr: 8 Oct 11:56:27 ntpd[28422]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T11:56:27.875 INFO:teuthology.orchestra.run.smithi062.stderr: 8 Oct 11:56:27 ntpd[28422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T11:56:27.876 INFO:teuthology.orchestra.run.smithi062.stderr: 8 Oct 11:56:27 ntpd[28422]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T11:56:27.876 INFO:teuthology.orchestra.run.smithi062.stderr: 8 Oct 11:56:27 ntpd[28422]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T11:56:27.876 INFO:teuthology.orchestra.run.smithi062.stderr: 8 Oct 11:56:27 ntpd[28422]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T11:56:27.877 INFO:teuthology.orchestra.run.smithi130.stderr: 8 Oct 11:56:27 ntpd[28413]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T11:56:27.877 INFO:teuthology.orchestra.run.smithi130.stderr: 8 Oct 11:56:27 ntpd[28413]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T11:56:27.877 INFO:teuthology.orchestra.run.smithi130.stderr: 8 Oct 11:56:27 ntpd[28413]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T11:56:27.877 INFO:teuthology.orchestra.run.smithi130.stderr: 8 Oct 11:56:27 ntpd[28413]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T11:56:27.877 INFO:teuthology.orchestra.run.smithi130.stderr: 8 Oct 11:56:27 ntpd[28413]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T11:56:27.877 INFO:teuthology.orchestra.run.smithi130.stderr: 8 Oct 11:56:27 ntpd[28413]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T11:56:27.922 INFO:teuthology.orchestra.run.smithi156.stderr: 8 Oct 11:56:27 ntpd[27963]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T11:56:27.922 INFO:teuthology.orchestra.run.smithi156.stderr: 8 Oct 11:56:27 ntpd[27963]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T11:56:27.923 INFO:teuthology.orchestra.run.smithi156.stderr: 8 Oct 11:56:27 ntpd[27963]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T11:56:27.923 INFO:teuthology.orchestra.run.smithi156.stderr: 8 Oct 11:56:27 ntpd[27963]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T11:56:27.923 INFO:teuthology.orchestra.run.smithi156.stderr: 8 Oct 11:56:27 ntpd[27963]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T11:56:27.923 INFO:teuthology.orchestra.run.smithi156.stderr: 8 Oct 11:56:27 ntpd[27963]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T11:56:28.875 INFO:teuthology.orchestra.run.smithi062.stderr: 8 Oct 11:56:28 ntpd[28422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T11:56:28.875 INFO:teuthology.orchestra.run.smithi062.stderr: 8 Oct 11:56:28 ntpd[28422]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T11:56:28.875 INFO:teuthology.orchestra.run.smithi062.stderr: 8 Oct 11:56:28 ntpd[28422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T11:56:28.876 INFO:teuthology.orchestra.run.smithi062.stderr: 8 Oct 11:56:28 ntpd[28422]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T11:56:28.876 INFO:teuthology.orchestra.run.smithi062.stderr: 8 Oct 11:56:28 ntpd[28422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T11:56:28.876 INFO:teuthology.orchestra.run.smithi062.stderr: 8 Oct 11:56:28 ntpd[28422]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T11:56:28.876 INFO:teuthology.orchestra.run.smithi062.stderr: 8 Oct 11:56:28 ntpd[28422]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T11:56:28.876 INFO:teuthology.orchestra.run.smithi062.stderr: 8 Oct 11:56:28 ntpd[28422]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T11:56:28.876 INFO:teuthology.orchestra.run.smithi062.stderr: 8 Oct 11:56:28 ntpd[28422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T11:56:28.876 INFO:teuthology.orchestra.run.smithi062.stderr: 8 Oct 11:56:28 ntpd[28422]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T11:56:28.876 INFO:teuthology.orchestra.run.smithi062.stderr: 8 Oct 11:56:28 ntpd[28422]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T11:56:28.876 INFO:teuthology.orchestra.run.smithi062.stderr: 8 Oct 11:56:28 ntpd[28422]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T11:56:28.876 INFO:teuthology.orchestra.run.smithi062.stdout: 8 Oct 11:56:28 ntpd[28422]: ntpd: time slew -0.001862 s 2023-10-08T11:56:28.877 INFO:teuthology.orchestra.run.smithi062.stdout:ntpd: time slew -0.001862s 2023-10-08T11:56:28.877 INFO:teuthology.orchestra.run.smithi062.stderr: 8 Oct 11:56:28 ntpd[28422]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-10-08T11:56:28.877 INFO:teuthology.orchestra.run.smithi062.stderr: 8 Oct 11:56:28 ntpd[28422]: can't open /var/log/ntpstats/loopstats.20231008: Permission denied 2023-10-08T11:56:28.878 INFO:teuthology.orchestra.run.smithi130.stderr: 8 Oct 11:56:28 ntpd[28413]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T11:56:28.878 INFO:teuthology.orchestra.run.smithi130.stderr: 8 Oct 11:56:28 ntpd[28413]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T11:56:28.878 INFO:teuthology.orchestra.run.smithi130.stderr: 8 Oct 11:56:28 ntpd[28413]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T11:56:28.878 INFO:teuthology.orchestra.run.smithi130.stderr: 8 Oct 11:56:28 ntpd[28413]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T11:56:28.879 INFO:teuthology.orchestra.run.smithi130.stderr: 8 Oct 11:56:28 ntpd[28413]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T11:56:28.879 INFO:teuthology.orchestra.run.smithi130.stderr: 8 Oct 11:56:28 ntpd[28413]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T11:56:28.879 INFO:teuthology.orchestra.run.smithi130.stderr: 8 Oct 11:56:28 ntpd[28413]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T11:56:28.879 INFO:teuthology.orchestra.run.smithi130.stderr: 8 Oct 11:56:28 ntpd[28413]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T11:56:28.879 INFO:teuthology.orchestra.run.smithi130.stdout: 8 Oct 11:56:28 ntpd[28413]: ntpd: time slew -0.002441 s 2023-10-08T11:56:28.879 INFO:teuthology.orchestra.run.smithi130.stdout:ntpd: time slew -0.002441s 2023-10-08T11:56:28.880 INFO:teuthology.orchestra.run.smithi130.stderr: 8 Oct 11:56:28 ntpd[28413]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-10-08T11:56:28.880 INFO:teuthology.orchestra.run.smithi130.stderr: 8 Oct 11:56:28 ntpd[28413]: can't open /var/log/ntpstats/loopstats.20231008: Permission denied 2023-10-08T11:56:28.923 INFO:teuthology.orchestra.run.smithi156.stderr: 8 Oct 11:56:28 ntpd[27963]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T11:56:28.924 INFO:teuthology.orchestra.run.smithi156.stderr: 8 Oct 11:56:28 ntpd[27963]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T11:56:28.924 INFO:teuthology.orchestra.run.smithi156.stderr: 8 Oct 11:56:28 ntpd[27963]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T11:56:28.924 INFO:teuthology.orchestra.run.smithi156.stderr: 8 Oct 11:56:28 ntpd[27963]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T11:56:28.924 INFO:teuthology.orchestra.run.smithi156.stderr: 8 Oct 11:56:28 ntpd[27963]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T11:56:28.924 INFO:teuthology.orchestra.run.smithi156.stderr: 8 Oct 11:56:28 ntpd[27963]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T11:56:28.924 INFO:teuthology.orchestra.run.smithi156.stderr: 8 Oct 11:56:28 ntpd[27963]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T11:56:28.924 INFO:teuthology.orchestra.run.smithi156.stderr: 8 Oct 11:56:28 ntpd[27963]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T11:56:28.924 INFO:teuthology.orchestra.run.smithi156.stdout: 8 Oct 11:56:28 ntpd[27963]: ntpd: time slew -0.000063 s 2023-10-08T11:56:28.924 INFO:teuthology.orchestra.run.smithi156.stdout:ntpd: time slew -0.000063s 2023-10-08T11:56:28.925 INFO:teuthology.orchestra.run.smithi156.stderr: 8 Oct 11:56:28 ntpd[27963]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-10-08T11:56:28.925 INFO:teuthology.orchestra.run.smithi156.stderr: 8 Oct 11:56:28 ntpd[27963]: can't open /var/log/ntpstats/loopstats.20231008: Permission denied 2023-10-08T11:56:28.965 INFO:teuthology.orchestra.run.smithi130.stdout: remote refid st t when poll reach delay offset jitter 2023-10-08T11:56:28.965 INFO:teuthology.orchestra.run.smithi130.stdout:============================================================================== 2023-10-08T11:56:28.965 INFO:teuthology.orchestra.run.smithi130.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-08T11:56:28.965 INFO:teuthology.orchestra.run.smithi130.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-08T11:56:28.965 INFO:teuthology.orchestra.run.smithi130.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-08T11:56:28.965 INFO:teuthology.orchestra.run.smithi130.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-08T11:56:28.970 INFO:teuthology.orchestra.run.smithi062.stdout: remote refid st t when poll reach delay offset jitter 2023-10-08T11:56:28.971 INFO:teuthology.orchestra.run.smithi062.stdout:============================================================================== 2023-10-08T11:56:28.971 INFO:teuthology.orchestra.run.smithi062.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-08T11:56:28.971 INFO:teuthology.orchestra.run.smithi062.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-08T11:56:28.971 INFO:teuthology.orchestra.run.smithi062.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-08T11:56:28.971 INFO:teuthology.orchestra.run.smithi062.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-08T11:56:29.034 INFO:teuthology.orchestra.run.smithi156.stdout: remote refid st t when poll reach delay offset jitter 2023-10-08T11:56:29.034 INFO:teuthology.orchestra.run.smithi156.stdout:============================================================================== 2023-10-08T11:56:29.034 INFO:teuthology.orchestra.run.smithi156.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-08T11:56:29.034 INFO:teuthology.orchestra.run.smithi156.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-08T11:56:29.034 INFO:teuthology.orchestra.run.smithi156.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-08T11:56:29.034 INFO:teuthology.orchestra.run.smithi156.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-08T11:56:29.035 INFO:teuthology.run_tasks:Running task install... 2023-10-08T11:56:29.047 DEBUG:teuthology.task.install:project ceph 2023-10-08T11:56:29.048 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '7b3143bae3b6870a749bfb9810ed6e7d0e89d7de'}} 2023-10-08T11:56:29.048 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '7b3143bae3b6870a749bfb9810ed6e7d0e89d7de'} 2023-10-08T11:56:29.048 INFO:teuthology.task.install:Using flavor: default 2023-10-08T11:56:29.056 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-08T11:56:29.056 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-08T11:56:29.056 DEBUG:teuthology.orchestra.run.smithi062:> sudo apt-key list | grep Ceph 2023-10-08T11:56:29.057 DEBUG:teuthology.orchestra.run.smithi130:> sudo apt-key list | grep Ceph 2023-10-08T11:56:29.057 DEBUG:teuthology.orchestra.run.smithi156:> sudo apt-key list | grep Ceph 2023-10-08T11:56:29.113 INFO:teuthology.orchestra.run.smithi130.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-10-08T11:56:29.123 INFO:teuthology.orchestra.run.smithi062.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-10-08T11:56:29.141 INFO:teuthology.orchestra.run.smithi130.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-10-08T11:56:29.141 INFO:teuthology.orchestra.run.smithi130.stdout:uid [ unknown] Ceph.com (release key) 2023-10-08T11:56:29.142 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-10-08T11:56:29.142 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-10-08T11:56:29.142 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7b3143bae3b6870a749bfb9810ed6e7d0e89d7de 2023-10-08T11:56:29.154 INFO:teuthology.orchestra.run.smithi062.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-10-08T11:56:29.154 INFO:teuthology.orchestra.run.smithi062.stdout:uid [ unknown] Ceph.com (release key) 2023-10-08T11:56:29.155 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-10-08T11:56:29.155 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-10-08T11:56:29.155 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7b3143bae3b6870a749bfb9810ed6e7d0e89d7de 2023-10-08T11:56:29.192 INFO:teuthology.orchestra.run.smithi156.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-10-08T11:56:29.241 INFO:teuthology.orchestra.run.smithi156.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-10-08T11:56:29.241 INFO:teuthology.orchestra.run.smithi156.stdout:uid [ unknown] Ceph.com (release key) 2023-10-08T11:56:29.241 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-10-08T11:56:29.242 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-10-08T11:56:29.242 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7b3143bae3b6870a749bfb9810ed6e7d0e89d7de 2023-10-08T11:56:29.302 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default/ 2023-10-08T11:56:29.302 INFO:teuthology.task.install.deb:Package version is 18.0.0-6639-g7b3143ba-1jammy 2023-10-08T11:56:29.370 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default/ 2023-10-08T11:56:29.370 INFO:teuthology.task.install.deb:Package version is 18.0.0-6639-g7b3143ba-1jammy 2023-10-08T11:56:29.475 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default/ 2023-10-08T11:56:29.475 INFO:teuthology.task.install.deb:Package version is 18.0.0-6639-g7b3143ba-1jammy 2023-10-08T11:56:29.500 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-10-08T11:56:29.500 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-10-08T11:56:29.521 DEBUG:teuthology.orchestra.run.smithi062:> sudo apt-get update 2023-10-08T11:56:29.557 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-08T11:56:29.557 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-10-08T11:56:29.571 DEBUG:teuthology.orchestra.run.smithi130:> sudo apt-get update 2023-10-08T11:56:29.609 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-10-08T11:56:29.609 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-10-08T11:56:29.630 DEBUG:teuthology.orchestra.run.smithi156:> sudo apt-get update 2023-10-08T11:56:29.750 INFO:teuthology.orchestra.run.smithi130.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-10-08T11:56:29.750 INFO:teuthology.orchestra.run.smithi130.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-10-08T11:56:29.756 INFO:teuthology.orchestra.run.smithi062.stdout:Ign:1 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy InRelease 2023-10-08T11:56:29.764 INFO:teuthology.orchestra.run.smithi130.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-10-08T11:56:29.777 INFO:teuthology.orchestra.run.smithi062.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy Release [6,978 B] 2023-10-08T11:56:29.786 INFO:teuthology.orchestra.run.smithi130.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-10-08T11:56:29.801 INFO:teuthology.orchestra.run.smithi062.stdout:Ign:3 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy Release.gpg 2023-10-08T11:56:29.816 INFO:teuthology.orchestra.run.smithi156.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-10-08T11:56:29.817 INFO:teuthology.orchestra.run.smithi156.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-10-08T11:56:29.820 INFO:teuthology.orchestra.run.smithi062.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-10-08T11:56:29.822 INFO:teuthology.orchestra.run.smithi156.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-10-08T11:56:29.822 INFO:teuthology.orchestra.run.smithi062.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,420 B] 2023-10-08T11:56:29.832 INFO:teuthology.orchestra.run.smithi062.stdout:Hit:6 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-10-08T11:56:29.839 INFO:teuthology.orchestra.run.smithi156.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-10-08T11:56:29.853 INFO:teuthology.orchestra.run.smithi062.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2023-10-08T11:56:29.863 INFO:teuthology.orchestra.run.smithi130.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy InRelease 2023-10-08T11:56:29.866 INFO:teuthology.orchestra.run.smithi156.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy InRelease 2023-10-08T11:56:29.887 INFO:teuthology.orchestra.run.smithi156.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy Release [6,978 B] 2023-10-08T11:56:29.894 INFO:teuthology.orchestra.run.smithi062.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-10-08T11:56:29.903 INFO:teuthology.orchestra.run.smithi130.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy Release [6,978 B] 2023-10-08T11:56:29.909 INFO:teuthology.orchestra.run.smithi156.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy Release.gpg 2023-10-08T11:56:29.930 INFO:teuthology.orchestra.run.smithi156.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,420 B] 2023-10-08T11:56:29.941 INFO:teuthology.orchestra.run.smithi130.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy Release.gpg 2023-10-08T11:56:29.964 INFO:teuthology.orchestra.run.smithi156.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2023-10-08T11:56:29.975 INFO:teuthology.orchestra.run.smithi062.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-10-08T11:56:29.981 INFO:teuthology.orchestra.run.smithi130.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,420 B] 2023-10-08T11:56:30.027 INFO:teuthology.orchestra.run.smithi130.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2023-10-08T11:56:30.111 INFO:teuthology.orchestra.run.smithi130.stdout:Fetched 27.9 kB in 0s (76.7 kB/s) 2023-10-08T11:56:30.219 INFO:teuthology.orchestra.run.smithi062.stdout:Fetched 27.9 kB in 1s (54.7 kB/s) 2023-10-08T11:56:30.442 INFO:teuthology.orchestra.run.smithi156.stdout:Fetched 27.9 kB in 1s (47.1 kB/s) 2023-10-08T11:56:30.956 INFO:teuthology.orchestra.run.smithi130.stdout:Reading package lists... 2023-10-08T11:56:30.970 DEBUG:teuthology.orchestra.run.smithi130:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-6639-g7b3143ba-1jammy cephadm=18.0.0-6639-g7b3143ba-1jammy ceph-mds=18.0.0-6639-g7b3143ba-1jammy ceph-mgr=18.0.0-6639-g7b3143ba-1jammy ceph-common=18.0.0-6639-g7b3143ba-1jammy ceph-fuse=18.0.0-6639-g7b3143ba-1jammy ceph-test=18.0.0-6639-g7b3143ba-1jammy ceph-volume=18.0.0-6639-g7b3143ba-1jammy radosgw=18.0.0-6639-g7b3143ba-1jammy python3-rados=18.0.0-6639-g7b3143ba-1jammy python3-rgw=18.0.0-6639-g7b3143ba-1jammy python3-cephfs=18.0.0-6639-g7b3143ba-1jammy python3-rbd=18.0.0-6639-g7b3143ba-1jammy libcephfs2=18.0.0-6639-g7b3143ba-1jammy libcephfs-dev=18.0.0-6639-g7b3143ba-1jammy librados2=18.0.0-6639-g7b3143ba-1jammy librbd1=18.0.0-6639-g7b3143ba-1jammy rbd-fuse=18.0.0-6639-g7b3143ba-1jammy python3-cephfs=18.0.0-6639-g7b3143ba-1jammy cephfs-shell=18.0.0-6639-g7b3143ba-1jammy cephfs-top=18.0.0-6639-g7b3143ba-1jammy cephfs-mirror=18.0.0-6639-g7b3143ba-1jammy 2023-10-08T11:56:31.032 INFO:teuthology.orchestra.run.smithi130.stdout:Reading package lists... 2023-10-08T11:56:31.104 INFO:teuthology.orchestra.run.smithi062.stdout:Reading package lists... 2023-10-08T11:56:31.121 DEBUG:teuthology.orchestra.run.smithi062:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-6639-g7b3143ba-1jammy cephadm=18.0.0-6639-g7b3143ba-1jammy ceph-mds=18.0.0-6639-g7b3143ba-1jammy ceph-mgr=18.0.0-6639-g7b3143ba-1jammy ceph-common=18.0.0-6639-g7b3143ba-1jammy ceph-fuse=18.0.0-6639-g7b3143ba-1jammy ceph-test=18.0.0-6639-g7b3143ba-1jammy ceph-volume=18.0.0-6639-g7b3143ba-1jammy radosgw=18.0.0-6639-g7b3143ba-1jammy python3-rados=18.0.0-6639-g7b3143ba-1jammy python3-rgw=18.0.0-6639-g7b3143ba-1jammy python3-cephfs=18.0.0-6639-g7b3143ba-1jammy python3-rbd=18.0.0-6639-g7b3143ba-1jammy libcephfs2=18.0.0-6639-g7b3143ba-1jammy libcephfs-dev=18.0.0-6639-g7b3143ba-1jammy librados2=18.0.0-6639-g7b3143ba-1jammy librbd1=18.0.0-6639-g7b3143ba-1jammy rbd-fuse=18.0.0-6639-g7b3143ba-1jammy python3-cephfs=18.0.0-6639-g7b3143ba-1jammy cephfs-shell=18.0.0-6639-g7b3143ba-1jammy cephfs-top=18.0.0-6639-g7b3143ba-1jammy cephfs-mirror=18.0.0-6639-g7b3143ba-1jammy 2023-10-08T11:56:31.175 INFO:teuthology.orchestra.run.smithi062.stdout:Reading package lists... 2023-10-08T11:56:31.217 INFO:teuthology.orchestra.run.smithi130.stdout:Building dependency tree... 2023-10-08T11:56:31.218 INFO:teuthology.orchestra.run.smithi130.stdout:Reading state information... 2023-10-08T11:56:31.343 INFO:teuthology.orchestra.run.smithi062.stdout:Building dependency tree... 2023-10-08T11:56:31.344 INFO:teuthology.orchestra.run.smithi062.stdout:Reading state information... 2023-10-08T11:56:31.378 INFO:teuthology.orchestra.run.smithi156.stdout:Reading package lists... 2023-10-08T11:56:31.383 INFO:teuthology.orchestra.run.smithi130.stdout:The following packages were automatically installed and are no longer required: 2023-10-08T11:56:31.383 INFO:teuthology.orchestra.run.smithi130.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-10-08T11:56:31.383 INFO:teuthology.orchestra.run.smithi130.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-10-08T11:56:31.384 INFO:teuthology.orchestra.run.smithi130.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-10-08T11:56:31.384 INFO:teuthology.orchestra.run.smithi130.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2023-10-08T11:56:31.384 INFO:teuthology.orchestra.run.smithi130.stdout: python2.7-minimal 2023-10-08T11:56:31.384 INFO:teuthology.orchestra.run.smithi130.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-08T11:56:31.385 INFO:teuthology.orchestra.run.smithi130.stdout:The following additional packages will be installed: 2023-10-08T11:56:31.385 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-10-08T11:56:31.385 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-10-08T11:56:31.385 INFO:teuthology.orchestra.run.smithi130.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-10-08T11:56:31.385 INFO:teuthology.orchestra.run.smithi130.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-10-08T11:56:31.386 INFO:teuthology.orchestra.run.smithi130.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-10-08T11:56:31.386 INFO:teuthology.orchestra.run.smithi130.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-10-08T11:56:31.386 INFO:teuthology.orchestra.run.smithi130.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-10-08T11:56:31.386 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-10-08T11:56:31.386 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-10-08T11:56:31.386 INFO:teuthology.orchestra.run.smithi130.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-10-08T11:56:31.386 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-10-08T11:56:31.386 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-10-08T11:56:31.387 INFO:teuthology.orchestra.run.smithi130.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-10-08T11:56:31.387 INFO:teuthology.orchestra.run.smithi130.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-10-08T11:56:31.387 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-10-08T11:56:31.387 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-10-08T11:56:31.387 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-10-08T11:56:31.387 INFO:teuthology.orchestra.run.smithi130.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-10-08T11:56:31.387 INFO:teuthology.orchestra.run.smithi130.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-10-08T11:56:31.387 INFO:teuthology.orchestra.run.smithi130.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-10-08T11:56:31.387 INFO:teuthology.orchestra.run.smithi130.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-10-08T11:56:31.387 INFO:teuthology.orchestra.run.smithi130.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-10-08T11:56:31.387 INFO:teuthology.orchestra.run.smithi130.stdout: qttranslations5-l10n socat xmlstarlet 2023-10-08T11:56:31.388 INFO:teuthology.orchestra.run.smithi130.stdout:Suggested packages: 2023-10-08T11:56:31.388 INFO:teuthology.orchestra.run.smithi130.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-10-08T11:56:31.388 INFO:teuthology.orchestra.run.smithi130.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-10-08T11:56:31.388 INFO:teuthology.orchestra.run.smithi130.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-10-08T11:56:31.388 INFO:teuthology.orchestra.run.smithi130.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-10-08T11:56:31.388 INFO:teuthology.orchestra.run.smithi130.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-10-08T11:56:31.388 INFO:teuthology.orchestra.run.smithi130.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-10-08T11:56:31.388 INFO:teuthology.orchestra.run.smithi130.stdout: python3-watchdog 2023-10-08T11:56:31.388 INFO:teuthology.orchestra.run.smithi130.stdout:Recommended packages: 2023-10-08T11:56:31.389 INFO:teuthology.orchestra.run.smithi130.stdout: btrfs-tools 2023-10-08T11:56:31.394 DEBUG:teuthology.orchestra.run.smithi156:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-6639-g7b3143ba-1jammy cephadm=18.0.0-6639-g7b3143ba-1jammy ceph-mds=18.0.0-6639-g7b3143ba-1jammy ceph-mgr=18.0.0-6639-g7b3143ba-1jammy ceph-common=18.0.0-6639-g7b3143ba-1jammy ceph-fuse=18.0.0-6639-g7b3143ba-1jammy ceph-test=18.0.0-6639-g7b3143ba-1jammy ceph-volume=18.0.0-6639-g7b3143ba-1jammy radosgw=18.0.0-6639-g7b3143ba-1jammy python3-rados=18.0.0-6639-g7b3143ba-1jammy python3-rgw=18.0.0-6639-g7b3143ba-1jammy python3-cephfs=18.0.0-6639-g7b3143ba-1jammy python3-rbd=18.0.0-6639-g7b3143ba-1jammy libcephfs2=18.0.0-6639-g7b3143ba-1jammy libcephfs-dev=18.0.0-6639-g7b3143ba-1jammy librados2=18.0.0-6639-g7b3143ba-1jammy librbd1=18.0.0-6639-g7b3143ba-1jammy rbd-fuse=18.0.0-6639-g7b3143ba-1jammy python3-cephfs=18.0.0-6639-g7b3143ba-1jammy cephfs-shell=18.0.0-6639-g7b3143ba-1jammy cephfs-top=18.0.0-6639-g7b3143ba-1jammy cephfs-mirror=18.0.0-6639-g7b3143ba-1jammy 2023-10-08T11:56:31.470 INFO:teuthology.orchestra.run.smithi156.stdout:Reading package lists... 2023-10-08T11:56:31.491 INFO:teuthology.orchestra.run.smithi130.stdout:The following NEW packages will be installed: 2023-10-08T11:56:31.491 INFO:teuthology.orchestra.run.smithi130.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-10-08T11:56:31.491 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-10-08T11:56:31.491 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-10-08T11:56:31.491 INFO:teuthology.orchestra.run.smithi130.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-10-08T11:56:31.492 INFO:teuthology.orchestra.run.smithi130.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-10-08T11:56:31.492 INFO:teuthology.orchestra.run.smithi130.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-10-08T11:56:31.492 INFO:teuthology.orchestra.run.smithi130.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2023-10-08T11:56:31.493 INFO:teuthology.orchestra.run.smithi130.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-10-08T11:56:31.493 INFO:teuthology.orchestra.run.smithi130.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-10-08T11:56:31.493 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-10-08T11:56:31.493 INFO:teuthology.orchestra.run.smithi130.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-10-08T11:56:31.493 INFO:teuthology.orchestra.run.smithi130.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-10-08T11:56:31.493 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-10-08T11:56:31.493 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-10-08T11:56:31.493 INFO:teuthology.orchestra.run.smithi130.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-10-08T11:56:31.493 INFO:teuthology.orchestra.run.smithi130.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-10-08T11:56:31.493 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-10-08T11:56:31.494 INFO:teuthology.orchestra.run.smithi130.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-10-08T11:56:31.494 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-10-08T11:56:31.494 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-10-08T11:56:31.494 INFO:teuthology.orchestra.run.smithi130.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-10-08T11:56:31.494 INFO:teuthology.orchestra.run.smithi130.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-10-08T11:56:31.494 INFO:teuthology.orchestra.run.smithi130.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-10-08T11:56:31.494 INFO:teuthology.orchestra.run.smithi130.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-10-08T11:56:31.494 INFO:teuthology.orchestra.run.smithi130.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-10-08T11:56:31.494 INFO:teuthology.orchestra.run.smithi130.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-10-08T11:56:31.494 INFO:teuthology.orchestra.run.smithi130.stdout: socat xmlstarlet 2023-10-08T11:56:31.497 INFO:teuthology.orchestra.run.smithi062.stdout:The following packages were automatically installed and are no longer required: 2023-10-08T11:56:31.497 INFO:teuthology.orchestra.run.smithi062.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-10-08T11:56:31.497 INFO:teuthology.orchestra.run.smithi062.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-10-08T11:56:31.498 INFO:teuthology.orchestra.run.smithi062.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-10-08T11:56:31.498 INFO:teuthology.orchestra.run.smithi062.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2023-10-08T11:56:31.498 INFO:teuthology.orchestra.run.smithi062.stdout: python2.7-minimal 2023-10-08T11:56:31.498 INFO:teuthology.orchestra.run.smithi062.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-08T11:56:31.499 INFO:teuthology.orchestra.run.smithi062.stdout:The following additional packages will be installed: 2023-10-08T11:56:31.500 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-10-08T11:56:31.500 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-10-08T11:56:31.500 INFO:teuthology.orchestra.run.smithi062.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-10-08T11:56:31.500 INFO:teuthology.orchestra.run.smithi062.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-10-08T11:56:31.500 INFO:teuthology.orchestra.run.smithi062.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-10-08T11:56:31.500 INFO:teuthology.orchestra.run.smithi062.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-10-08T11:56:31.500 INFO:teuthology.orchestra.run.smithi062.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-10-08T11:56:31.500 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-10-08T11:56:31.500 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-10-08T11:56:31.500 INFO:teuthology.orchestra.run.smithi062.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-10-08T11:56:31.500 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-10-08T11:56:31.501 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-10-08T11:56:31.501 INFO:teuthology.orchestra.run.smithi062.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-10-08T11:56:31.501 INFO:teuthology.orchestra.run.smithi062.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-10-08T11:56:31.502 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-10-08T11:56:31.502 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-10-08T11:56:31.502 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-10-08T11:56:31.502 INFO:teuthology.orchestra.run.smithi062.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-10-08T11:56:31.502 INFO:teuthology.orchestra.run.smithi062.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-10-08T11:56:31.502 INFO:teuthology.orchestra.run.smithi062.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-10-08T11:56:31.502 INFO:teuthology.orchestra.run.smithi062.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-10-08T11:56:31.502 INFO:teuthology.orchestra.run.smithi062.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-10-08T11:56:31.502 INFO:teuthology.orchestra.run.smithi062.stdout: qttranslations5-l10n socat xmlstarlet 2023-10-08T11:56:31.503 INFO:teuthology.orchestra.run.smithi062.stdout:Suggested packages: 2023-10-08T11:56:31.503 INFO:teuthology.orchestra.run.smithi062.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-10-08T11:56:31.503 INFO:teuthology.orchestra.run.smithi062.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-10-08T11:56:31.503 INFO:teuthology.orchestra.run.smithi062.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-10-08T11:56:31.503 INFO:teuthology.orchestra.run.smithi062.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-10-08T11:56:31.503 INFO:teuthology.orchestra.run.smithi062.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-10-08T11:56:31.503 INFO:teuthology.orchestra.run.smithi062.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-10-08T11:56:31.503 INFO:teuthology.orchestra.run.smithi062.stdout: python3-watchdog 2023-10-08T11:56:31.503 INFO:teuthology.orchestra.run.smithi062.stdout:Recommended packages: 2023-10-08T11:56:31.503 INFO:teuthology.orchestra.run.smithi062.stdout: btrfs-tools 2023-10-08T11:56:31.549 INFO:teuthology.orchestra.run.smithi130.stdout:0 upgraded, 115 newly installed, 0 to remove and 257 not upgraded. 2023-10-08T11:56:31.550 INFO:teuthology.orchestra.run.smithi130.stdout:Need to get 184 MB of archives. 2023-10-08T11:56:31.550 INFO:teuthology.orchestra.run.smithi130.stdout:After this operation, 825 MB of additional disk space will be used. 2023-10-08T11:56:31.550 INFO:teuthology.orchestra.run.smithi130.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-10-08T11:56:31.567 INFO:teuthology.orchestra.run.smithi130.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-10-08T11:56:31.577 INFO:teuthology.orchestra.run.smithi130.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-10-08T11:56:31.604 INFO:teuthology.orchestra.run.smithi062.stdout:The following NEW packages will be installed: 2023-10-08T11:56:31.604 INFO:teuthology.orchestra.run.smithi062.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-10-08T11:56:31.604 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-10-08T11:56:31.604 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-10-08T11:56:31.606 INFO:teuthology.orchestra.run.smithi062.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-10-08T11:56:31.606 INFO:teuthology.orchestra.run.smithi062.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-10-08T11:56:31.606 INFO:teuthology.orchestra.run.smithi062.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-10-08T11:56:31.606 INFO:teuthology.orchestra.run.smithi062.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2023-10-08T11:56:31.607 INFO:teuthology.orchestra.run.smithi062.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-10-08T11:56:31.607 INFO:teuthology.orchestra.run.smithi062.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-10-08T11:56:31.607 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-10-08T11:56:31.607 INFO:teuthology.orchestra.run.smithi062.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-10-08T11:56:31.607 INFO:teuthology.orchestra.run.smithi062.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-10-08T11:56:31.607 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-10-08T11:56:31.608 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-10-08T11:56:31.608 INFO:teuthology.orchestra.run.smithi062.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-10-08T11:56:31.608 INFO:teuthology.orchestra.run.smithi062.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-10-08T11:56:31.608 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-10-08T11:56:31.608 INFO:teuthology.orchestra.run.smithi062.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-10-08T11:56:31.608 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-10-08T11:56:31.608 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-10-08T11:56:31.608 INFO:teuthology.orchestra.run.smithi062.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-10-08T11:56:31.609 INFO:teuthology.orchestra.run.smithi062.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-10-08T11:56:31.609 INFO:teuthology.orchestra.run.smithi062.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-10-08T11:56:31.609 INFO:teuthology.orchestra.run.smithi062.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-10-08T11:56:31.609 INFO:teuthology.orchestra.run.smithi062.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-10-08T11:56:31.609 INFO:teuthology.orchestra.run.smithi062.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-10-08T11:56:31.609 INFO:teuthology.orchestra.run.smithi062.stdout: socat xmlstarlet 2023-10-08T11:56:31.617 INFO:teuthology.orchestra.run.smithi130.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2023-10-08T11:56:31.625 INFO:teuthology.orchestra.run.smithi130.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-10-08T11:56:31.633 INFO:teuthology.orchestra.run.smithi130.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-6639-g7b3143ba-1jammy [3,448 kB] 2023-10-08T11:56:31.634 INFO:teuthology.orchestra.run.smithi156.stdout:Building dependency tree... 2023-10-08T11:56:31.635 INFO:teuthology.orchestra.run.smithi156.stdout:Reading state information... 2023-10-08T11:56:31.641 INFO:teuthology.orchestra.run.smithi130.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-10-08T11:56:31.644 INFO:teuthology.orchestra.run.smithi130.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-10-08T11:56:31.653 INFO:teuthology.orchestra.run.smithi130.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-10-08T11:56:31.663 INFO:teuthology.orchestra.run.smithi062.stdout:0 upgraded, 115 newly installed, 0 to remove and 257 not upgraded. 2023-10-08T11:56:31.663 INFO:teuthology.orchestra.run.smithi062.stdout:Need to get 184 MB of archives. 2023-10-08T11:56:31.663 INFO:teuthology.orchestra.run.smithi062.stdout:After this operation, 825 MB of additional disk space will be used. 2023-10-08T11:56:31.663 INFO:teuthology.orchestra.run.smithi062.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-10-08T11:56:31.680 INFO:teuthology.orchestra.run.smithi062.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-10-08T11:56:31.690 INFO:teuthology.orchestra.run.smithi062.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-10-08T11:56:31.699 INFO:teuthology.orchestra.run.smithi130.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-10-08T11:56:31.703 INFO:teuthology.orchestra.run.smithi130.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-10-08T11:56:31.714 INFO:teuthology.orchestra.run.smithi130.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-10-08T11:56:31.718 INFO:teuthology.orchestra.run.smithi130.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-10-08T11:56:31.718 INFO:teuthology.orchestra.run.smithi130.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-10-08T11:56:31.726 INFO:teuthology.orchestra.run.smithi130.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-10-08T11:56:31.727 INFO:teuthology.orchestra.run.smithi130.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-10-08T11:56:31.727 INFO:teuthology.orchestra.run.smithi130.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-10-08T11:56:31.728 INFO:teuthology.orchestra.run.smithi130.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-10-08T11:56:31.729 INFO:teuthology.orchestra.run.smithi130.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-10-08T11:56:31.730 INFO:teuthology.orchestra.run.smithi062.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2023-10-08T11:56:31.736 INFO:teuthology.orchestra.run.smithi130.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-10-08T11:56:31.737 INFO:teuthology.orchestra.run.smithi130.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-10-08T11:56:31.739 INFO:teuthology.orchestra.run.smithi062.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-10-08T11:56:31.753 INFO:teuthology.orchestra.run.smithi130.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-10-08T11:56:31.753 INFO:teuthology.orchestra.run.smithi130.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-10-08T11:56:31.753 INFO:teuthology.orchestra.run.smithi130.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-10-08T11:56:31.755 INFO:teuthology.orchestra.run.smithi062.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-10-08T11:56:31.756 INFO:teuthology.orchestra.run.smithi130.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-10-08T11:56:31.756 INFO:teuthology.orchestra.run.smithi130.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-10-08T11:56:31.757 INFO:teuthology.orchestra.run.smithi130.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-10-08T11:56:31.757 INFO:teuthology.orchestra.run.smithi130.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-10-08T11:56:31.758 INFO:teuthology.orchestra.run.smithi062.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-10-08T11:56:31.758 INFO:teuthology.orchestra.run.smithi130.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-10-08T11:56:31.768 INFO:teuthology.orchestra.run.smithi062.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-10-08T11:56:31.769 INFO:teuthology.orchestra.run.smithi130.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-10-08T11:56:31.770 INFO:teuthology.orchestra.run.smithi130.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-10-08T11:56:31.785 INFO:teuthology.orchestra.run.smithi156.stdout:The following packages were automatically installed and are no longer required: 2023-10-08T11:56:31.785 INFO:teuthology.orchestra.run.smithi156.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-10-08T11:56:31.785 INFO:teuthology.orchestra.run.smithi156.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-10-08T11:56:31.785 INFO:teuthology.orchestra.run.smithi156.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-10-08T11:56:31.785 INFO:teuthology.orchestra.run.smithi156.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-10-08T11:56:31.786 INFO:teuthology.orchestra.run.smithi156.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-10-08T11:56:31.787 INFO:teuthology.orchestra.run.smithi156.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-08T11:56:31.787 INFO:teuthology.orchestra.run.smithi156.stdout:The following additional packages will be installed: 2023-10-08T11:56:31.787 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-10-08T11:56:31.787 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-10-08T11:56:31.787 INFO:teuthology.orchestra.run.smithi156.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-10-08T11:56:31.787 INFO:teuthology.orchestra.run.smithi156.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-10-08T11:56:31.788 INFO:teuthology.orchestra.run.smithi130.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-10-08T11:56:31.788 INFO:teuthology.orchestra.run.smithi130.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-10-08T11:56:31.788 INFO:teuthology.orchestra.run.smithi130.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-10-08T11:56:31.789 INFO:teuthology.orchestra.run.smithi156.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-10-08T11:56:31.789 INFO:teuthology.orchestra.run.smithi156.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-10-08T11:56:31.789 INFO:teuthology.orchestra.run.smithi156.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-10-08T11:56:31.789 INFO:teuthology.orchestra.run.smithi156.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-10-08T11:56:31.789 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-10-08T11:56:31.790 INFO:teuthology.orchestra.run.smithi156.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-10-08T11:56:31.790 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-10-08T11:56:31.790 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-10-08T11:56:31.790 INFO:teuthology.orchestra.run.smithi156.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-10-08T11:56:31.790 INFO:teuthology.orchestra.run.smithi156.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-10-08T11:56:31.790 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-10-08T11:56:31.790 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-10-08T11:56:31.790 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-10-08T11:56:31.790 INFO:teuthology.orchestra.run.smithi156.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-10-08T11:56:31.790 INFO:teuthology.orchestra.run.smithi156.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-10-08T11:56:31.790 INFO:teuthology.orchestra.run.smithi156.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-10-08T11:56:31.790 INFO:teuthology.orchestra.run.smithi156.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-10-08T11:56:31.791 INFO:teuthology.orchestra.run.smithi156.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-10-08T11:56:31.791 INFO:teuthology.orchestra.run.smithi156.stdout: qttranslations5-l10n socat xmlstarlet 2023-10-08T11:56:31.791 INFO:teuthology.orchestra.run.smithi156.stdout:Suggested packages: 2023-10-08T11:56:31.791 INFO:teuthology.orchestra.run.smithi156.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-10-08T11:56:31.791 INFO:teuthology.orchestra.run.smithi156.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-10-08T11:56:31.791 INFO:teuthology.orchestra.run.smithi156.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-10-08T11:56:31.791 INFO:teuthology.orchestra.run.smithi156.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-10-08T11:56:31.791 INFO:teuthology.orchestra.run.smithi156.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-10-08T11:56:31.791 INFO:teuthology.orchestra.run.smithi156.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-10-08T11:56:31.791 INFO:teuthology.orchestra.run.smithi156.stdout: python3-watchdog 2023-10-08T11:56:31.791 INFO:teuthology.orchestra.run.smithi156.stdout:Recommended packages: 2023-10-08T11:56:31.792 INFO:teuthology.orchestra.run.smithi156.stdout: btrfs-tools 2023-10-08T11:56:31.793 INFO:teuthology.orchestra.run.smithi130.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-10-08T11:56:31.793 INFO:teuthology.orchestra.run.smithi130.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-10-08T11:56:31.793 INFO:teuthology.orchestra.run.smithi130.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-10-08T11:56:31.794 INFO:teuthology.orchestra.run.smithi130.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-10-08T11:56:31.795 INFO:teuthology.orchestra.run.smithi130.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-10-08T11:56:31.803 INFO:teuthology.orchestra.run.smithi130.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-10-08T11:56:31.804 INFO:teuthology.orchestra.run.smithi130.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-urllib3 all 1.26.5-1~exp1 [96.4 kB] 2023-10-08T11:56:31.813 INFO:teuthology.orchestra.run.smithi062.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-10-08T11:56:31.814 INFO:teuthology.orchestra.run.smithi130.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-10-08T11:56:31.815 INFO:teuthology.orchestra.run.smithi130.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-10-08T11:56:31.817 INFO:teuthology.orchestra.run.smithi130.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-10-08T11:56:31.818 INFO:teuthology.orchestra.run.smithi062.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-10-08T11:56:31.818 INFO:teuthology.orchestra.run.smithi130.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-10-08T11:56:31.821 INFO:teuthology.orchestra.run.smithi130.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-10-08T11:56:31.825 INFO:teuthology.orchestra.run.smithi062.stdout:Get:11 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-6639-g7b3143ba-1jammy [3,448 kB] 2023-10-08T11:56:31.829 INFO:teuthology.orchestra.run.smithi062.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-10-08T11:56:31.833 INFO:teuthology.orchestra.run.smithi062.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-10-08T11:56:31.833 INFO:teuthology.orchestra.run.smithi062.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-10-08T11:56:31.842 INFO:teuthology.orchestra.run.smithi062.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-10-08T11:56:31.843 INFO:teuthology.orchestra.run.smithi062.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-10-08T11:56:31.843 INFO:teuthology.orchestra.run.smithi062.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-10-08T11:56:31.844 INFO:teuthology.orchestra.run.smithi062.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-10-08T11:56:31.844 INFO:teuthology.orchestra.run.smithi062.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-10-08T11:56:31.851 INFO:teuthology.orchestra.run.smithi062.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-10-08T11:56:31.852 INFO:teuthology.orchestra.run.smithi062.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-10-08T11:56:31.868 INFO:teuthology.orchestra.run.smithi062.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-10-08T11:56:31.869 INFO:teuthology.orchestra.run.smithi062.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-10-08T11:56:31.870 INFO:teuthology.orchestra.run.smithi062.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-10-08T11:56:31.873 INFO:teuthology.orchestra.run.smithi130.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-10-08T11:56:31.875 INFO:teuthology.orchestra.run.smithi062.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-10-08T11:56:31.876 INFO:teuthology.orchestra.run.smithi062.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-10-08T11:56:31.876 INFO:teuthology.orchestra.run.smithi062.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-10-08T11:56:31.876 INFO:teuthology.orchestra.run.smithi062.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-10-08T11:56:31.876 INFO:teuthology.orchestra.run.smithi062.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-10-08T11:56:31.876 INFO:teuthology.orchestra.run.smithi130.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-10-08T11:56:31.877 INFO:teuthology.orchestra.run.smithi130.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-10-08T11:56:31.877 INFO:teuthology.orchestra.run.smithi130.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-10-08T11:56:31.877 INFO:teuthology.orchestra.run.smithi130.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-10-08T11:56:31.877 INFO:teuthology.orchestra.run.smithi130.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-10-08T11:56:31.886 INFO:teuthology.orchestra.run.smithi062.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-10-08T11:56:31.886 INFO:teuthology.orchestra.run.smithi062.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-10-08T11:56:31.892 INFO:teuthology.orchestra.run.smithi130.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-10-08T11:56:31.894 INFO:teuthology.orchestra.run.smithi130.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-10-08T11:56:31.894 INFO:teuthology.orchestra.run.smithi130.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-10-08T11:56:31.902 INFO:teuthology.orchestra.run.smithi062.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-10-08T11:56:31.903 INFO:teuthology.orchestra.run.smithi062.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-10-08T11:56:31.903 INFO:teuthology.orchestra.run.smithi062.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-10-08T11:56:31.909 INFO:teuthology.orchestra.run.smithi062.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-10-08T11:56:31.909 INFO:teuthology.orchestra.run.smithi062.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-10-08T11:56:31.910 INFO:teuthology.orchestra.run.smithi062.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-10-08T11:56:31.910 INFO:teuthology.orchestra.run.smithi130.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-10-08T11:56:31.911 INFO:teuthology.orchestra.run.smithi130.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-10-08T11:56:31.911 INFO:teuthology.orchestra.run.smithi130.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-10-08T11:56:31.911 INFO:teuthology.orchestra.run.smithi130.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-10-08T11:56:31.911 INFO:teuthology.orchestra.run.smithi130.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-10-08T11:56:31.911 INFO:teuthology.orchestra.run.smithi130.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-10-08T11:56:31.912 INFO:teuthology.orchestra.run.smithi062.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-10-08T11:56:31.912 INFO:teuthology.orchestra.run.smithi062.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-10-08T11:56:31.919 INFO:teuthology.orchestra.run.smithi062.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-10-08T11:56:31.920 INFO:teuthology.orchestra.run.smithi062.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-urllib3 all 1.26.5-1~exp1 [96.4 kB] 2023-10-08T11:56:31.923 INFO:teuthology.orchestra.run.smithi130.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-10-08T11:56:31.924 INFO:teuthology.orchestra.run.smithi130.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-10-08T11:56:31.926 INFO:teuthology.orchestra.run.smithi130.stdout:Get:64 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-6639-g7b3143ba-1jammy [3,130 kB] 2023-10-08T11:56:31.927 INFO:teuthology.orchestra.run.smithi130.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-10-08T11:56:31.930 INFO:teuthology.orchestra.run.smithi156.stdout:The following NEW packages will be installed: 2023-10-08T11:56:31.930 INFO:teuthology.orchestra.run.smithi156.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-10-08T11:56:31.930 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-10-08T11:56:31.930 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-10-08T11:56:31.930 INFO:teuthology.orchestra.run.smithi156.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-10-08T11:56:31.931 INFO:teuthology.orchestra.run.smithi062.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-10-08T11:56:31.932 INFO:teuthology.orchestra.run.smithi156.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-10-08T11:56:31.932 INFO:teuthology.orchestra.run.smithi156.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-10-08T11:56:31.932 INFO:teuthology.orchestra.run.smithi156.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2023-10-08T11:56:31.933 INFO:teuthology.orchestra.run.smithi156.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-10-08T11:56:31.933 INFO:teuthology.orchestra.run.smithi156.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-10-08T11:56:31.933 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-10-08T11:56:31.933 INFO:teuthology.orchestra.run.smithi156.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-10-08T11:56:31.933 INFO:teuthology.orchestra.run.smithi156.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-10-08T11:56:31.933 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-10-08T11:56:31.933 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-10-08T11:56:31.933 INFO:teuthology.orchestra.run.smithi156.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-10-08T11:56:31.934 INFO:teuthology.orchestra.run.smithi156.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-10-08T11:56:31.934 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-10-08T11:56:31.934 INFO:teuthology.orchestra.run.smithi156.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-10-08T11:56:31.934 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-10-08T11:56:31.934 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-10-08T11:56:31.935 INFO:teuthology.orchestra.run.smithi156.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-10-08T11:56:31.935 INFO:teuthology.orchestra.run.smithi156.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-10-08T11:56:31.935 INFO:teuthology.orchestra.run.smithi156.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-10-08T11:56:31.935 INFO:teuthology.orchestra.run.smithi156.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-10-08T11:56:31.935 INFO:teuthology.orchestra.run.smithi156.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-10-08T11:56:31.935 INFO:teuthology.orchestra.run.smithi156.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-10-08T11:56:31.935 INFO:teuthology.orchestra.run.smithi156.stdout: socat xmlstarlet 2023-10-08T11:56:31.936 INFO:teuthology.orchestra.run.smithi062.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-10-08T11:56:31.936 INFO:teuthology.orchestra.run.smithi062.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-10-08T11:56:31.936 INFO:teuthology.orchestra.run.smithi062.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-10-08T11:56:31.937 INFO:teuthology.orchestra.run.smithi062.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-10-08T11:56:31.940 INFO:teuthology.orchestra.run.smithi130.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-10-08T11:56:31.941 INFO:teuthology.orchestra.run.smithi130.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-10-08T11:56:31.942 INFO:teuthology.orchestra.run.smithi130.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-10-08T11:56:31.946 INFO:teuthology.orchestra.run.smithi130.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-10-08T11:56:31.947 INFO:teuthology.orchestra.run.smithi130.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-10-08T11:56:31.948 INFO:teuthology.orchestra.run.smithi130.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-10-08T11:56:31.952 INFO:teuthology.orchestra.run.smithi130.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-10-08T11:56:31.957 INFO:teuthology.orchestra.run.smithi130.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-10-08T11:56:31.957 INFO:teuthology.orchestra.run.smithi130.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-10-08T11:56:31.958 INFO:teuthology.orchestra.run.smithi130.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-10-08T11:56:31.974 INFO:teuthology.orchestra.run.smithi130.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-10-08T11:56:31.976 INFO:teuthology.orchestra.run.smithi130.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-10-08T11:56:31.976 INFO:teuthology.orchestra.run.smithi130.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-10-08T11:56:31.982 INFO:teuthology.orchestra.run.smithi130.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-10-08T11:56:31.982 INFO:teuthology.orchestra.run.smithi130.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-10-08T11:56:31.982 INFO:teuthology.orchestra.run.smithi130.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-10-08T11:56:31.984 INFO:teuthology.orchestra.run.smithi130.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-10-08T11:56:31.990 INFO:teuthology.orchestra.run.smithi062.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-10-08T11:56:31.991 INFO:teuthology.orchestra.run.smithi130.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-10-08T11:56:31.991 INFO:teuthology.orchestra.run.smithi062.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-10-08T11:56:31.992 INFO:teuthology.orchestra.run.smithi062.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-10-08T11:56:31.993 INFO:teuthology.orchestra.run.smithi062.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-10-08T11:56:31.993 INFO:teuthology.orchestra.run.smithi062.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-10-08T11:56:31.994 INFO:teuthology.orchestra.run.smithi062.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-10-08T11:56:32.012 INFO:teuthology.orchestra.run.smithi062.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-10-08T11:56:32.013 INFO:teuthology.orchestra.run.smithi062.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-10-08T11:56:32.014 INFO:teuthology.orchestra.run.smithi062.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-10-08T11:56:32.028 INFO:teuthology.orchestra.run.smithi062.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-10-08T11:56:32.029 INFO:teuthology.orchestra.run.smithi062.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-10-08T11:56:32.029 INFO:teuthology.orchestra.run.smithi062.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-10-08T11:56:32.029 INFO:teuthology.orchestra.run.smithi062.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-10-08T11:56:32.030 INFO:teuthology.orchestra.run.smithi062.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-10-08T11:56:32.030 INFO:teuthology.orchestra.run.smithi062.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-10-08T11:56:32.042 INFO:teuthology.orchestra.run.smithi062.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-10-08T11:56:32.043 INFO:teuthology.orchestra.run.smithi062.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-10-08T11:56:32.046 INFO:teuthology.orchestra.run.smithi062.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-10-08T11:56:32.057 INFO:teuthology.orchestra.run.smithi130.stdout:Get:84 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-6639-g7b3143ba-1jammy [690 kB] 2023-10-08T11:56:32.059 INFO:teuthology.orchestra.run.smithi062.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-10-08T11:56:32.060 INFO:teuthology.orchestra.run.smithi062.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-10-08T11:56:32.061 INFO:teuthology.orchestra.run.smithi062.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-10-08T11:56:32.064 INFO:teuthology.orchestra.run.smithi062.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-10-08T11:56:32.066 INFO:teuthology.orchestra.run.smithi062.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-10-08T11:56:32.066 INFO:teuthology.orchestra.run.smithi062.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-10-08T11:56:32.070 INFO:teuthology.orchestra.run.smithi062.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-10-08T11:56:32.076 INFO:teuthology.orchestra.run.smithi062.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-10-08T11:56:32.076 INFO:teuthology.orchestra.run.smithi062.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-10-08T11:56:32.077 INFO:teuthology.orchestra.run.smithi062.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-10-08T11:56:32.089 INFO:teuthology.orchestra.run.smithi130.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-6639-g7b3143ba-1jammy [356 kB] 2023-10-08T11:56:32.093 INFO:teuthology.orchestra.run.smithi062.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-10-08T11:56:32.094 INFO:teuthology.orchestra.run.smithi062.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-10-08T11:56:32.095 INFO:teuthology.orchestra.run.smithi062.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-10-08T11:56:32.101 INFO:teuthology.orchestra.run.smithi062.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-10-08T11:56:32.101 INFO:teuthology.orchestra.run.smithi062.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-10-08T11:56:32.101 INFO:teuthology.orchestra.run.smithi130.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-6639-g7b3143ba-1jammy [32.8 kB] 2023-10-08T11:56:32.102 INFO:teuthology.orchestra.run.smithi062.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-10-08T11:56:32.103 INFO:teuthology.orchestra.run.smithi062.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-10-08T11:56:32.104 INFO:teuthology.orchestra.run.smithi130.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-6639-g7b3143ba-1jammy [180 kB] 2023-10-08T11:56:32.109 INFO:teuthology.orchestra.run.smithi062.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-10-08T11:56:32.114 INFO:teuthology.orchestra.run.smithi130.stdout:Get:88 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-6639-g7b3143ba-1jammy [62.4 kB] 2023-10-08T11:56:32.116 INFO:teuthology.orchestra.run.smithi130.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-6639-g7b3143ba-1jammy [329 kB] 2023-10-08T11:56:32.127 INFO:teuthology.orchestra.run.smithi156.stdout:0 upgraded, 115 newly installed, 0 to remove and 257 not upgraded. 2023-10-08T11:56:32.127 INFO:teuthology.orchestra.run.smithi156.stdout:Need to get 184 MB of archives. 2023-10-08T11:56:32.127 INFO:teuthology.orchestra.run.smithi156.stdout:After this operation, 825 MB of additional disk space will be used. 2023-10-08T11:56:32.127 INFO:teuthology.orchestra.run.smithi156.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-10-08T11:56:32.130 INFO:teuthology.orchestra.run.smithi130.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-6639-g7b3143ba-1jammy [6,213 kB] 2023-10-08T11:56:32.174 INFO:teuthology.orchestra.run.smithi156.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-6639-g7b3143ba-1jammy [3,448 kB] 2023-10-08T11:56:32.210 INFO:teuthology.orchestra.run.smithi156.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-10-08T11:56:32.255 INFO:teuthology.orchestra.run.smithi156.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-10-08T11:56:32.421 INFO:teuthology.orchestra.run.smithi062.stdout:Get:83 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-6639-g7b3143ba-1jammy [3,130 kB] 2023-10-08T11:56:32.439 INFO:teuthology.orchestra.run.smithi130.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-6639-g7b3143ba-1jammy [112 kB] 2023-10-08T11:56:32.450 INFO:teuthology.orchestra.run.smithi130.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-6639-g7b3143ba-1jammy [439 kB] 2023-10-08T11:56:32.451 INFO:teuthology.orchestra.run.smithi156.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2023-10-08T11:56:32.459 INFO:teuthology.orchestra.run.smithi130.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-6639-g7b3143ba-1jammy [22.6 MB] 2023-10-08T11:56:32.494 INFO:teuthology.orchestra.run.smithi156.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-10-08T11:56:32.569 INFO:teuthology.orchestra.run.smithi156.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-10-08T11:56:32.580 INFO:teuthology.orchestra.run.smithi156.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-10-08T11:56:32.626 INFO:teuthology.orchestra.run.smithi156.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-10-08T11:56:32.792 INFO:teuthology.orchestra.run.smithi156.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-10-08T11:56:32.800 INFO:teuthology.orchestra.run.smithi156.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-10-08T11:56:32.827 INFO:teuthology.orchestra.run.smithi156.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-10-08T11:56:32.835 INFO:teuthology.orchestra.run.smithi062.stdout:Get:84 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-6639-g7b3143ba-1jammy [690 kB] 2023-10-08T11:56:32.932 INFO:teuthology.orchestra.run.smithi062.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-6639-g7b3143ba-1jammy [356 kB] 2023-10-08T11:56:32.992 INFO:teuthology.orchestra.run.smithi062.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-6639-g7b3143ba-1jammy [32.8 kB] 2023-10-08T11:56:32.993 INFO:teuthology.orchestra.run.smithi062.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-6639-g7b3143ba-1jammy [180 kB] 2023-10-08T11:56:32.998 INFO:teuthology.orchestra.run.smithi156.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-10-08T11:56:33.012 INFO:teuthology.orchestra.run.smithi062.stdout:Get:88 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-6639-g7b3143ba-1jammy [62.4 kB] 2023-10-08T11:56:33.022 INFO:teuthology.orchestra.run.smithi062.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-6639-g7b3143ba-1jammy [329 kB] 2023-10-08T11:56:33.079 INFO:teuthology.orchestra.run.smithi062.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-6639-g7b3143ba-1jammy [6,213 kB] 2023-10-08T11:56:33.193 INFO:teuthology.orchestra.run.smithi156.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-10-08T11:56:33.557 INFO:teuthology.orchestra.run.smithi156.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-10-08T11:56:33.565 INFO:teuthology.orchestra.run.smithi156.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-10-08T11:56:33.567 INFO:teuthology.orchestra.run.smithi156.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-10-08T11:56:33.578 INFO:teuthology.orchestra.run.smithi156.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-10-08T11:56:33.580 INFO:teuthology.orchestra.run.smithi156.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-10-08T11:56:33.581 INFO:teuthology.orchestra.run.smithi156.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-10-08T11:56:33.582 INFO:teuthology.orchestra.run.smithi156.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-10-08T11:56:33.585 INFO:teuthology.orchestra.run.smithi156.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-10-08T11:56:33.586 INFO:teuthology.orchestra.run.smithi156.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-10-08T11:56:33.591 INFO:teuthology.orchestra.run.smithi130.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-6639-g7b3143ba-1jammy [6,852 kB] 2023-10-08T11:56:33.752 INFO:teuthology.orchestra.run.smithi156.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-10-08T11:56:33.812 INFO:teuthology.orchestra.run.smithi130.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-6639-g7b3143ba-1jammy [238 kB] 2023-10-08T11:56:33.823 INFO:teuthology.orchestra.run.smithi130.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-6639-g7b3143ba-1jammy [128 kB] 2023-10-08T11:56:33.829 INFO:teuthology.orchestra.run.smithi130.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-6639-g7b3143ba-1jammy [1,498 kB] 2023-10-08T11:56:33.899 INFO:teuthology.orchestra.run.smithi130.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-6639-g7b3143ba-1jammy [9,875 kB] 2023-10-08T11:56:33.934 INFO:teuthology.orchestra.run.smithi062.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-6639-g7b3143ba-1jammy [112 kB] 2023-10-08T11:56:33.948 INFO:teuthology.orchestra.run.smithi062.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-6639-g7b3143ba-1jammy [439 kB] 2023-10-08T11:56:34.008 INFO:teuthology.orchestra.run.smithi062.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-6639-g7b3143ba-1jammy [22.6 MB] 2023-10-08T11:56:34.052 INFO:teuthology.orchestra.run.smithi156.stdout:Get:25 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-6639-g7b3143ba-1jammy [3,130 kB] 2023-10-08T11:56:34.184 INFO:teuthology.orchestra.run.smithi156.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-10-08T11:56:34.194 INFO:teuthology.orchestra.run.smithi156.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-10-08T11:56:34.200 INFO:teuthology.orchestra.run.smithi156.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-10-08T11:56:34.203 INFO:teuthology.orchestra.run.smithi156.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-10-08T11:56:34.222 INFO:teuthology.orchestra.run.smithi156.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-10-08T11:56:34.225 INFO:teuthology.orchestra.run.smithi156.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-10-08T11:56:34.227 INFO:teuthology.orchestra.run.smithi156.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-10-08T11:56:34.269 INFO:teuthology.orchestra.run.smithi156.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-10-08T11:56:34.283 INFO:teuthology.orchestra.run.smithi156.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-10-08T11:56:34.288 INFO:teuthology.orchestra.run.smithi156.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-10-08T11:56:34.359 INFO:teuthology.orchestra.run.smithi130.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-6639-g7b3143ba-1jammy [31.7 MB] 2023-10-08T11:56:34.541 INFO:teuthology.orchestra.run.smithi156.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-10-08T11:56:34.624 INFO:teuthology.orchestra.run.smithi156.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-10-08T11:56:34.714 INFO:teuthology.orchestra.run.smithi156.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-10-08T11:56:34.772 INFO:teuthology.orchestra.run.smithi156.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-10-08T11:56:34.894 INFO:teuthology.orchestra.run.smithi156.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-10-08T11:56:34.981 INFO:teuthology.orchestra.run.smithi156.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-10-08T11:56:34.999 INFO:teuthology.orchestra.run.smithi156.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-urllib3 all 1.26.5-1~exp1 [96.4 kB] 2023-10-08T11:56:35.028 INFO:teuthology.orchestra.run.smithi156.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-10-08T11:56:35.041 INFO:teuthology.orchestra.run.smithi156.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-10-08T11:56:35.079 INFO:teuthology.orchestra.run.smithi156.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-10-08T11:56:35.087 INFO:teuthology.orchestra.run.smithi156.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-10-08T11:56:35.280 INFO:teuthology.orchestra.run.smithi156.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-10-08T11:56:35.544 INFO:teuthology.orchestra.run.smithi156.stdout:Get:48 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-6639-g7b3143ba-1jammy [690 kB] 2023-10-08T11:56:35.822 INFO:teuthology.orchestra.run.smithi156.stdout:Get:49 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-6639-g7b3143ba-1jammy [356 kB] 2023-10-08T11:56:35.961 INFO:teuthology.orchestra.run.smithi130.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-6639-g7b3143ba-1jammy [14.1 kB] 2023-10-08T11:56:35.962 INFO:teuthology.orchestra.run.smithi130.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-6639-g7b3143ba-1jammy [839 kB] 2023-10-08T11:56:35.978 INFO:teuthology.orchestra.run.smithi130.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-6639-g7b3143ba-1jammy [2,149 kB] 2023-10-08T11:56:35.983 INFO:teuthology.orchestra.run.smithi156.stdout:Get:50 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-6639-g7b3143ba-1jammy [32.8 kB] 2023-10-08T11:56:35.985 INFO:teuthology.orchestra.run.smithi156.stdout:Get:51 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-6639-g7b3143ba-1jammy [180 kB] 2023-10-08T11:56:36.015 INFO:teuthology.orchestra.run.smithi130.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-6639-g7b3143ba-1jammy [283 kB] 2023-10-08T11:56:36.020 INFO:teuthology.orchestra.run.smithi130.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-6639-g7b3143ba-1jammy [138 kB] 2023-10-08T11:56:36.024 INFO:teuthology.orchestra.run.smithi130.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-6639-g7b3143ba-1jammy [1,906 kB] 2023-10-08T11:56:36.075 INFO:teuthology.orchestra.run.smithi156.stdout:Get:52 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-6639-g7b3143ba-1jammy [62.4 kB] 2023-10-08T11:56:36.087 INFO:teuthology.orchestra.run.smithi156.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-10-08T11:56:36.088 INFO:teuthology.orchestra.run.smithi156.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-10-08T11:56:36.090 INFO:teuthology.orchestra.run.smithi156.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-10-08T11:56:36.091 INFO:teuthology.orchestra.run.smithi156.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-10-08T11:56:36.091 INFO:teuthology.orchestra.run.smithi156.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-10-08T11:56:36.092 INFO:teuthology.orchestra.run.smithi156.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-10-08T11:56:36.115 INFO:teuthology.orchestra.run.smithi156.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-10-08T11:56:36.116 INFO:teuthology.orchestra.run.smithi130.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-6639-g7b3143ba-1jammy [8,625 kB] 2023-10-08T11:56:36.116 INFO:teuthology.orchestra.run.smithi156.stdout:Get:60 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-6639-g7b3143ba-1jammy [329 kB] 2023-10-08T11:56:36.118 INFO:teuthology.orchestra.run.smithi156.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-10-08T11:56:36.118 INFO:teuthology.orchestra.run.smithi156.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-10-08T11:56:36.188 INFO:teuthology.orchestra.run.smithi156.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-10-08T11:56:36.318 INFO:teuthology.orchestra.run.smithi156.stdout:Get:64 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-6639-g7b3143ba-1jammy [6,213 kB] 2023-10-08T11:56:36.353 INFO:teuthology.orchestra.run.smithi156.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-10-08T11:56:36.525 INFO:teuthology.orchestra.run.smithi130.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-6639-g7b3143ba-1jammy [14.2 kB] 2023-10-08T11:56:36.525 INFO:teuthology.orchestra.run.smithi130.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-6639-g7b3143ba-1jammy [47.7 MB] 2023-10-08T11:56:36.609 INFO:teuthology.orchestra.run.smithi156.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-10-08T11:56:36.641 INFO:teuthology.orchestra.run.smithi156.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-10-08T11:56:36.667 INFO:teuthology.orchestra.run.smithi156.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-10-08T11:56:36.719 INFO:teuthology.orchestra.run.smithi156.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-10-08T11:56:36.739 INFO:teuthology.orchestra.run.smithi156.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-10-08T11:56:36.766 INFO:teuthology.orchestra.run.smithi156.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-10-08T11:56:36.895 INFO:teuthology.orchestra.run.smithi156.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-10-08T11:56:36.927 INFO:teuthology.orchestra.run.smithi156.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-10-08T11:56:36.948 INFO:teuthology.orchestra.run.smithi156.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-10-08T11:56:36.955 INFO:teuthology.orchestra.run.smithi156.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-10-08T11:56:37.158 INFO:teuthology.orchestra.run.smithi156.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-10-08T11:56:37.189 INFO:teuthology.orchestra.run.smithi062.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-6639-g7b3143ba-1jammy [6,852 kB] 2023-10-08T11:56:37.620 INFO:teuthology.orchestra.run.smithi156.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-10-08T11:56:37.624 INFO:teuthology.orchestra.run.smithi156.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-10-08T11:56:37.751 INFO:teuthology.orchestra.run.smithi156.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-10-08T11:56:37.797 INFO:teuthology.orchestra.run.smithi156.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-10-08T11:56:37.798 INFO:teuthology.orchestra.run.smithi156.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-10-08T11:56:37.804 INFO:teuthology.orchestra.run.smithi156.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-10-08T11:56:37.806 INFO:teuthology.orchestra.run.smithi156.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-10-08T11:56:37.822 INFO:teuthology.orchestra.run.smithi156.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-10-08T11:56:37.829 INFO:teuthology.orchestra.run.smithi156.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-10-08T11:56:37.890 INFO:teuthology.orchestra.run.smithi156.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-10-08T11:56:38.055 INFO:teuthology.orchestra.run.smithi156.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-10-08T11:56:38.060 INFO:teuthology.orchestra.run.smithi062.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-6639-g7b3143ba-1jammy [238 kB] 2023-10-08T11:56:38.098 INFO:teuthology.orchestra.run.smithi062.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-6639-g7b3143ba-1jammy [128 kB] 2023-10-08T11:56:38.117 INFO:teuthology.orchestra.run.smithi062.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-6639-g7b3143ba-1jammy [1,498 kB] 2023-10-08T11:56:38.220 INFO:teuthology.orchestra.run.smithi156.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-10-08T11:56:38.324 INFO:teuthology.orchestra.run.smithi062.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-6639-g7b3143ba-1jammy [9,875 kB] 2023-10-08T11:56:38.497 INFO:teuthology.orchestra.run.smithi156.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-10-08T11:56:38.522 INFO:teuthology.orchestra.run.smithi156.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-10-08T11:56:38.991 INFO:teuthology.orchestra.run.smithi130.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-6639-g7b3143ba-1jammy [120 kB] 2023-10-08T11:56:38.993 INFO:teuthology.orchestra.run.smithi130.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-6639-g7b3143ba-1jammy [227 kB] 2023-10-08T11:56:38.998 INFO:teuthology.orchestra.run.smithi130.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-6639-g7b3143ba-1jammy [34.0 kB] 2023-10-08T11:56:38.999 INFO:teuthology.orchestra.run.smithi130.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-6639-g7b3143ba-1jammy [23.4 kB] 2023-10-08T11:56:39.000 INFO:teuthology.orchestra.run.smithi130.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-6639-g7b3143ba-1jammy [38.3 kB] 2023-10-08T11:56:39.001 INFO:teuthology.orchestra.run.smithi130.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-6639-g7b3143ba-1jammy [12.3 MB] 2023-10-08T11:56:39.388 INFO:teuthology.orchestra.run.smithi130.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-6639-g7b3143ba-1jammy [92.0 kB] 2023-10-08T11:56:39.426 INFO:teuthology.orchestra.run.smithi156.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-6639-g7b3143ba-1jammy [112 kB] 2023-10-08T11:56:39.432 INFO:teuthology.orchestra.run.smithi156.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-6639-g7b3143ba-1jammy [439 kB] 2023-10-08T11:56:39.600 INFO:teuthology.orchestra.run.smithi156.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-6639-g7b3143ba-1jammy [22.6 MB] 2023-10-08T11:56:39.627 INFO:teuthology.orchestra.run.smithi062.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-6639-g7b3143ba-1jammy [31.7 MB] 2023-10-08T11:56:39.944 INFO:teuthology.orchestra.run.smithi130.stdout:Fetched 184 MB in 8s (23.3 MB/s) 2023-10-08T11:56:40.062 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-pyperclip. 2023-10-08T11:56:40.145 INFO:teuthology.orchestra.run.smithi130.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 130506 files and directories currently installed.) 2023-10-08T11:56:40.149 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-10-08T11:56:40.186 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-10-08T11:56:40.446 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-wcwidth. 2023-10-08T11:56:40.467 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-10-08T11:56:40.505 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-10-08T11:56:40.833 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-cmd2. 2023-10-08T11:56:40.853 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-10-08T11:56:40.891 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-10-08T11:56:41.218 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libfmt8:amd64. 2023-10-08T11:56:41.239 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2023-10-08T11:56:41.318 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2023-10-08T11:56:41.646 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-10-08T11:56:41.667 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-10-08T11:56:41.704 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-10-08T11:56:41.770 INFO:teuthology.orchestra.run.smithi062.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-6639-g7b3143ba-1jammy [14.1 kB] 2023-10-08T11:56:41.771 INFO:teuthology.orchestra.run.smithi062.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-6639-g7b3143ba-1jammy [839 kB] 2023-10-08T11:56:41.787 INFO:teuthology.orchestra.run.smithi062.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-6639-g7b3143ba-1jammy [2,149 kB] 2023-10-08T11:56:41.896 INFO:teuthology.orchestra.run.smithi062.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-6639-g7b3143ba-1jammy [283 kB] 2023-10-08T11:56:41.903 INFO:teuthology.orchestra.run.smithi062.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-6639-g7b3143ba-1jammy [138 kB] 2023-10-08T11:56:41.915 INFO:teuthology.orchestra.run.smithi062.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-6639-g7b3143ba-1jammy [1,906 kB] 2023-10-08T11:56:42.008 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-10-08T11:56:42.025 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-10-08T11:56:42.037 INFO:teuthology.orchestra.run.smithi062.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-6639-g7b3143ba-1jammy [8,625 kB] 2023-10-08T11:56:42.058 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-10-08T11:56:42.394 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-10-08T11:56:42.415 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-10-08T11:56:42.452 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-10-08T11:56:42.560 INFO:teuthology.orchestra.run.smithi062.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-6639-g7b3143ba-1jammy [14.2 kB] 2023-10-08T11:56:42.561 INFO:teuthology.orchestra.run.smithi062.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-6639-g7b3143ba-1jammy [47.7 MB] 2023-10-08T11:56:43.180 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-10-08T11:56:43.201 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-10-08T11:56:43.247 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-08T11:56:43.608 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-10-08T11:56:43.620 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-10-08T11:56:43.648 INFO:teuthology.orchestra.run.smithi156.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-6639-g7b3143ba-1jammy [6,852 kB] 2023-10-08T11:56:43.650 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-08T11:56:43.994 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-10-08T11:56:44.015 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-10-08T11:56:44.052 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-08T11:56:44.355 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-10-08T11:56:44.367 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-10-08T11:56:44.406 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-10-08T11:56:44.648 INFO:teuthology.orchestra.run.smithi156.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-6639-g7b3143ba-1jammy [238 kB] 2023-10-08T11:56:44.682 INFO:teuthology.orchestra.run.smithi156.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-6639-g7b3143ba-1jammy [128 kB] 2023-10-08T11:56:44.715 INFO:teuthology.orchestra.run.smithi156.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-6639-g7b3143ba-1jammy [1,498 kB] 2023-10-08T11:56:44.733 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package librados2. 2023-10-08T11:56:44.753 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../011-librados2_18.0.0-6639-g7b3143ba-1jammy_amd64.deb ... 2023-10-08T11:56:44.791 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking librados2 (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:56:44.914 INFO:teuthology.orchestra.run.smithi156.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-6639-g7b3143ba-1jammy [9,875 kB] 2023-10-08T11:56:45.236 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package librbd1. 2023-10-08T11:56:45.256 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../012-librbd1_18.0.0-6639-g7b3143ba-1jammy_amd64.deb ... 2023-10-08T11:56:45.294 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking librbd1 (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:56:45.696 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libcephfs2. 2023-10-08T11:56:45.717 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../013-libcephfs2_18.0.0-6639-g7b3143ba-1jammy_amd64.deb ... 2023-10-08T11:56:45.754 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libcephfs2 (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:56:45.894 INFO:teuthology.orchestra.run.smithi062.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-6639-g7b3143ba-1jammy [120 kB] 2023-10-08T11:56:45.896 INFO:teuthology.orchestra.run.smithi062.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-6639-g7b3143ba-1jammy [227 kB] 2023-10-08T11:56:45.901 INFO:teuthology.orchestra.run.smithi062.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-6639-g7b3143ba-1jammy [34.0 kB] 2023-10-08T11:56:45.902 INFO:teuthology.orchestra.run.smithi062.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-6639-g7b3143ba-1jammy [23.4 kB] 2023-10-08T11:56:45.903 INFO:teuthology.orchestra.run.smithi062.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-6639-g7b3143ba-1jammy [38.3 kB] 2023-10-08T11:56:45.904 INFO:teuthology.orchestra.run.smithi062.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-6639-g7b3143ba-1jammy [12.3 MB] 2023-10-08T11:56:45.998 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-rados. 2023-10-08T11:56:46.010 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../014-python3-rados_18.0.0-6639-g7b3143ba-1jammy_amd64.deb ... 2023-10-08T11:56:46.040 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-rados (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:56:46.359 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-10-08T11:56:46.361 INFO:teuthology.orchestra.run.smithi156.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-6639-g7b3143ba-1jammy [31.7 MB] 2023-10-08T11:56:46.380 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.0.0-6639-g7b3143ba-1jammy_all.deb ... 2023-10-08T11:56:46.417 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-ceph-argparse (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:56:46.636 INFO:teuthology.orchestra.run.smithi062.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-6639-g7b3143ba-1jammy [92.0 kB] 2023-10-08T11:56:46.670 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-cephfs. 2023-10-08T11:56:46.682 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../016-python3-cephfs_18.0.0-6639-g7b3143ba-1jammy_amd64.deb ... 2023-10-08T11:56:46.720 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-cephfs (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:56:47.056 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-ceph-common. 2023-10-08T11:56:47.076 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../017-python3-ceph-common_18.0.0-6639-g7b3143ba-1jammy_all.deb ... 2023-10-08T11:56:47.122 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-ceph-common (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:56:47.209 INFO:teuthology.orchestra.run.smithi062.stdout:Fetched 184 MB in 15s (12.3 MB/s) 2023-10-08T11:56:47.353 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pyperclip. 2023-10-08T11:56:47.430 INFO:teuthology.orchestra.run.smithi062.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 130506 files and directories currently installed.) 2023-10-08T11:56:47.435 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-10-08T11:56:47.442 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-prettytable. 2023-10-08T11:56:47.462 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2023-10-08T11:56:47.484 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-10-08T11:56:47.492 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-10-08T11:56:47.753 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-rbd. 2023-10-08T11:56:47.773 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../019-python3-rbd_18.0.0-6639-g7b3143ba-1jammy_amd64.deb ... 2023-10-08T11:56:47.811 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-rbd (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:56:47.812 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-wcwidth. 2023-10-08T11:56:47.833 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-10-08T11:56:47.871 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-10-08T11:56:48.182 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-cmd2. 2023-10-08T11:56:48.203 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-10-08T11:56:48.232 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-10-08T11:56:48.363 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-10-08T11:56:48.384 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-10-08T11:56:48.422 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-10-08T11:56:48.543 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libfmt8:amd64. 2023-10-08T11:56:48.564 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2023-10-08T11:56:48.677 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2023-10-08T11:56:48.758 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package librgw2. 2023-10-08T11:56:48.778 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../021-librgw2_18.0.0-6639-g7b3143ba-1jammy_amd64.deb ... 2023-10-08T11:56:48.816 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking librgw2 (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:56:49.055 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-10-08T11:56:49.075 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-10-08T11:56:49.138 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-10-08T11:56:49.305 INFO:teuthology.orchestra.run.smithi156.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-6639-g7b3143ba-1jammy [14.1 kB] 2023-10-08T11:56:49.306 INFO:teuthology.orchestra.run.smithi156.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-6639-g7b3143ba-1jammy [839 kB] 2023-10-08T11:56:49.326 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-rgw. 2023-10-08T11:56:49.338 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../022-python3-rgw_18.0.0-6639-g7b3143ba-1jammy_amd64.deb ... 2023-10-08T11:56:49.351 INFO:teuthology.orchestra.run.smithi156.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-6639-g7b3143ba-1jammy [2,149 kB] 2023-10-08T11:56:49.368 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-rgw (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:56:49.488 INFO:teuthology.orchestra.run.smithi156.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-6639-g7b3143ba-1jammy [283 kB] 2023-10-08T11:56:49.506 INFO:teuthology.orchestra.run.smithi156.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-6639-g7b3143ba-1jammy [138 kB] 2023-10-08T11:56:49.521 INFO:teuthology.orchestra.run.smithi156.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-6639-g7b3143ba-1jammy [1,906 kB] 2023-10-08T11:56:49.525 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-10-08T11:56:49.546 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-10-08T11:56:49.608 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-10-08T11:56:49.621 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package liboath0:amd64. 2023-10-08T11:56:49.632 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2023-10-08T11:56:49.636 INFO:teuthology.orchestra.run.smithi156.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-6639-g7b3143ba-1jammy [8,625 kB] 2023-10-08T11:56:49.662 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-10-08T11:56:49.953 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-10-08T11:56:49.974 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-10-08T11:56:49.981 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libradosstriper1. 2023-10-08T11:56:50.002 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../024-libradosstriper1_18.0.0-6639-g7b3143ba-1jammy_amd64.deb ... 2023-10-08T11:56:50.003 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-10-08T11:56:50.040 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libradosstriper1 (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:56:50.138 INFO:teuthology.orchestra.run.smithi156.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-6639-g7b3143ba-1jammy [14.2 kB] 2023-10-08T11:56:50.138 INFO:teuthology.orchestra.run.smithi156.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-6639-g7b3143ba-1jammy [47.7 MB] 2023-10-08T11:56:50.457 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-10-08T11:56:50.478 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-10-08T11:56:50.485 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-common. 2023-10-08T11:56:50.505 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../025-ceph-common_18.0.0-6639-g7b3143ba-1jammy_amd64.deb ... 2023-10-08T11:56:50.515 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-08T11:56:50.543 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-common (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:56:50.927 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-10-08T11:56:50.950 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-10-08T11:56:51.019 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-08T11:56:51.380 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-10-08T11:56:51.401 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-10-08T11:56:51.439 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-08T11:56:51.807 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-base. 2023-10-08T11:56:51.827 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../026-ceph-base_18.0.0-6639-g7b3143ba-1jammy_amd64.deb ... 2023-10-08T11:56:51.842 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-10-08T11:56:51.862 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-10-08T11:56:51.866 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-base (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:56:51.925 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-10-08T11:56:52.142 INFO:teuthology.orchestra.run.smithi156.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-6639-g7b3143ba-1jammy [120 kB] 2023-10-08T11:56:52.144 INFO:teuthology.orchestra.run.smithi156.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-6639-g7b3143ba-1jammy [227 kB] 2023-10-08T11:56:52.146 INFO:teuthology.orchestra.run.smithi156.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-6639-g7b3143ba-1jammy [34.0 kB] 2023-10-08T11:56:52.146 INFO:teuthology.orchestra.run.smithi156.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-6639-g7b3143ba-1jammy [23.4 kB] 2023-10-08T11:56:52.147 INFO:teuthology.orchestra.run.smithi156.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-6639-g7b3143ba-1jammy [38.3 kB] 2023-10-08T11:56:52.147 INFO:teuthology.orchestra.run.smithi156.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-6639-g7b3143ba-1jammy [12.3 MB] 2023-10-08T11:56:52.536 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package librados2. 2023-10-08T11:56:52.548 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../011-librados2_18.0.0-6639-g7b3143ba-1jammy_amd64.deb ... 2023-10-08T11:56:52.579 INFO:teuthology.orchestra.run.smithi156.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-6639-g7b3143ba-1jammy [92.0 kB] 2023-10-08T11:56:52.610 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-10-08T11:56:52.611 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking librados2 (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:56:52.631 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-10-08T11:56:52.668 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-10-08T11:56:52.971 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-cheroot. 2023-10-08T11:56:52.991 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-10-08T11:56:53.029 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-10-08T11:56:53.072 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package librbd1. 2023-10-08T11:56:53.093 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../012-librbd1_18.0.0-6639-g7b3143ba-1jammy_amd64.deb ... 2023-10-08T11:56:53.130 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking librbd1 (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:56:53.150 INFO:teuthology.orchestra.run.smithi156.stdout:Fetched 184 MB in 21s (8,921 kB/s) 2023-10-08T11:56:53.291 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-pyperclip. 2023-10-08T11:56:53.362 INFO:teuthology.orchestra.run.smithi156.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132936 files and directories currently installed.) 2023-10-08T11:56:53.364 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-10-08T11:56:53.365 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-10-08T11:56:53.386 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-10-08T11:56:53.407 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-10-08T11:56:53.423 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-10-08T11:56:53.625 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libcephfs2. 2023-10-08T11:56:53.646 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../013-libcephfs2_18.0.0-6639-g7b3143ba-1jammy_amd64.deb ... 2023-10-08T11:56:53.684 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libcephfs2 (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:56:53.701 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-jaraco.text. 2023-10-08T11:56:53.709 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-wcwidth. 2023-10-08T11:56:53.722 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2023-10-08T11:56:53.733 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-10-08T11:56:53.759 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-10-08T11:56:53.934 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-10-08T11:56:53.986 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-rados. 2023-10-08T11:56:53.998 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../014-python3-rados_18.0.0-6639-g7b3143ba-1jammy_amd64.deb ... 2023-10-08T11:56:54.012 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-10-08T11:56:54.032 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-10-08T11:56:54.036 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-rados (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:56:54.062 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-10-08T11:56:54.237 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-cmd2. 2023-10-08T11:56:54.250 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-10-08T11:56:54.295 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-10-08T11:56:54.348 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-tempora. 2023-10-08T11:56:54.369 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2023-10-08T11:56:54.405 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-10-08T11:56:54.406 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-10-08T11:56:54.426 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.0.0-6639-g7b3143ba-1jammy_all.deb ... 2023-10-08T11:56:54.455 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-ceph-argparse (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:56:54.709 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-portend. 2023-10-08T11:56:54.718 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-cephfs. 2023-10-08T11:56:54.729 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2023-10-08T11:56:54.739 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../016-python3-cephfs_18.0.0-6639-g7b3143ba-1jammy_amd64.deb ... 2023-10-08T11:56:54.748 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libfmt8:amd64. 2023-10-08T11:56:54.762 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2023-10-08T11:56:54.767 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-10-08T11:56:54.776 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-cephfs (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:56:54.848 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2023-10-08T11:56:55.069 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-10-08T11:56:55.090 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2023-10-08T11:56:55.113 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-ceph-common. 2023-10-08T11:56:55.128 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-10-08T11:56:55.133 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../017-python3-ceph-common_18.0.0-6639-g7b3143ba-1jammy_all.deb ... 2023-10-08T11:56:55.151 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-10-08T11:56:55.166 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-10-08T11:56:55.170 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-ceph-common (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:56:55.234 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-10-08T11:56:55.372 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-cherrypy3. 2023-10-08T11:56:55.392 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2023-10-08T11:56:55.422 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-10-08T11:56:55.549 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-prettytable. 2023-10-08T11:56:55.570 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2023-10-08T11:56:55.571 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-10-08T11:56:55.586 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-10-08T11:56:55.607 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-10-08T11:56:55.629 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-10-08T11:56:55.784 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-natsort. 2023-10-08T11:56:55.804 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2023-10-08T11:56:55.842 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-10-08T11:56:55.851 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-rbd. 2023-10-08T11:56:55.872 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../019-python3-rbd_18.0.0-6639-g7b3143ba-1jammy_amd64.deb ... 2023-10-08T11:56:55.909 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-rbd (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:56:55.966 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-10-08T11:56:55.980 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-10-08T11:56:56.024 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-10-08T11:56:56.187 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-logutils. 2023-10-08T11:56:56.207 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2023-10-08T11:56:56.245 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-10-08T11:56:56.296 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-10-08T11:56:56.317 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-10-08T11:56:56.379 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-10-08T11:56:56.386 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-10-08T11:56:56.401 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-10-08T11:56:56.452 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-08T11:56:56.547 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-markupsafe. 2023-10-08T11:56:56.568 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-10-08T11:56:56.605 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-10-08T11:56:56.765 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package librgw2. 2023-10-08T11:56:56.786 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../021-librgw2_18.0.0-6639-g7b3143ba-1jammy_amd64.deb ... 2023-10-08T11:56:56.823 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking librgw2 (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:56:56.855 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-10-08T11:56:56.870 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-10-08T11:56:56.875 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-mako. 2023-10-08T11:56:56.895 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-10-08T11:56:56.914 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-08T11:56:56.933 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-10-08T11:56:57.244 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-simplegeneric. 2023-10-08T11:56:57.258 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-10-08T11:56:57.265 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2023-10-08T11:56:57.273 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-10-08T11:56:57.302 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-10-08T11:56:57.317 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-08T11:56:57.367 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-rgw. 2023-10-08T11:56:57.383 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../022-python3-rgw_18.0.0-6639-g7b3143ba-1jammy_amd64.deb ... 2023-10-08T11:56:57.575 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-rgw (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:56:57.605 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-singledispatch. 2023-10-08T11:56:57.620 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-10-08T11:56:57.625 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-10-08T11:56:57.634 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-10-08T11:56:57.663 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-10-08T11:56:57.669 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-10-08T11:56:57.954 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package liboath0:amd64. 2023-10-08T11:56:57.966 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-webob. 2023-10-08T11:56:57.975 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2023-10-08T11:56:57.987 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-10-08T11:56:57.989 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package librados2. 2023-10-08T11:56:58.003 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../011-librados2_18.0.0-6639-g7b3143ba-1jammy_amd64.deb ... 2023-10-08T11:56:58.011 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-10-08T11:56:58.024 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-10-08T11:56:58.047 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking librados2 (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:56:58.364 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libradosstriper1. 2023-10-08T11:56:58.386 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../024-libradosstriper1_18.0.0-6639-g7b3143ba-1jammy_amd64.deb ... 2023-10-08T11:56:58.456 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libradosstriper1 (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:56:58.525 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package librbd1. 2023-10-08T11:56:58.539 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../012-librbd1_18.0.0-6639-g7b3143ba-1jammy_amd64.deb ... 2023-10-08T11:56:58.560 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-waitress. 2023-10-08T11:56:58.581 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-10-08T11:56:58.583 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking librbd1 (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:56:58.622 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-10-08T11:56:58.930 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-tempita. 2023-10-08T11:56:58.934 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-common. 2023-10-08T11:56:58.951 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-10-08T11:56:58.955 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../025-ceph-common_18.0.0-6639-g7b3143ba-1jammy_amd64.deb ... 2023-10-08T11:56:58.988 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-10-08T11:56:58.992 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-common (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:56:59.119 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libcephfs2. 2023-10-08T11:56:59.134 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../013-libcephfs2_18.0.0-6639-g7b3143ba-1jammy_amd64.deb ... 2023-10-08T11:56:59.169 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libcephfs2 (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:56:59.274 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-paste. 2023-10-08T11:56:59.295 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-10-08T11:56:59.332 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-10-08T11:56:59.388 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-rados. 2023-10-08T11:56:59.402 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../014-python3-rados_18.0.0-6639-g7b3143ba-1jammy_amd64.deb ... 2023-10-08T11:56:59.446 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-rados (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:56:59.660 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-10-08T11:56:59.672 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-10-08T11:56:59.710 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-10-08T11:56:59.767 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-10-08T11:56:59.781 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.0.0-6639-g7b3143ba-1jammy_all.deb ... 2023-10-08T11:56:59.824 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-ceph-argparse (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:00.004 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-pastedeploy. 2023-10-08T11:57:00.025 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2023-10-08T11:57:00.062 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-10-08T11:57:00.085 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-cephfs. 2023-10-08T11:57:00.099 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../016-python3-cephfs_18.0.0-6639-g7b3143ba-1jammy_amd64.deb ... 2023-10-08T11:57:00.143 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-cephfs (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:00.315 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-base. 2023-10-08T11:57:00.336 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../026-ceph-base_18.0.0-6639-g7b3143ba-1jammy_amd64.deb ... 2023-10-08T11:57:00.390 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-base (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:00.392 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-webtest. 2023-10-08T11:57:00.414 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2023-10-08T11:57:00.451 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-10-08T11:57:00.479 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-ceph-common. 2023-10-08T11:57:00.493 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../017-python3-ceph-common_18.0.0-6639-g7b3143ba-1jammy_all.deb ... 2023-10-08T11:57:00.538 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-ceph-common (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:00.762 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-pecan. 2023-10-08T11:57:00.786 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-10-08T11:57:00.820 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-10-08T11:57:00.849 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-prettytable. 2023-10-08T11:57:00.863 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2023-10-08T11:57:00.907 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-10-08T11:57:01.161 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-10-08T11:57:01.182 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-10-08T11:57:01.183 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-certifi. 2023-10-08T11:57:01.204 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2023-10-08T11:57:01.219 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-10-08T11:57:01.226 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-rbd. 2023-10-08T11:57:01.241 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../019-python3-rbd_18.0.0-6639-g7b3143ba-1jammy_amd64.deb ... 2023-10-08T11:57:01.250 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-10-08T11:57:01.276 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-rbd (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:01.521 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-cheroot. 2023-10-08T11:57:01.542 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-10-08T11:57:01.544 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-idna. 2023-10-08T11:57:01.565 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2023-10-08T11:57:01.571 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-10-08T11:57:01.585 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-10-08T11:57:01.596 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-10-08T11:57:01.602 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-idna (3.3-1) ... 2023-10-08T11:57:01.646 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-10-08T11:57:01.905 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-urllib3. 2023-10-08T11:57:01.926 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1_all.deb ... 2023-10-08T11:57:01.932 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-10-08T11:57:01.953 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-10-08T11:57:01.957 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package librgw2. 2023-10-08T11:57:01.963 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1) ... 2023-10-08T11:57:01.971 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../021-librgw2_18.0.0-6639-g7b3143ba-1jammy_amd64.deb ... 2023-10-08T11:57:01.991 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-10-08T11:57:02.015 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking librgw2 (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:02.292 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-requests. 2023-10-08T11:57:02.313 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-10-08T11:57:02.327 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-jaraco.text. 2023-10-08T11:57:02.348 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2023-10-08T11:57:02.350 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-10-08T11:57:02.385 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-10-08T11:57:02.476 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-rgw. 2023-10-08T11:57:02.489 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../022-python3-rgw_18.0.0-6639-g7b3143ba-1jammy_amd64.deb ... 2023-10-08T11:57:02.534 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-rgw (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:02.661 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-werkzeug. 2023-10-08T11:57:02.682 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-10-08T11:57:02.719 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-10-08T11:57:02.829 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package liboath0:amd64. 2023-10-08T11:57:02.842 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2023-10-08T11:57:02.904 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-10-08T11:57:02.930 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-10-08T11:57:02.950 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-10-08T11:57:02.988 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-10-08T11:57:03.031 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-10-08T11:57:03.052 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.0.0-6639-g7b3143ba-1jammy_all.deb ... 2023-10-08T11:57:03.097 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-mgr-modules-core (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:03.181 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libradosstriper1. 2023-10-08T11:57:03.195 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../024-libradosstriper1_18.0.0-6639-g7b3143ba-1jammy_amd64.deb ... 2023-10-08T11:57:03.248 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libradosstriper1 (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:03.332 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-tempora. 2023-10-08T11:57:03.353 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2023-10-08T11:57:03.415 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-10-08T11:57:03.469 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-10-08T11:57:03.490 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.0.0-6639-g7b3143ba-1jammy_amd64.deb ... 2023-10-08T11:57:03.527 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:03.668 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package ceph-common. 2023-10-08T11:57:03.682 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../025-ceph-common_18.0.0-6639-g7b3143ba-1jammy_amd64.deb ... 2023-10-08T11:57:03.726 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking ceph-common (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:03.752 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-portend. 2023-10-08T11:57:03.773 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2023-10-08T11:57:03.810 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-10-08T11:57:03.847 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-openssl. 2023-10-08T11:57:03.868 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2023-10-08T11:57:03.905 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-10-08T11:57:04.146 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-10-08T11:57:04.167 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2023-10-08T11:57:04.204 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-10-08T11:57:04.258 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-mgr. 2023-10-08T11:57:04.279 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../058-ceph-mgr_18.0.0-6639-g7b3143ba-1jammy_amd64.deb ... 2023-10-08T11:57:04.316 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-mgr (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:04.499 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-cherrypy3. 2023-10-08T11:57:04.520 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2023-10-08T11:57:04.549 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-10-08T11:57:04.711 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-mon. 2023-10-08T11:57:04.723 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../059-ceph-mon_18.0.0-6639-g7b3143ba-1jammy_amd64.deb ... 2023-10-08T11:57:04.752 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-mon (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:04.957 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package ceph-base. 2023-10-08T11:57:04.971 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../026-ceph-base_18.0.0-6639-g7b3143ba-1jammy_amd64.deb ... 2023-10-08T11:57:05.617 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking ceph-base (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:05.661 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-natsort. 2023-10-08T11:57:05.682 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2023-10-08T11:57:05.721 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-10-08T11:57:06.064 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-logutils. 2023-10-08T11:57:06.085 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2023-10-08T11:57:06.122 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-10-08T11:57:06.244 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-10-08T11:57:06.257 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-10-08T11:57:06.281 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-osd. 2023-10-08T11:57:06.294 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-10-08T11:57:06.303 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../060-ceph-osd_18.0.0-6639-g7b3143ba-1jammy_amd64.deb ... 2023-10-08T11:57:06.339 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-osd (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:06.483 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-markupsafe. 2023-10-08T11:57:06.504 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-10-08T11:57:06.541 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-10-08T11:57:06.597 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-cheroot. 2023-10-08T11:57:06.610 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-10-08T11:57:06.647 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-10-08T11:57:06.844 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-mako. 2023-10-08T11:57:06.865 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-10-08T11:57:06.902 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-10-08T11:57:06.992 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-10-08T11:57:07.005 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-10-08T11:57:07.050 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-10-08T11:57:07.272 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-simplegeneric. 2023-10-08T11:57:07.293 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2023-10-08T11:57:07.330 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-10-08T11:57:07.352 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-jaraco.text. 2023-10-08T11:57:07.366 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2023-10-08T11:57:07.403 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-10-08T11:57:07.639 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-10-08T11:57:07.652 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-10-08T11:57:07.666 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-singledispatch. 2023-10-08T11:57:07.687 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-10-08T11:57:07.697 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-10-08T11:57:07.741 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-10-08T11:57:08.008 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-tempora. 2023-10-08T11:57:08.022 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2023-10-08T11:57:08.067 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-10-08T11:57:08.218 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph. 2023-10-08T11:57:08.230 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../061-ceph_18.0.0-6639-g7b3143ba-1jammy_amd64.deb ... 2023-10-08T11:57:08.268 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:08.269 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-webob. 2023-10-08T11:57:08.290 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-10-08T11:57:08.344 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-10-08T11:57:08.377 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-portend. 2023-10-08T11:57:08.392 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2023-10-08T11:57:08.436 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-10-08T11:57:08.705 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-10-08T11:57:08.714 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-waitress. 2023-10-08T11:57:08.720 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2023-10-08T11:57:08.734 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-10-08T11:57:08.755 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-10-08T11:57:08.766 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-10-08T11:57:08.770 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-fuse. 2023-10-08T11:57:08.792 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../062-ceph-fuse_18.0.0-6639-g7b3143ba-1jammy_amd64.deb ... 2023-10-08T11:57:08.820 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-fuse (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:09.052 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-cherrypy3. 2023-10-08T11:57:09.066 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2023-10-08T11:57:09.091 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-tempita. 2023-10-08T11:57:09.110 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-10-08T11:57:09.113 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-10-08T11:57:09.141 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-10-08T11:57:09.224 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-mds. 2023-10-08T11:57:09.245 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../063-ceph-mds_18.0.0-6639-g7b3143ba-1jammy_amd64.deb ... 2023-10-08T11:57:09.281 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-mds (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:09.405 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-natsort. 2023-10-08T11:57:09.419 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2023-10-08T11:57:09.463 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-10-08T11:57:09.486 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-paste. 2023-10-08T11:57:09.507 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-10-08T11:57:09.569 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-10-08T11:57:09.677 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package cephadm. 2023-10-08T11:57:09.698 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../064-cephadm_18.0.0-6639-g7b3143ba-1jammy_amd64.deb ... 2023-10-08T11:57:09.735 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking cephadm (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:09.808 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-logutils. 2023-10-08T11:57:09.823 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2023-10-08T11:57:09.867 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-10-08T11:57:09.922 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-10-08T11:57:09.935 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-10-08T11:57:09.972 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-10-08T11:57:10.054 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-asyncssh. 2023-10-08T11:57:10.076 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2023-10-08T11:57:10.112 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-10-08T11:57:10.153 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-markupsafe. 2023-10-08T11:57:10.167 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-10-08T11:57:10.211 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-10-08T11:57:10.308 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pastedeploy. 2023-10-08T11:57:10.329 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2023-10-08T11:57:10.392 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-10-08T11:57:10.448 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python-babel-localedata. 2023-10-08T11:57:10.461 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-10-08T11:57:10.472 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-mako. 2023-10-08T11:57:10.486 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-10-08T11:57:10.498 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-10-08T11:57:10.522 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-10-08T11:57:10.769 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-webtest. 2023-10-08T11:57:10.790 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2023-10-08T11:57:10.827 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-10-08T11:57:10.834 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-simplegeneric. 2023-10-08T11:57:10.849 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2023-10-08T11:57:10.892 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-10-08T11:57:11.130 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pecan. 2023-10-08T11:57:11.151 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-10-08T11:57:11.180 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-10-08T11:57:11.195 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-singledispatch. 2023-10-08T11:57:11.209 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-10-08T11:57:11.253 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-10-08T11:57:11.496 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-babel. 2023-10-08T11:57:11.517 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-10-08T11:57:11.534 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-certifi. 2023-10-08T11:57:11.545 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-10-08T11:57:11.552 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2023-10-08T11:57:11.556 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-webob. 2023-10-08T11:57:11.571 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-10-08T11:57:11.609 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-10-08T11:57:11.614 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-10-08T11:57:11.848 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-jinja2. 2023-10-08T11:57:11.869 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2023-10-08T11:57:11.906 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-10-08T11:57:11.959 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-waitress. 2023-10-08T11:57:11.973 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-10-08T11:57:11.979 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-idna. 2023-10-08T11:57:12.000 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2023-10-08T11:57:12.020 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-10-08T11:57:12.037 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-idna (3.3-1) ... 2023-10-08T11:57:12.260 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-10-08T11:57:12.281 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.0.0-6639-g7b3143ba-1jammy_all.deb ... 2023-10-08T11:57:12.310 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-mgr-cephadm (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:12.370 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-tempita. 2023-10-08T11:57:12.385 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-10-08T11:57:12.390 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-urllib3. 2023-10-08T11:57:12.411 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1_all.deb ... 2023-10-08T11:57:12.428 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-10-08T11:57:12.469 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1) ... 2023-10-08T11:57:12.672 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-bcrypt. 2023-10-08T11:57:12.692 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-10-08T11:57:12.730 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-10-08T11:57:12.731 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-paste. 2023-10-08T11:57:12.746 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-10-08T11:57:12.789 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-10-08T11:57:12.810 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-requests. 2023-10-08T11:57:12.831 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-10-08T11:57:12.868 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-10-08T11:57:13.007 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-repoze.lru. 2023-10-08T11:57:13.028 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../071-python3-repoze.lru_0.7-2_all.deb ... 2023-10-08T11:57:13.066 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-10-08T11:57:13.110 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-10-08T11:57:13.124 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-10-08T11:57:13.167 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-10-08T11:57:13.221 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-werkzeug. 2023-10-08T11:57:13.242 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-10-08T11:57:13.419 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-routes. 2023-10-08T11:57:13.437 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-10-08T11:57:13.440 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../072-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-10-08T11:57:13.477 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-10-08T11:57:13.495 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-pastedeploy. 2023-10-08T11:57:13.510 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2023-10-08T11:57:13.554 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-10-08T11:57:13.765 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-10-08T11:57:13.786 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.0.0-6639-g7b3143ba-1jammy_all.deb ... 2023-10-08T11:57:13.824 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mgr-modules-core (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:13.824 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-webtest. 2023-10-08T11:57:13.830 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-10-08T11:57:13.838 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2023-10-08T11:57:13.851 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../073-ceph-mgr-dashboard_18.0.0-6639-g7b3143ba-1jammy_all.deb ... 2023-10-08T11:57:13.873 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-10-08T11:57:13.888 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-mgr-dashboard (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:14.185 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-pecan. 2023-10-08T11:57:14.199 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-10-08T11:57:14.228 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-10-08T11:57:14.243 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-10-08T11:57:14.249 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.0.0-6639-g7b3143ba-1jammy_amd64.deb ... 2023-10-08T11:57:14.286 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:14.292 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-10-08T11:57:14.304 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-10-08T11:57:14.334 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-10-08T11:57:14.598 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-certifi. 2023-10-08T11:57:14.613 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2023-10-08T11:57:14.664 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-openssl. 2023-10-08T11:57:14.672 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-10-08T11:57:14.685 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2023-10-08T11:57:14.722 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-10-08T11:57:14.837 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-joblib. 2023-10-08T11:57:14.858 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../075-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-10-08T11:57:14.895 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-10-08T11:57:15.092 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mgr. 2023-10-08T11:57:15.113 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../058-ceph-mgr_18.0.0-6639-g7b3143ba-1jammy_amd64.deb ... 2023-10-08T11:57:15.150 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mgr (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:15.217 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-idna. 2023-10-08T11:57:15.232 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2023-10-08T11:57:15.266 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-10-08T11:57:15.275 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-idna (3.3-1) ... 2023-10-08T11:57:15.287 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../076-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-10-08T11:57:15.324 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-10-08T11:57:15.562 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-urllib3. 2023-10-08T11:57:15.570 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mon. 2023-10-08T11:57:15.576 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1_all.deb ... 2023-10-08T11:57:15.591 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../059-ceph-mon_18.0.0-6639-g7b3143ba-1jammy_amd64.deb ... 2023-10-08T11:57:15.610 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-sklearn. 2023-10-08T11:57:15.611 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1) ... 2023-10-08T11:57:15.620 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mon (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:15.631 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../077-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-10-08T11:57:15.668 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-10-08T11:57:15.948 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-requests. 2023-10-08T11:57:15.963 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-10-08T11:57:15.998 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-10-08T11:57:16.268 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-werkzeug. 2023-10-08T11:57:16.282 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-10-08T11:57:16.326 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-10-08T11:57:16.419 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-10-08T11:57:16.441 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../078-ceph-mgr-diskprediction-local_18.0.0-6639-g7b3143ba-1jammy_all.deb ... 2023-10-08T11:57:16.485 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:16.573 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-osd. 2023-10-08T11:57:16.595 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../060-ceph-osd_18.0.0-6639-g7b3143ba-1jammy_amd64.deb ... 2023-10-08T11:57:16.612 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-10-08T11:57:16.623 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-osd (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:16.627 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.0.0-6639-g7b3143ba-1jammy_all.deb ... 2023-10-08T11:57:16.662 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking ceph-mgr-modules-core (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:17.042 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-10-08T11:57:17.056 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.0.0-6639-g7b3143ba-1jammy_amd64.deb ... 2023-10-08T11:57:17.100 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:17.436 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-openssl. 2023-10-08T11:57:17.451 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2023-10-08T11:57:17.463 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-cachetools. 2023-10-08T11:57:17.484 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../079-python3-cachetools_5.0.0-1_all.deb ... 2023-10-08T11:57:17.486 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-10-08T11:57:17.513 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-10-08T11:57:17.781 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package ceph-mgr. 2023-10-08T11:57:17.796 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../058-ceph-mgr_18.0.0-6639-g7b3143ba-1jammy_amd64.deb ... 2023-10-08T11:57:17.807 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-pyasn1. 2023-10-08T11:57:17.829 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../080-python3-pyasn1_0.4.8-1_all.deb ... 2023-10-08T11:57:17.839 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking ceph-mgr (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:17.866 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-10-08T11:57:18.192 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package ceph-mon. 2023-10-08T11:57:18.207 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../059-ceph-mon_18.0.0-6639-g7b3143ba-1jammy_amd64.deb ... 2023-10-08T11:57:18.211 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-10-08T11:57:18.232 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../081-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-10-08T11:57:18.242 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking ceph-mon (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:18.269 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-10-08T11:57:18.580 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-rsa. 2023-10-08T11:57:18.601 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph. 2023-10-08T11:57:18.602 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../082-python3-rsa_4.8-1_all.deb ... 2023-10-08T11:57:18.622 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../061-ceph_18.0.0-6639-g7b3143ba-1jammy_amd64.deb ... 2023-10-08T11:57:18.638 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-rsa (4.8-1) ... 2023-10-08T11:57:18.684 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:19.037 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-fuse. 2023-10-08T11:57:19.058 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../062-ceph-fuse_18.0.0-6639-g7b3143ba-1jammy_amd64.deb ... 2023-10-08T11:57:19.071 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package ceph-osd. 2023-10-08T11:57:19.086 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../060-ceph-osd_18.0.0-6639-g7b3143ba-1jammy_amd64.deb ... 2023-10-08T11:57:19.095 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-fuse (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:19.129 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking ceph-osd (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:19.219 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-google-auth. 2023-10-08T11:57:19.240 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../083-python3-google-auth_1.5.1-3_all.deb ... 2023-10-08T11:57:19.277 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-10-08T11:57:19.482 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mds. 2023-10-08T11:57:19.494 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../063-ceph-mds_18.0.0-6639-g7b3143ba-1jammy_amd64.deb ... 2023-10-08T11:57:19.556 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mds (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:19.597 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-10-08T11:57:19.618 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../084-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-10-08T11:57:19.655 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-10-08T11:57:19.967 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-websocket. 2023-10-08T11:57:19.988 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../085-python3-websocket_1.2.3-1_all.deb ... 2023-10-08T11:57:19.993 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package cephadm. 2023-10-08T11:57:20.014 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../064-cephadm_18.0.0-6639-g7b3143ba-1jammy_amd64.deb ... 2023-10-08T11:57:20.024 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-10-08T11:57:20.051 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking cephadm (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:20.345 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-kubernetes. 2023-10-08T11:57:20.366 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../086-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-10-08T11:57:20.391 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package ceph. 2023-10-08T11:57:20.402 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-10-08T11:57:20.404 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-asyncssh. 2023-10-08T11:57:20.406 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../061-ceph_18.0.0-6639-g7b3143ba-1jammy_amd64.deb ... 2023-10-08T11:57:20.425 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2023-10-08T11:57:20.449 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking ceph (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:20.479 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-10-08T11:57:20.727 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package ceph-fuse. 2023-10-08T11:57:20.742 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../062-ceph-fuse_18.0.0-6639-g7b3143ba-1jammy_amd64.deb ... 2023-10-08T11:57:20.777 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking ceph-fuse (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:20.857 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python-babel-localedata. 2023-10-08T11:57:20.870 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-10-08T11:57:20.906 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-10-08T11:57:21.125 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-10-08T11:57:21.138 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../087-ceph-mgr-k8sevents_18.0.0-6639-g7b3143ba-1jammy_all.deb ... 2023-10-08T11:57:21.147 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package ceph-mds. 2023-10-08T11:57:21.161 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../063-ceph-mds_18.0.0-6639-g7b3143ba-1jammy_amd64.deb ... 2023-10-08T11:57:21.174 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:21.205 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking ceph-mds (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:21.470 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libonig5:amd64. 2023-10-08T11:57:21.491 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../088-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-10-08T11:57:21.536 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-10-08T11:57:21.583 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package cephadm. 2023-10-08T11:57:21.597 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../064-cephadm_18.0.0-6639-g7b3143ba-1jammy_amd64.deb ... 2023-10-08T11:57:21.641 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking cephadm (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:21.881 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libjq1:amd64. 2023-10-08T11:57:21.902 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../089-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-10-08T11:57:21.940 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-10-08T11:57:21.962 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-asyncssh. 2023-10-08T11:57:21.976 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2023-10-08T11:57:22.011 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-10-08T11:57:22.070 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-babel. 2023-10-08T11:57:22.092 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-10-08T11:57:22.137 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-10-08T11:57:22.225 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package jq. 2023-10-08T11:57:22.237 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../090-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-10-08T11:57:22.275 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-10-08T11:57:22.290 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python-babel-localedata. 2023-10-08T11:57:22.304 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-10-08T11:57:22.339 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-10-08T11:57:22.520 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-jinja2. 2023-10-08T11:57:22.541 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2023-10-08T11:57:22.544 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package socat. 2023-10-08T11:57:22.566 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../091-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-10-08T11:57:22.589 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-10-08T11:57:22.602 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-10-08T11:57:22.905 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package xmlstarlet. 2023-10-08T11:57:22.918 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../092-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-10-08T11:57:22.947 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-10-08T11:57:22.993 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-10-08T11:57:23.014 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.0.0-6639-g7b3143ba-1jammy_all.deb ... 2023-10-08T11:57:23.051 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mgr-cephadm (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:23.294 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-babel. 2023-10-08T11:57:23.307 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-10-08T11:57:23.335 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-test. 2023-10-08T11:57:23.352 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-10-08T11:57:23.356 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../093-ceph-test_18.0.0-6639-g7b3143ba-1jammy_amd64.deb ... 2023-10-08T11:57:23.401 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-test (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:23.438 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-bcrypt. 2023-10-08T11:57:23.459 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-10-08T11:57:23.674 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-10-08T11:57:23.689 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-jinja2. 2023-10-08T11:57:23.702 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2023-10-08T11:57:23.730 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-10-08T11:57:24.050 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-10-08T11:57:24.063 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.0.0-6639-g7b3143ba-1jammy_all.deb ... 2023-10-08T11:57:24.085 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-repoze.lru. 2023-10-08T11:57:24.091 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking ceph-mgr-cephadm (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:24.106 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../071-python3-repoze.lru_0.7-2_all.deb ... 2023-10-08T11:57:24.157 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-10-08T11:57:24.387 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-bcrypt. 2023-10-08T11:57:24.400 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-10-08T11:57:24.437 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-10-08T11:57:24.468 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-routes. 2023-10-08T11:57:24.489 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../072-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-10-08T11:57:24.518 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-10-08T11:57:24.740 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-repoze.lru. 2023-10-08T11:57:24.753 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../071-python3-repoze.lru_0.7-2_all.deb ... 2023-10-08T11:57:24.798 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-10-08T11:57:24.880 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-10-08T11:57:24.901 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../073-ceph-mgr-dashboard_18.0.0-6639-g7b3143ba-1jammy_all.deb ... 2023-10-08T11:57:24.953 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mgr-dashboard (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:25.135 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-routes. 2023-10-08T11:57:25.148 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../072-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-10-08T11:57:25.196 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-10-08T11:57:25.433 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-10-08T11:57:25.446 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-10-08T11:57:25.491 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-10-08T11:57:25.688 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-10-08T11:57:25.697 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-volume. 2023-10-08T11:57:25.702 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../073-ceph-mgr-dashboard_18.0.0-6639-g7b3143ba-1jammy_all.deb ... 2023-10-08T11:57:25.718 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../094-ceph-volume_18.0.0-6639-g7b3143ba-1jammy_all.deb ... 2023-10-08T11:57:25.746 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking ceph-mgr-dashboard (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:25.763 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-volume (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:26.178 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-joblib. 2023-10-08T11:57:26.199 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../075-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-10-08T11:57:26.274 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-10-08T11:57:26.278 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-10-08T11:57:26.288 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-10-08T11:57:26.325 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-10-08T11:57:26.343 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package cephfs-mirror. 2023-10-08T11:57:26.364 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../095-cephfs-mirror_18.0.0-6639-g7b3143ba-1jammy_amd64.deb ... 2023-10-08T11:57:26.409 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking cephfs-mirror (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:26.673 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-10-08T11:57:26.694 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../076-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-10-08T11:57:26.729 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-colorama. 2023-10-08T11:57:26.739 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-10-08T11:57:26.751 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../096-python3-colorama_0.4.4-1_all.deb ... 2023-10-08T11:57:26.796 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-10-08T11:57:26.803 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-joblib. 2023-10-08T11:57:26.817 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../075-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-10-08T11:57:26.862 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-10-08T11:57:27.031 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package cephfs-shell. 2023-10-08T11:57:27.049 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../097-cephfs-shell_18.0.0-6639-g7b3143ba-1jammy_all.deb ... 2023-10-08T11:57:27.082 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking cephfs-shell (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:27.084 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-sklearn. 2023-10-08T11:57:27.105 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../077-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-10-08T11:57:27.175 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-10-08T11:57:27.232 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-10-08T11:57:27.245 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../076-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-10-08T11:57:27.290 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-10-08T11:57:27.334 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package cephfs-top. 2023-10-08T11:57:27.346 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../098-cephfs-top_18.0.0-6639-g7b3143ba-1jammy_all.deb ... 2023-10-08T11:57:27.393 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking cephfs-top (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:27.593 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-sklearn. 2023-10-08T11:57:27.607 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../077-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-10-08T11:57:27.645 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libcephfs-dev. 2023-10-08T11:57:27.651 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-10-08T11:57:27.667 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../099-libcephfs-dev_18.0.0-6639-g7b3143ba-1jammy_amd64.deb ... 2023-10-08T11:57:27.712 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libcephfs-dev (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:27.909 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-10-08T11:57:27.931 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../078-ceph-mgr-diskprediction-local_18.0.0-6639-g7b3143ba-1jammy_all.deb ... 2023-10-08T11:57:27.967 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:28.098 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package nvme-cli. 2023-10-08T11:57:28.120 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../100-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-10-08T11:57:28.165 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-10-08T11:57:28.335 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-10-08T11:57:28.349 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../078-ceph-mgr-diskprediction-local_18.0.0-6639-g7b3143ba-1jammy_all.deb ... 2023-10-08T11:57:28.393 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:28.486 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-10-08T11:57:28.499 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../101-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-10-08T11:57:28.536 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-10-08T11:57:28.973 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-iniconfig. 2023-10-08T11:57:28.994 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../102-python3-iniconfig_1.1.1-2_all.deb ... 2023-10-08T11:57:29.039 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-10-08T11:57:29.043 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-cachetools. 2023-10-08T11:57:29.065 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../079-python3-cachetools_5.0.0-1_all.deb ... 2023-10-08T11:57:29.111 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-10-08T11:57:29.300 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-pastescript. 2023-10-08T11:57:29.312 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../103-python3-pastescript_2.0.2-4_all.deb ... 2023-10-08T11:57:29.341 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-10-08T11:57:29.346 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-cachetools. 2023-10-08T11:57:29.361 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../079-python3-cachetools_5.0.0-1_all.deb ... 2023-10-08T11:57:29.404 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-10-08T11:57:29.448 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pyasn1. 2023-10-08T11:57:29.469 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../080-python3-pyasn1_0.4.8-1_all.deb ... 2023-10-08T11:57:29.514 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-10-08T11:57:29.645 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-pluggy. 2023-10-08T11:57:29.667 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../104-python3-pluggy_0.13.0-7.1_all.deb ... 2023-10-08T11:57:29.711 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-10-08T11:57:29.716 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-pyasn1. 2023-10-08T11:57:29.731 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../080-python3-pyasn1_0.4.8-1_all.deb ... 2023-10-08T11:57:29.774 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-10-08T11:57:29.884 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-10-08T11:57:29.906 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../081-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-10-08T11:57:29.984 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-10-08T11:57:30.023 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-psutil. 2023-10-08T11:57:30.044 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../105-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-10-08T11:57:30.089 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-10-08T11:57:30.119 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-10-08T11:57:30.134 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../081-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-10-08T11:57:30.177 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-10-08T11:57:30.303 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-rsa. 2023-10-08T11:57:30.325 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../082-python3-rsa_4.8-1_all.deb ... 2023-10-08T11:57:30.370 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-rsa (4.8-1) ... 2023-10-08T11:57:30.434 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-py. 2023-10-08T11:57:30.455 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../106-python3-py_1.10.0-1_all.deb ... 2023-10-08T11:57:30.496 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-rsa. 2023-10-08T11:57:30.500 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-py (1.10.0-1) ... 2023-10-08T11:57:30.511 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../082-python3-rsa_4.8-1_all.deb ... 2023-10-08T11:57:30.555 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-rsa (4.8-1) ... 2023-10-08T11:57:30.758 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-google-auth. 2023-10-08T11:57:30.771 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../083-python3-google-auth_1.5.1-3_all.deb ... 2023-10-08T11:57:30.841 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-10-08T11:57:30.846 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-pygments. 2023-10-08T11:57:30.867 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../107-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-10-08T11:57:30.912 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-10-08T11:57:30.918 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-google-auth. 2023-10-08T11:57:30.934 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../083-python3-google-auth_1.5.1-3_all.deb ... 2023-10-08T11:57:30.977 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-10-08T11:57:31.203 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-10-08T11:57:31.225 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../084-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-10-08T11:57:31.278 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-10-08T11:57:31.296 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-10-08T11:57:31.311 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../084-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-10-08T11:57:31.355 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-10-08T11:57:31.366 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-pyinotify. 2023-10-08T11:57:31.388 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../108-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-10-08T11:57:31.424 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-10-08T11:57:31.623 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-websocket. 2023-10-08T11:57:31.644 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../085-python3-websocket_1.2.3-1_all.deb ... 2023-10-08T11:57:31.700 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-websocket. 2023-10-08T11:57:31.714 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../085-python3-websocket_1.2.3-1_all.deb ... 2023-10-08T11:57:31.722 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-10-08T11:57:31.753 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-toml. 2023-10-08T11:57:31.757 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-10-08T11:57:31.774 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../109-python3-toml_0.10.2-1_all.deb ... 2023-10-08T11:57:31.819 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-10-08T11:57:32.084 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-kubernetes. 2023-10-08T11:57:32.086 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-kubernetes. 2023-10-08T11:57:32.101 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../086-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-10-08T11:57:32.105 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-pytest. 2023-10-08T11:57:32.106 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../086-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-10-08T11:57:32.127 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../110-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-10-08T11:57:32.144 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-10-08T11:57:32.150 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-10-08T11:57:32.172 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-10-08T11:57:32.509 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-simplejson. 2023-10-08T11:57:32.531 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-10-08T11:57:32.575 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-10-08T11:57:32.853 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-10-08T11:57:32.865 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-10-08T11:57:32.875 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-10-08T11:57:32.889 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../087-ceph-mgr-k8sevents_18.0.0-6639-g7b3143ba-1jammy_all.deb ... 2023-10-08T11:57:32.903 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-10-08T11:57:32.906 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-10-08T11:57:32.919 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../087-ceph-mgr-k8sevents_18.0.0-6639-g7b3143ba-1jammy_all.deb ... 2023-10-08T11:57:32.924 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:32.980 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:33.253 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libonig5:amd64. 2023-10-08T11:57:33.267 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../088-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-10-08T11:57:33.311 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-10-08T11:57:33.342 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libonig5:amd64. 2023-10-08T11:57:33.363 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../088-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-10-08T11:57:33.408 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-10-08T11:57:33.630 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libjq1:amd64. 2023-10-08T11:57:33.646 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../089-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-10-08T11:57:33.674 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package radosgw. 2023-10-08T11:57:33.689 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-10-08T11:57:33.695 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../113-radosgw_18.0.0-6639-g7b3143ba-1jammy_amd64.deb ... 2023-10-08T11:57:33.719 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libjq1:amd64. 2023-10-08T11:57:33.732 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../089-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-10-08T11:57:33.740 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking radosgw (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:33.761 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-10-08T11:57:33.925 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package jq. 2023-10-08T11:57:33.940 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../090-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-10-08T11:57:33.975 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-10-08T11:57:34.072 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package jq. 2023-10-08T11:57:34.085 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../090-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-10-08T11:57:34.122 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-10-08T11:57:34.211 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package socat. 2023-10-08T11:57:34.226 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../091-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-10-08T11:57:34.269 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-10-08T11:57:34.408 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package socat. 2023-10-08T11:57:34.430 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../091-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-10-08T11:57:34.499 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-10-08T11:57:34.572 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package xmlstarlet. 2023-10-08T11:57:34.587 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../092-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-10-08T11:57:34.630 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-10-08T11:57:34.769 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package xmlstarlet. 2023-10-08T11:57:34.782 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../092-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-10-08T11:57:34.810 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package rbd-fuse. 2023-10-08T11:57:34.832 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../114-rbd-fuse_18.0.0-6639-g7b3143ba-1jammy_amd64.deb ... 2023-10-08T11:57:34.844 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-10-08T11:57:34.876 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking rbd-fuse (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:34.935 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package ceph-test. 2023-10-08T11:57:34.948 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../093-ceph-test_18.0.0-6639-g7b3143ba-1jammy_amd64.deb ... 2023-10-08T11:57:34.993 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking ceph-test (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:35.220 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-10-08T11:57:35.240 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-test. 2023-10-08T11:57:35.253 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../093-ceph-test_18.0.0-6639-g7b3143ba-1jammy_amd64.deb ... 2023-10-08T11:57:35.298 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-test (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:35.473 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-10-08T11:57:35.599 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-10-08T11:57:35.870 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-10-08T11:57:36.220 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-10-08T11:57:36.691 INFO:teuthology.orchestra.run.smithi130.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-10-08T11:57:36.793 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up cephadm (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:36.980 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package ceph-volume. 2023-10-08T11:57:36.996 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../094-ceph-volume_18.0.0-6639-g7b3143ba-1jammy_all.deb ... 2023-10-08T11:57:37.038 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking ceph-volume (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:37.310 INFO:teuthology.orchestra.run.smithi130.stdout:Adding system user cephadm....done 2023-10-08T11:57:37.393 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package cephfs-mirror. 2023-10-08T11:57:37.408 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../095-cephfs-mirror_18.0.0-6639-g7b3143ba-1jammy_amd64.deb ... 2023-10-08T11:57:37.451 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking cephfs-mirror (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:37.465 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-10-08T11:57:37.676 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-volume. 2023-10-08T11:57:37.698 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../094-ceph-volume_18.0.0-6639-g7b3143ba-1jammy_all.deb ... 2023-10-08T11:57:37.725 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-10-08T11:57:37.734 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-volume (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:37.763 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-colorama. 2023-10-08T11:57:37.779 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../096-python3-colorama_0.4.4-1_all.deb ... 2023-10-08T11:57:37.821 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-10-08T11:57:37.976 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-10-08T11:57:38.082 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package cephfs-shell. 2023-10-08T11:57:38.097 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../097-cephfs-shell_18.0.0-6639-g7b3143ba-1jammy_all.deb ... 2023-10-08T11:57:38.102 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-10-08T11:57:38.140 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking cephfs-shell (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:38.172 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package cephfs-mirror. 2023-10-08T11:57:38.194 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../095-cephfs-mirror_18.0.0-6639-g7b3143ba-1jammy_amd64.deb ... 2023-10-08T11:57:38.239 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking cephfs-mirror (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:38.353 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-10-08T11:57:38.418 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package cephfs-top. 2023-10-08T11:57:38.433 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../098-cephfs-top_18.0.0-6639-g7b3143ba-1jammy_all.deb ... 2023-10-08T11:57:38.476 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking cephfs-top (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:38.592 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-colorama. 2023-10-08T11:57:38.613 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-10-08T11:57:38.614 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../096-python3-colorama_0.4.4-1_all.deb ... 2023-10-08T11:57:38.658 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-10-08T11:57:38.722 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-py (1.10.0-1) ... 2023-10-08T11:57:38.729 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libcephfs-dev. 2023-10-08T11:57:38.744 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../099-libcephfs-dev_18.0.0-6639-g7b3143ba-1jammy_amd64.deb ... 2023-10-08T11:57:38.787 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libcephfs-dev (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:38.953 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package cephfs-shell. 2023-10-08T11:57:38.974 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../097-cephfs-shell_18.0.0-6639-g7b3143ba-1jammy_all.deb ... 2023-10-08T11:57:39.007 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-10-08T11:57:39.019 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking cephfs-shell (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:39.157 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package nvme-cli. 2023-10-08T11:57:39.172 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../100-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-10-08T11:57:39.207 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-10-08T11:57:39.350 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-10-08T11:57:39.574 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package cephfs-top. 2023-10-08T11:57:39.579 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-10-08T11:57:39.586 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../098-cephfs-top_18.0.0-6639-g7b3143ba-1jammy_all.deb ... 2023-10-08T11:57:39.594 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../101-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-10-08T11:57:39.624 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking cephfs-top (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:39.628 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-10-08T11:57:39.635 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-10-08T11:57:39.886 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-10-08T11:57:39.910 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libcephfs-dev. 2023-10-08T11:57:39.923 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../099-libcephfs-dev_18.0.0-6639-g7b3143ba-1jammy_amd64.deb ... 2023-10-08T11:57:39.959 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libcephfs-dev (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:40.048 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-iniconfig. 2023-10-08T11:57:40.063 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../102-python3-iniconfig_1.1.1-2_all.deb ... 2023-10-08T11:57:40.106 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-10-08T11:57:40.163 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-10-08T11:57:40.384 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-pastescript. 2023-10-08T11:57:40.396 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package nvme-cli. 2023-10-08T11:57:40.399 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../103-python3-pastescript_2.0.2-4_all.deb ... 2023-10-08T11:57:40.414 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-10-08T11:57:40.418 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../100-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-10-08T11:57:40.434 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-10-08T11:57:40.462 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-10-08T11:57:40.673 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-10-08T11:57:40.779 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-pluggy. 2023-10-08T11:57:40.794 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../104-python3-pluggy_0.13.0-7.1_all.deb ... 2023-10-08T11:57:40.837 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-10-08T11:57:40.842 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-10-08T11:57:40.864 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../101-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-10-08T11:57:40.934 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-10-08T11:57:40.968 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-ceph-argparse (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:41.149 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-psutil. 2023-10-08T11:57:41.164 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../105-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-10-08T11:57:41.207 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-10-08T11:57:41.309 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-10-08T11:57:41.395 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-iniconfig. 2023-10-08T11:57:41.417 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../102-python3-iniconfig_1.1.1-2_all.deb ... 2023-10-08T11:57:41.443 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-10-08T11:57:41.519 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-10-08T11:57:41.535 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-py. 2023-10-08T11:57:41.550 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../106-python3-py_1.10.0-1_all.deb ... 2023-10-08T11:57:41.593 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-py (1.10.0-1) ... 2023-10-08T11:57:41.703 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-10-08T11:57:41.858 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pastescript. 2023-10-08T11:57:41.878 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../103-python3-pastescript_2.0.2-4_all.deb ... 2023-10-08T11:57:41.922 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-10-08T11:57:41.938 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-pygments. 2023-10-08T11:57:41.953 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../107-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-10-08T11:57:41.954 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-10-08T11:57:41.999 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-10-08T11:57:42.080 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-10-08T11:57:42.276 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pluggy. 2023-10-08T11:57:42.298 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../104-python3-pluggy_0.13.0-7.1_all.deb ... 2023-10-08T11:57:42.367 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-10-08T11:57:42.422 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-10-08T11:57:42.425 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-pyinotify. 2023-10-08T11:57:42.439 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../108-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-10-08T11:57:42.483 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-10-08T11:57:42.532 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-10-08T11:57:42.662 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-psutil. 2023-10-08T11:57:42.684 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../105-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-10-08T11:57:42.728 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-10-08T11:57:42.770 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-toml. 2023-10-08T11:57:42.784 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../109-python3-toml_0.10.2-1_all.deb ... 2023-10-08T11:57:42.800 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-10-08T11:57:42.828 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-10-08T11:57:43.059 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-10-08T11:57:43.098 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-py. 2023-10-08T11:57:43.120 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../106-python3-py_1.10.0-1_all.deb ... 2023-10-08T11:57:43.156 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-pytest. 2023-10-08T11:57:43.156 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-py (1.10.0-1) ... 2023-10-08T11:57:43.171 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../110-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-10-08T11:57:43.214 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-10-08T11:57:43.361 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-10-08T11:57:43.484 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-simplejson. 2023-10-08T11:57:43.499 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-10-08T11:57:43.518 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pygments. 2023-10-08T11:57:43.534 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-10-08T11:57:43.540 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../107-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-10-08T11:57:43.617 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-10-08T11:57:43.770 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-10-08T11:57:43.785 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-10-08T11:57:43.828 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-10-08T11:57:44.021 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-10-08T11:57:44.147 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pyinotify. 2023-10-08T11:57:44.169 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../108-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-10-08T11:57:44.221 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-10-08T11:57:44.272 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-10-08T11:57:44.406 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-10-08T11:57:44.516 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-10-08T11:57:44.557 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package radosgw. 2023-10-08T11:57:44.570 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../113-radosgw_18.0.0-6639-g7b3143ba-1jammy_amd64.deb ... 2023-10-08T11:57:44.615 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking radosgw (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:44.775 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-toml. 2023-10-08T11:57:44.784 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-10-08T11:57:44.797 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../109-python3-toml_0.10.2-1_all.deb ... 2023-10-08T11:57:44.841 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-10-08T11:57:45.152 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pytest. 2023-10-08T11:57:45.174 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../110-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-10-08T11:57:45.178 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-10-08T11:57:45.201 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package rbd-fuse. 2023-10-08T11:57:45.216 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../114-rbd-fuse_18.0.0-6639-g7b3143ba-1jammy_amd64.deb ... 2023-10-08T11:57:45.218 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-10-08T11:57:45.259 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking rbd-fuse (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:45.430 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-10-08T11:57:45.530 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-10-08T11:57:45.597 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-simplejson. 2023-10-08T11:57:45.619 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-10-08T11:57:45.672 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-10-08T11:57:45.798 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-10-08T11:57:45.900 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-10-08T11:57:45.946 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-10-08T11:57:45.968 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-10-08T11:57:46.008 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-10-08T11:57:46.026 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-10-08T11:57:46.074 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-10-08T11:57:46.283 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-10-08T11:57:46.361 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-10-08T11:57:46.664 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-10-08T11:57:46.736 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-10-08T11:57:46.829 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package radosgw. 2023-10-08T11:57:46.851 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../113-radosgw_18.0.0-6639-g7b3143ba-1jammy_amd64.deb ... 2023-10-08T11:57:46.895 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking radosgw (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:46.987 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-10-08T11:57:47.105 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-ceph-common (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:47.254 INFO:teuthology.orchestra.run.smithi156.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-10-08T11:57:47.297 INFO:teuthology.orchestra.run.smithi156.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2023-10-08T11:57:47.345 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up cephadm (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:47.381 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-idna (3.3-1) ... 2023-10-08T11:57:47.682 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-10-08T11:57:47.723 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package rbd-fuse. 2023-10-08T11:57:47.746 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../114-rbd-fuse_18.0.0-6639-g7b3143ba-1jammy_amd64.deb ... 2023-10-08T11:57:47.790 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking rbd-fuse (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:47.900 INFO:teuthology.orchestra.run.smithi156.stdout:Adding system user cephadm....done 2023-10-08T11:57:48.060 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-10-08T11:57:48.125 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-10-08T11:57:48.344 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-10-08T11:57:48.427 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-10-08T11:57:48.579 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-10-08T11:57:48.603 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-10-08T11:57:48.729 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-10-08T11:57:48.838 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-08T11:57:48.859 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-10-08T11:57:48.973 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-toml (0.10.2-1) ... 2023-10-08T11:57:48.997 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-10-08T11:57:49.208 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-10-08T11:57:49.216 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-10-08T11:57:49.265 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-10-08T11:57:49.317 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-10-08T11:57:49.391 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-py (1.10.0-1) ... 2023-10-08T11:57:49.443 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-urllib3 (1.26.5-1~exp1) ... 2023-10-08T11:57:49.692 INFO:teuthology.orchestra.run.smithi062.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-10-08T11:57:49.709 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-10-08T11:57:49.753 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-10-08T11:57:49.831 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up cephadm (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:50.070 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-10-08T11:57:50.171 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-10-08T11:57:50.346 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-10-08T11:57:50.405 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-08T11:57:50.457 INFO:teuthology.orchestra.run.smithi062.stdout:Adding system user cephadm....done 2023-10-08T11:57:50.523 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2023-10-08T11:57:50.624 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-10-08T11:57:50.697 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-10-08T11:57:50.909 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-10-08T11:57:50.996 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-10-08T11:57:51.007 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-10-08T11:57:51.168 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-10-08T11:57:51.266 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-10-08T11:57:51.323 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-10-08T11:57:51.458 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-10-08T11:57:51.542 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-10-08T11:57:51.599 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-10-08T11:57:51.713 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-10-08T11:57:51.725 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-10-08T11:57:51.810 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-ceph-argparse (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:51.964 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-10-08T11:57:51.984 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-10-08T11:57:52.119 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-10-08T11:57:52.232 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-10-08T11:57:52.244 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-10-08T11:57:52.271 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-10-08T11:57:52.333 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-10-08T11:57:52.345 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-py (1.10.0-1) ... 2023-10-08T11:57:52.538 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-10-08T11:57:52.601 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-10-08T11:57:52.655 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-10-08T11:57:52.727 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-10-08T11:57:52.797 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-10-08T11:57:52.923 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-10-08T11:57:53.020 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-10-08T11:57:53.081 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-10-08T11:57:53.291 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-10-08T11:57:53.338 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-10-08T11:57:53.366 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-10-08T11:57:53.434 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-10-08T11:57:53.589 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-10-08T11:57:53.625 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-10-08T11:57:53.693 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-10-08T11:57:53.910 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-10-08T11:57:53.969 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-10-08T11:57:54.010 INFO:teuthology.orchestra.run.smithi130.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-10-08T11:57:54.258 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-10-08T11:57:54.279 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-10-08T11:57:54.311 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-10-08T11:57:54.385 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-10-08T11:57:54.588 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-10-08T11:57:54.778 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-10-08T11:57:54.888 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-ceph-argparse (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:54.957 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-10-08T11:57:55.046 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-portend (3.0.0-1) ... 2023-10-08T11:57:55.198 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-10-08T11:57:55.224 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-10-08T11:57:55.297 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-08T11:57:55.324 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-10-08T11:57:55.350 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-10-08T11:57:55.423 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-10-08T11:57:55.476 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-10-08T11:57:55.592 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-10-08T11:57:55.741 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-10-08T11:57:55.785 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-10-08T11:57:55.868 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-10-08T11:57:55.977 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-10-08T11:57:56.034 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-10-08T11:57:56.178 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-10-08T11:57:56.302 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-10-08T11:57:56.395 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-10-08T11:57:56.421 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-10-08T11:57:56.437 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-rsa (4.8-1) ... 2023-10-08T11:57:56.521 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-10-08T11:57:56.705 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-10-08T11:57:56.797 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-10-08T11:57:56.814 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-10-08T11:57:56.964 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-10-08T11:57:57.073 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-10-08T11:57:57.116 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-10-08T11:57:57.216 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-10-08T11:57:57.383 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-10-08T11:57:57.442 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-10-08T11:57:57.592 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-10-08T11:57:57.793 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-10-08T11:57:57.876 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-10-08T11:57:58.052 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-10-08T11:57:58.060 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-10-08T11:57:58.154 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-ceph-common (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:58.212 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-10-08T11:57:58.336 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-10-08T11:57:58.349 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up librados2 (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:58.438 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-idna (3.3-1) ... 2023-10-08T11:57:58.456 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up librgw2 (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:58.495 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-10-08T11:57:58.621 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-10-08T11:57:58.670 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libsqlite3-mod-ceph (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:58.798 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-10-08T11:57:58.810 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libcephfs2 (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:58.937 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libradosstriper1 (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:58.939 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-10-08T11:57:59.063 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-10-08T11:57:59.339 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up librbd1 (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:59.357 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-10-08T11:57:59.441 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-mgr-modules-core (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:59.542 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-fuse (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:57:59.640 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-10-08T11:57:59.745 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-08T11:57:59.745 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-08T11:58:00.028 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-08T11:58:00.043 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-10-08T11:58:00.163 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-toml (0.10.2-1) ... 2023-10-08T11:58:00.285 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libcephfs-dev (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:00.328 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-10-08T11:58:00.420 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-rados (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:00.447 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-10-08T11:58:00.546 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up cephfs-top (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:00.573 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-10-08T11:58:00.654 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-10-08T11:58:00.672 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-10-08T11:58:00.699 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-urllib3 (1.26.5-1~exp1) ... 2023-10-08T11:58:01.000 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-10-08T11:58:01.072 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-10-08T11:58:01.373 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-10-08T11:58:01.510 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-10-08T11:58:01.533 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-ceph-common (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:01.769 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-08T11:58:01.850 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-idna (3.3-1) ... 2023-10-08T11:58:01.879 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2023-10-08T11:58:01.935 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-rbd (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:01.996 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-10-08T11:58:02.086 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up rbd-fuse (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:02.168 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-10-08T11:58:02.237 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-rgw (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:02.307 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-10-08T11:58:02.388 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-cephfs (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:02.514 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up cephfs-shell (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:02.582 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-10-08T11:58:02.640 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-common (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:02.851 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-10-08T11:58:03.110 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-10-08T11:58:03.258 INFO:teuthology.orchestra.run.smithi130.stdout:Adding group ceph....done 2023-10-08T11:58:03.369 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-10-08T11:58:03.399 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-08T11:58:03.558 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-toml (0.10.2-1) ... 2023-10-08T11:58:03.587 INFO:teuthology.orchestra.run.smithi130.stdout:Adding system user ceph....done 2023-10-08T11:58:03.654 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-10-08T11:58:03.762 INFO:teuthology.orchestra.run.smithi130.stdout:Setting system user ceph properties....done 2023-10-08T11:58:03.774 INFO:teuthology.orchestra.run.smithi130.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-10-08T11:58:03.780 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-10-08T11:58:03.843 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-10-08T11:58:03.911 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-10-08T11:58:03.943 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-10-08T11:58:04.064 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-10-08T11:58:04.103 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-urllib3 (1.26.5-1~exp1) ... 2023-10-08T11:58:04.190 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-10-08T11:58:04.284 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-10-08T11:58:04.421 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-10-08T11:58:04.483 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-10-08T11:58:04.697 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-10-08T11:58:04.792 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-10-08T11:58:04.867 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up cephfs-mirror (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:04.998 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-08T11:58:05.052 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-10-08T11:58:05.098 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-08T11:58:05.098 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-08T11:58:05.124 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2023-10-08T11:58:05.273 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-10-08T11:58:05.416 INFO:teuthology.orchestra.run.smithi156.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-10-08T11:58:05.635 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-10-08T11:58:05.669 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-test (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:05.680 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-10-08T11:58:05.795 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up radosgw (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:05.806 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-10-08T11:58:05.919 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-10-08T11:58:06.204 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-10-08T11:58:06.224 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-10-08T11:58:06.325 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-08T11:58:06.325 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-08T11:58:06.483 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-portend (3.0.0-1) ... 2023-10-08T11:58:06.486 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-10-08T11:58:06.734 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-08T11:58:06.814 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-10-08T11:58:06.860 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-10-08T11:58:06.915 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-base (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:07.124 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-10-08T11:58:07.195 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-10-08T11:58:07.250 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-10-08T11:58:07.481 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-10-08T11:58:07.496 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-10-08T11:58:07.534 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-10-08T11:58:07.643 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-10-08T11:58:07.772 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-10-08T11:58:07.898 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-rsa (4.8-1) ... 2023-10-08T11:58:07.961 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-10-08T11:58:08.075 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-mds (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:08.182 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-10-08T11:58:08.329 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-10-08T11:58:08.337 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-08T11:58:08.337 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-08T11:58:08.451 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-10-08T11:58:08.622 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-10-08T11:58:08.718 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-10-08T11:58:08.869 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-mgr (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:09.036 INFO:teuthology.orchestra.run.smithi062.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-10-08T11:58:09.084 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-08T11:58:09.084 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-08T11:58:09.111 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-10-08T11:58:09.309 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-10-08T11:58:09.421 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-10-08T11:58:09.425 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-10-08T11:58:09.662 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-osd (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:09.782 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-10-08T11:58:09.836 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-10-08T11:58:09.907 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up librados2 (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:09.993 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-08T11:58:09.993 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-08T11:58:10.059 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up librgw2 (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:10.112 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-portend (3.0.0-1) ... 2023-10-08T11:58:10.262 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libsqlite3-mod-ceph (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:10.371 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libcephfs2 (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:10.421 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-08T11:58:10.472 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libradosstriper1 (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:10.556 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-10-08T11:58:10.572 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-mgr-k8sevents (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:10.598 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-10-08T11:58:10.698 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:10.850 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-mon (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:10.892 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up librbd1 (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:10.964 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-10-08T11:58:11.018 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up ceph-mgr-modules-core (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:11.061 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-08T11:58:11.062 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-08T11:58:11.144 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up ceph-fuse (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:11.316 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-10-08T11:58:11.336 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-08T11:58:11.336 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-08T11:58:11.618 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-10-08T11:58:11.634 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-mgr-cephadm (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:11.718 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-rsa (4.8-1) ... 2023-10-08T11:58:11.785 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:11.911 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-mgr-dashboard (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:11.986 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-10-08T11:58:11.987 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libcephfs-dev (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:12.054 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-volume (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:12.096 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-rados (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:12.222 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up cephfs-top (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:12.279 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-10-08T11:58:12.348 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-10-08T11:58:12.415 INFO:teuthology.orchestra.run.smithi130.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-10-08T11:58:12.555 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-10-08T11:58:12.948 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-10-08T11:58:13.316 INFO:teuthology.orchestra.run.smithi130.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-10-08T11:58:13.317 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-10-08T11:58:13.645 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-rbd (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:13.685 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-10-08T11:58:13.754 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up rbd-fuse (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:13.795 INFO:teuthology.orchestra.run.smithi130.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-08T11:58:13.798 DEBUG:teuthology.orchestra.run.smithi130:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-10-08T11:58:13.802 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up librados2 (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:13.860 INFO:teuthology.orchestra.run.smithi130.stdout:Reading package lists... 2023-10-08T11:58:13.897 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-rgw (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:13.962 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up librgw2 (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:14.023 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-cephfs (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:14.046 INFO:teuthology.orchestra.run.smithi130.stdout:Building dependency tree... 2023-10-08T11:58:14.046 INFO:teuthology.orchestra.run.smithi130.stdout:Reading state information... 2023-10-08T11:58:14.149 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up cephfs-shell (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:14.210 INFO:teuthology.orchestra.run.smithi130.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-10-08T11:58:14.210 INFO:teuthology.orchestra.run.smithi130.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-10-08T11:58:14.210 INFO:teuthology.orchestra.run.smithi130.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-10-08T11:58:14.210 INFO:teuthology.orchestra.run.smithi130.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-10-08T11:58:14.210 INFO:teuthology.orchestra.run.smithi130.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-10-08T11:58:14.210 INFO:teuthology.orchestra.run.smithi130.stdout:The following packages were automatically installed and are no longer required: 2023-10-08T11:58:14.210 INFO:teuthology.orchestra.run.smithi130.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-10-08T11:58:14.211 INFO:teuthology.orchestra.run.smithi130.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-10-08T11:58:14.214 INFO:teuthology.orchestra.run.smithi130.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-10-08T11:58:14.214 INFO:teuthology.orchestra.run.smithi130.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2023-10-08T11:58:14.214 INFO:teuthology.orchestra.run.smithi130.stdout: python2.7-minimal 2023-10-08T11:58:14.214 INFO:teuthology.orchestra.run.smithi130.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-08T11:58:14.214 INFO:teuthology.orchestra.run.smithi130.stdout:The following additional packages will be installed: 2023-10-08T11:58:14.214 INFO:teuthology.orchestra.run.smithi130.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-10-08T11:58:14.214 INFO:teuthology.orchestra.run.smithi130.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-10-08T11:58:14.214 INFO:teuthology.orchestra.run.smithi130.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-10-08T11:58:14.214 INFO:teuthology.orchestra.run.smithi130.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-10-08T11:58:14.214 INFO:teuthology.orchestra.run.smithi130.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-10-08T11:58:14.214 INFO:teuthology.orchestra.run.smithi130.stdout:Suggested packages: 2023-10-08T11:58:14.215 INFO:teuthology.orchestra.run.smithi130.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-10-08T11:58:14.215 INFO:teuthology.orchestra.run.smithi130.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-10-08T11:58:14.215 INFO:teuthology.orchestra.run.smithi130.stdout: libengine-pkcs11-openssl 2023-10-08T11:58:14.215 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libsqlite3-mod-ceph (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:14.252 INFO:teuthology.orchestra.run.smithi130.stdout:The following NEW packages will be installed: 2023-10-08T11:58:14.253 INFO:teuthology.orchestra.run.smithi130.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-10-08T11:58:14.253 INFO:teuthology.orchestra.run.smithi130.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-10-08T11:58:14.253 INFO:teuthology.orchestra.run.smithi130.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-10-08T11:58:14.253 INFO:teuthology.orchestra.run.smithi130.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-10-08T11:58:14.253 INFO:teuthology.orchestra.run.smithi130.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-10-08T11:58:14.254 INFO:teuthology.orchestra.run.smithi130.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-10-08T11:58:14.254 INFO:teuthology.orchestra.run.smithi130.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-10-08T11:58:14.254 INFO:teuthology.orchestra.run.smithi130.stdout:The following packages will be upgraded: 2023-10-08T11:58:14.255 INFO:teuthology.orchestra.run.smithi130.stdout: libssl3 2023-10-08T11:58:14.275 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up ceph-common (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:14.341 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libcephfs2 (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:14.434 INFO:teuthology.orchestra.run.smithi130.stdout:1 upgraded, 39 newly installed, 0 to remove and 256 not upgraded. 2023-10-08T11:58:14.434 INFO:teuthology.orchestra.run.smithi130.stdout:Need to get 54.6 MB of archives. 2023-10-08T11:58:14.434 INFO:teuthology.orchestra.run.smithi130.stdout:After this operation, 202 MB of additional disk space will be used. 2023-10-08T11:58:14.434 INFO:teuthology.orchestra.run.smithi130.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-10-08T11:58:14.492 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libradosstriper1 (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:14.601 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-10-08T11:58:14.820 INFO:teuthology.orchestra.run.smithi156.stdout:Adding group ceph....done 2023-10-08T11:58:14.878 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up librbd1 (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:14.912 INFO:teuthology.orchestra.run.smithi130.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.10 [1,901 kB] 2023-10-08T11:58:15.004 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mgr-modules-core (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:15.163 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-fuse (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:15.169 INFO:teuthology.orchestra.run.smithi130.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-10-08T11:58:15.187 INFO:teuthology.orchestra.run.smithi156.stdout:Adding system user ceph....done 2023-10-08T11:58:15.204 INFO:teuthology.orchestra.run.smithi130.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-10-08T11:58:15.206 INFO:teuthology.orchestra.run.smithi130.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-10-08T11:58:15.211 INFO:teuthology.orchestra.run.smithi130.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-10-08T11:58:15.214 INFO:teuthology.orchestra.run.smithi130.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-10-08T11:58:15.215 INFO:teuthology.orchestra.run.smithi130.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-10-08T11:58:15.218 INFO:teuthology.orchestra.run.smithi130.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-10-08T11:58:15.220 INFO:teuthology.orchestra.run.smithi130.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-10-08T11:58:15.374 INFO:teuthology.orchestra.run.smithi156.stdout:Setting system user ceph properties....done 2023-10-08T11:58:15.382 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-08T11:58:15.382 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-08T11:58:15.385 INFO:teuthology.orchestra.run.smithi130.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-10-08T11:58:15.386 INFO:teuthology.orchestra.run.smithi130.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-10-08T11:58:15.391 INFO:teuthology.orchestra.run.smithi156.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-10-08T11:58:15.532 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-10-08T11:58:15.630 INFO:teuthology.orchestra.run.smithi130.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-10-08T11:58:15.921 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-10-08T11:58:16.107 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libcephfs-dev (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:16.258 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-rados (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:16.384 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up cephfs-top (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:16.534 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-10-08T11:58:16.651 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up cephfs-mirror (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:16.817 INFO:teuthology.orchestra.run.smithi130.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-10-08T11:58:16.822 INFO:teuthology.orchestra.run.smithi130.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-10-08T11:58:16.822 INFO:teuthology.orchestra.run.smithi130.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-10-08T11:58:16.829 INFO:teuthology.orchestra.run.smithi130.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-10-08T11:58:16.829 INFO:teuthology.orchestra.run.smithi130.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-10-08T11:58:16.840 INFO:teuthology.orchestra.run.smithi130.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.9-0ubuntu0.22.04.1 [141 kB] 2023-10-08T11:58:16.843 INFO:teuthology.orchestra.run.smithi130.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-10-08T11:58:16.859 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-08T11:58:16.859 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-08T11:58:16.861 INFO:teuthology.orchestra.run.smithi130.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-10-08T11:58:17.025 INFO:teuthology.orchestra.run.smithi130.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.10 [2,372 kB] 2023-10-08T11:58:17.529 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up ceph-test (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:17.646 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up radosgw (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:17.745 INFO:teuthology.orchestra.run.smithi130.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-10-08T11:58:17.746 INFO:teuthology.orchestra.run.smithi130.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-10-08T11:58:17.772 INFO:teuthology.orchestra.run.smithi130.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-10-08T11:58:17.797 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-rbd (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:17.850 INFO:teuthology.orchestra.run.smithi130.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-10-08T11:58:17.859 INFO:teuthology.orchestra.run.smithi130.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-10-08T11:58:17.860 INFO:teuthology.orchestra.run.smithi130.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-10-08T11:58:17.861 INFO:teuthology.orchestra.run.smithi130.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-10-08T11:58:17.862 INFO:teuthology.orchestra.run.smithi130.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.9-0ubuntu0.22.04.1 [1,222 kB] 2023-10-08T11:58:17.888 INFO:teuthology.orchestra.run.smithi130.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-10-08T11:58:17.892 INFO:teuthology.orchestra.run.smithi130.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.9-0ubuntu0.22.04.1 [16.1 MB] 2023-10-08T11:58:17.923 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up rbd-fuse (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:18.083 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-rgw (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:18.209 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-cephfs (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:18.343 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up cephfs-shell (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:18.452 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-common (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:18.548 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-08T11:58:18.548 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-08T11:58:18.606 INFO:teuthology.orchestra.run.smithi130.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-10-08T11:58:18.690 INFO:teuthology.orchestra.run.smithi130.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-10-08T11:58:18.690 INFO:teuthology.orchestra.run.smithi130.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-10-08T11:58:18.691 INFO:teuthology.orchestra.run.smithi130.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-10-08T11:58:18.780 INFO:teuthology.orchestra.run.smithi130.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-10-08T11:58:18.785 INFO:teuthology.orchestra.run.smithi130.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-10-08T11:58:19.062 INFO:teuthology.orchestra.run.smithi062.stdout:Adding group ceph....done 2023-10-08T11:58:19.165 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up ceph-base (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:19.243 INFO:teuthology.orchestra.run.smithi130.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-10-08T11:58:19.244 INFO:teuthology.orchestra.run.smithi130.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-10-08T11:58:19.480 INFO:teuthology.orchestra.run.smithi062.stdout:Adding system user ceph....done 2023-10-08T11:58:19.527 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-10-08T11:58:19.643 INFO:teuthology.orchestra.run.smithi130.stdout:Preconfiguring packages ... 2023-10-08T11:58:19.657 INFO:teuthology.orchestra.run.smithi062.stdout:Setting system user ceph properties....done 2023-10-08T11:58:19.673 INFO:teuthology.orchestra.run.smithi062.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-10-08T11:58:19.812 INFO:teuthology.orchestra.run.smithi130.stdout:Fetched 54.6 MB in 5s (11.0 MB/s) 2023-10-08T11:58:19.816 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-10-08T11:58:19.991 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package flex. 2023-10-08T11:58:20.080 INFO:teuthology.orchestra.run.smithi130.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 137425 files and directories currently installed.) 2023-10-08T11:58:20.085 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-10-08T11:58:20.131 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking flex (2.6.4-8build2) ... 2023-10-08T11:58:20.204 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-10-08T11:58:20.262 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up ceph-mds (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:20.497 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-08T11:58:20.497 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-08T11:58:20.737 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up cephfs-mirror (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:20.951 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-08T11:58:20.951 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-08T11:58:21.102 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up ceph-mgr (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:21.136 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.10_amd64.deb ... 2023-10-08T11:58:21.307 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-08T11:58:21.307 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-08T11:58:21.464 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.10) over (3.0.2-0ubuntu1.7) ... 2023-10-08T11:58:21.505 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-test (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:21.639 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up radosgw (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:21.921 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.10) ... 2023-10-08T11:58:21.929 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up ceph-osd (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:22.191 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-08T11:58:22.192 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-08T11:58:22.235 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-08T11:58:22.236 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-08T11:58:22.440 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package bison. 2023-10-08T11:58:22.529 INFO:teuthology.orchestra.run.smithi130.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 137498 files and directories currently installed.) 2023-10-08T11:58:22.534 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-10-08T11:58:22.592 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-10-08T11:58:22.733 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-base (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:22.856 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up ceph-mgr-k8sevents (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:23.002 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:23.010 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-10-08T11:58:23.032 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-10-08T11:58:23.072 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-10-08T11:58:23.076 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-10-08T11:58:23.133 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up ceph-mon (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:23.324 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-08T11:58:23.324 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-08T11:58:23.405 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package dump. 2023-10-08T11:58:23.426 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-10-08T11:58:23.471 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking dump (0.4b47-3) ... 2023-10-08T11:58:23.595 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mds (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:23.741 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package indent. 2023-10-08T11:58:23.754 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-10-08T11:58:23.791 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-10-08T11:58:23.951 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up ceph-mgr-cephadm (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:23.961 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-08T11:58:23.961 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-08T11:58:24.060 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-10-08T11:58:24.073 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-10-08T11:58:24.093 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up ceph (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:24.119 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-10-08T11:58:24.236 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up ceph-mgr-dashboard (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:24.406 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up ceph-volume (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:24.433 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-10-08T11:58:24.453 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-10-08T11:58:24.498 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-10-08T11:58:24.504 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mgr (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:24.722 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-08T11:58:24.722 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-08T11:58:24.734 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-10-08T11:58:24.756 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-10-08T11:58:24.765 INFO:teuthology.orchestra.run.smithi156.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-10-08T11:58:24.801 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-10-08T11:58:25.155 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libfl2:amd64. 2023-10-08T11:58:25.176 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-10-08T11:58:25.230 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-osd (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:25.244 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-10-08T11:58:25.499 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-10-08T11:58:25.511 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-10-08T11:58:25.549 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-10-08T11:58:25.585 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-08T11:58:25.585 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-08T11:58:25.776 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libjson-perl. 2023-10-08T11:58:25.789 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-10-08T11:58:25.826 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-10-08T11:58:25.841 INFO:teuthology.orchestra.run.smithi156.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-10-08T11:58:26.132 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mgr-k8sevents (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:26.138 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libllvm14:amd64. 2023-10-08T11:58:26.160 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-10-08T11:58:26.205 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-10-08T11:58:26.324 INFO:teuthology.orchestra.run.smithi156.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-08T11:58:26.328 DEBUG:teuthology.orchestra.run.smithi156:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-10-08T11:58:26.333 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:26.403 INFO:teuthology.orchestra.run.smithi156.stdout:Reading package lists... 2023-10-08T11:58:26.488 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mon (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:26.569 INFO:teuthology.orchestra.run.smithi156.stdout:Building dependency tree... 2023-10-08T11:58:26.569 INFO:teuthology.orchestra.run.smithi156.stdout:Reading state information... 2023-10-08T11:58:26.716 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-08T11:58:26.716 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-08T11:58:26.720 INFO:teuthology.orchestra.run.smithi156.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-10-08T11:58:26.720 INFO:teuthology.orchestra.run.smithi156.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-10-08T11:58:26.720 INFO:teuthology.orchestra.run.smithi156.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-10-08T11:58:26.720 INFO:teuthology.orchestra.run.smithi156.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-10-08T11:58:26.721 INFO:teuthology.orchestra.run.smithi156.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-10-08T11:58:26.721 INFO:teuthology.orchestra.run.smithi156.stdout:The following packages were automatically installed and are no longer required: 2023-10-08T11:58:26.721 INFO:teuthology.orchestra.run.smithi156.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-10-08T11:58:26.721 INFO:teuthology.orchestra.run.smithi156.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-10-08T11:58:26.721 INFO:teuthology.orchestra.run.smithi156.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-10-08T11:58:26.722 INFO:teuthology.orchestra.run.smithi156.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-10-08T11:58:26.722 INFO:teuthology.orchestra.run.smithi156.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-10-08T11:58:26.722 INFO:teuthology.orchestra.run.smithi156.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-08T11:58:26.722 INFO:teuthology.orchestra.run.smithi156.stdout:The following additional packages will be installed: 2023-10-08T11:58:26.722 INFO:teuthology.orchestra.run.smithi156.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-10-08T11:58:26.722 INFO:teuthology.orchestra.run.smithi156.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-10-08T11:58:26.723 INFO:teuthology.orchestra.run.smithi156.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-10-08T11:58:26.723 INFO:teuthology.orchestra.run.smithi156.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-10-08T11:58:26.723 INFO:teuthology.orchestra.run.smithi156.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-10-08T11:58:26.724 INFO:teuthology.orchestra.run.smithi156.stdout:Suggested packages: 2023-10-08T11:58:26.724 INFO:teuthology.orchestra.run.smithi156.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-10-08T11:58:26.724 INFO:teuthology.orchestra.run.smithi156.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-10-08T11:58:26.724 INFO:teuthology.orchestra.run.smithi156.stdout: libengine-pkcs11-openssl 2023-10-08T11:58:26.772 INFO:teuthology.orchestra.run.smithi156.stdout:The following NEW packages will be installed: 2023-10-08T11:58:26.773 INFO:teuthology.orchestra.run.smithi156.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-10-08T11:58:26.773 INFO:teuthology.orchestra.run.smithi156.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-10-08T11:58:26.773 INFO:teuthology.orchestra.run.smithi156.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-10-08T11:58:26.773 INFO:teuthology.orchestra.run.smithi156.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-10-08T11:58:26.774 INFO:teuthology.orchestra.run.smithi156.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-10-08T11:58:26.774 INFO:teuthology.orchestra.run.smithi156.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-10-08T11:58:26.774 INFO:teuthology.orchestra.run.smithi156.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-10-08T11:58:26.775 INFO:teuthology.orchestra.run.smithi156.stdout:The following packages will be upgraded: 2023-10-08T11:58:26.775 INFO:teuthology.orchestra.run.smithi156.stdout: libssl3 2023-10-08T11:58:26.959 INFO:teuthology.orchestra.run.smithi156.stdout:1 upgraded, 39 newly installed, 0 to remove and 256 not upgraded. 2023-10-08T11:58:26.959 INFO:teuthology.orchestra.run.smithi156.stdout:Need to get 54.6 MB of archives. 2023-10-08T11:58:26.959 INFO:teuthology.orchestra.run.smithi156.stdout:After this operation, 202 MB of additional disk space will be used. 2023-10-08T11:58:26.959 INFO:teuthology.orchestra.run.smithi156.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-10-08T11:58:27.244 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mgr-cephadm (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:27.420 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:27.435 INFO:teuthology.orchestra.run.smithi156.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.10 [1,901 kB] 2023-10-08T11:58:27.546 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mgr-dashboard (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:27.691 INFO:teuthology.orchestra.run.smithi156.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-10-08T11:58:27.713 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-volume (18.0.0-6639-g7b3143ba-1jammy) ... 2023-10-08T11:58:27.726 INFO:teuthology.orchestra.run.smithi156.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-10-08T11:58:27.728 INFO:teuthology.orchestra.run.smithi156.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-10-08T11:58:27.732 INFO:teuthology.orchestra.run.smithi156.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-10-08T11:58:27.736 INFO:teuthology.orchestra.run.smithi156.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-10-08T11:58:27.737 INFO:teuthology.orchestra.run.smithi156.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-10-08T11:58:27.740 INFO:teuthology.orchestra.run.smithi156.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-10-08T11:58:27.742 INFO:teuthology.orchestra.run.smithi156.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-10-08T11:58:27.891 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-10-08T11:58:27.908 INFO:teuthology.orchestra.run.smithi156.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-10-08T11:58:27.908 INFO:teuthology.orchestra.run.smithi156.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-10-08T11:58:27.913 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-10-08T11:58:27.958 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-10-08T11:58:28.066 INFO:teuthology.orchestra.run.smithi062.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-10-08T11:58:28.153 INFO:teuthology.orchestra.run.smithi156.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-10-08T11:58:28.185 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libmbim-proxy. 2023-10-08T11:58:28.198 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-10-08T11:58:28.227 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-10-08T11:58:28.555 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-10-08T11:58:28.577 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-10-08T11:58:28.622 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-10-08T11:58:28.925 INFO:teuthology.orchestra.run.smithi062.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-10-08T11:58:28.975 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libndp0:amd64. 2023-10-08T11:58:28.997 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-10-08T11:58:29.041 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-10-08T11:58:29.166 INFO:teuthology.orchestra.run.smithi156.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-10-08T11:58:29.193 INFO:teuthology.orchestra.run.smithi156.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-10-08T11:58:29.194 INFO:teuthology.orchestra.run.smithi156.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-10-08T11:58:29.197 INFO:teuthology.orchestra.run.smithi156.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-10-08T11:58:29.197 INFO:teuthology.orchestra.run.smithi156.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-10-08T11:58:29.202 INFO:teuthology.orchestra.run.smithi156.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.9-0ubuntu0.22.04.1 [141 kB] 2023-10-08T11:58:29.204 INFO:teuthology.orchestra.run.smithi156.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-10-08T11:58:29.230 INFO:teuthology.orchestra.run.smithi156.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-10-08T11:58:29.378 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libnm0:amd64. 2023-10-08T11:58:29.394 INFO:teuthology.orchestra.run.smithi156.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.10 [2,372 kB] 2023-10-08T11:58:29.400 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-10-08T11:58:29.430 INFO:teuthology.orchestra.run.smithi062.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-08T11:58:29.432 DEBUG:teuthology.orchestra.run.smithi062:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-10-08T11:58:29.444 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-10-08T11:58:29.527 INFO:teuthology.orchestra.run.smithi062.stdout:Reading package lists... 2023-10-08T11:58:29.717 INFO:teuthology.orchestra.run.smithi062.stdout:Building dependency tree... 2023-10-08T11:58:29.718 INFO:teuthology.orchestra.run.smithi062.stdout:Reading state information... 2023-10-08T11:58:29.797 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libpq5:amd64. 2023-10-08T11:58:29.819 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../16-libpq5_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-10-08T11:58:29.864 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-10-08T11:58:29.891 INFO:teuthology.orchestra.run.smithi062.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-10-08T11:58:29.891 INFO:teuthology.orchestra.run.smithi062.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-10-08T11:58:29.891 INFO:teuthology.orchestra.run.smithi062.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-10-08T11:58:29.891 INFO:teuthology.orchestra.run.smithi062.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-10-08T11:58:29.891 INFO:teuthology.orchestra.run.smithi062.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-10-08T11:58:29.891 INFO:teuthology.orchestra.run.smithi062.stdout:The following packages were automatically installed and are no longer required: 2023-10-08T11:58:29.891 INFO:teuthology.orchestra.run.smithi062.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-10-08T11:58:29.891 INFO:teuthology.orchestra.run.smithi062.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-10-08T11:58:29.892 INFO:teuthology.orchestra.run.smithi062.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-10-08T11:58:29.892 INFO:teuthology.orchestra.run.smithi062.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2023-10-08T11:58:29.892 INFO:teuthology.orchestra.run.smithi062.stdout: python2.7-minimal 2023-10-08T11:58:29.892 INFO:teuthology.orchestra.run.smithi062.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-08T11:58:29.893 INFO:teuthology.orchestra.run.smithi062.stdout:The following additional packages will be installed: 2023-10-08T11:58:29.893 INFO:teuthology.orchestra.run.smithi062.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-10-08T11:58:29.893 INFO:teuthology.orchestra.run.smithi062.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-10-08T11:58:29.893 INFO:teuthology.orchestra.run.smithi062.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-10-08T11:58:29.893 INFO:teuthology.orchestra.run.smithi062.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-10-08T11:58:29.893 INFO:teuthology.orchestra.run.smithi062.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-10-08T11:58:29.894 INFO:teuthology.orchestra.run.smithi062.stdout:Suggested packages: 2023-10-08T11:58:29.895 INFO:teuthology.orchestra.run.smithi062.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-10-08T11:58:29.895 INFO:teuthology.orchestra.run.smithi062.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-10-08T11:58:29.895 INFO:teuthology.orchestra.run.smithi062.stdout: libengine-pkcs11-openssl 2023-10-08T11:58:29.934 INFO:teuthology.orchestra.run.smithi062.stdout:The following NEW packages will be installed: 2023-10-08T11:58:29.935 INFO:teuthology.orchestra.run.smithi062.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-10-08T11:58:29.935 INFO:teuthology.orchestra.run.smithi062.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-10-08T11:58:29.935 INFO:teuthology.orchestra.run.smithi062.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-10-08T11:58:29.935 INFO:teuthology.orchestra.run.smithi062.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-10-08T11:58:29.935 INFO:teuthology.orchestra.run.smithi062.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-10-08T11:58:29.936 INFO:teuthology.orchestra.run.smithi062.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-10-08T11:58:29.936 INFO:teuthology.orchestra.run.smithi062.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-10-08T11:58:29.936 INFO:teuthology.orchestra.run.smithi062.stdout:The following packages will be upgraded: 2023-10-08T11:58:29.937 INFO:teuthology.orchestra.run.smithi062.stdout: libssl3 2023-10-08T11:58:29.988 INFO:teuthology.orchestra.run.smithi062.stdout:1 upgraded, 39 newly installed, 0 to remove and 256 not upgraded. 2023-10-08T11:58:29.988 INFO:teuthology.orchestra.run.smithi062.stdout:Need to get 54.6 MB of archives. 2023-10-08T11:58:29.988 INFO:teuthology.orchestra.run.smithi062.stdout:After this operation, 202 MB of additional disk space will be used. 2023-10-08T11:58:29.988 INFO:teuthology.orchestra.run.smithi062.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-10-08T11:58:30.086 INFO:teuthology.orchestra.run.smithi062.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.10 [1,901 kB] 2023-10-08T11:58:30.115 INFO:teuthology.orchestra.run.smithi156.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-10-08T11:58:30.116 INFO:teuthology.orchestra.run.smithi156.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-10-08T11:58:30.142 INFO:teuthology.orchestra.run.smithi156.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-10-08T11:58:30.148 INFO:teuthology.orchestra.run.smithi062.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-10-08T11:58:30.163 INFO:teuthology.orchestra.run.smithi062.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-10-08T11:58:30.164 INFO:teuthology.orchestra.run.smithi062.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-10-08T11:58:30.166 INFO:teuthology.orchestra.run.smithi062.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-10-08T11:58:30.168 INFO:teuthology.orchestra.run.smithi062.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-10-08T11:58:30.168 INFO:teuthology.orchestra.run.smithi062.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-10-08T11:58:30.170 INFO:teuthology.orchestra.run.smithi062.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-10-08T11:58:30.171 INFO:teuthology.orchestra.run.smithi062.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-10-08T11:58:30.172 INFO:teuthology.orchestra.run.smithi062.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-10-08T11:58:30.173 INFO:teuthology.orchestra.run.smithi062.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-10-08T11:58:30.188 INFO:teuthology.orchestra.run.smithi062.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-10-08T11:58:30.217 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-10-08T11:58:30.219 INFO:teuthology.orchestra.run.smithi156.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-10-08T11:58:30.228 INFO:teuthology.orchestra.run.smithi156.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-10-08T11:58:30.228 INFO:teuthology.orchestra.run.smithi156.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-10-08T11:58:30.229 INFO:teuthology.orchestra.run.smithi156.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-10-08T11:58:30.230 INFO:teuthology.orchestra.run.smithi156.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.9-0ubuntu0.22.04.1 [1,222 kB] 2023-10-08T11:58:30.239 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-10-08T11:58:30.258 INFO:teuthology.orchestra.run.smithi156.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-10-08T11:58:30.261 INFO:teuthology.orchestra.run.smithi156.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.9-0ubuntu0.22.04.1 [16.1 MB] 2023-10-08T11:58:30.283 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-10-08T11:58:30.535 INFO:teuthology.orchestra.run.smithi062.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-10-08T11:58:30.537 INFO:teuthology.orchestra.run.smithi062.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-10-08T11:58:30.537 INFO:teuthology.orchestra.run.smithi062.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-10-08T11:58:30.540 INFO:teuthology.orchestra.run.smithi062.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-10-08T11:58:30.540 INFO:teuthology.orchestra.run.smithi062.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-10-08T11:58:30.545 INFO:teuthology.orchestra.run.smithi062.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.9-0ubuntu0.22.04.1 [141 kB] 2023-10-08T11:58:30.547 INFO:teuthology.orchestra.run.smithi062.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-10-08T11:58:30.554 INFO:teuthology.orchestra.run.smithi062.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-10-08T11:58:30.555 INFO:teuthology.orchestra.run.smithi062.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.10 [2,372 kB] 2023-10-08T11:58:30.569 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libqmi-proxy. 2023-10-08T11:58:30.577 INFO:teuthology.orchestra.run.smithi062.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-10-08T11:58:30.577 INFO:teuthology.orchestra.run.smithi062.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-10-08T11:58:30.582 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-10-08T11:58:30.588 INFO:teuthology.orchestra.run.smithi062.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-10-08T11:58:30.609 INFO:teuthology.orchestra.run.smithi062.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-10-08T11:58:30.612 INFO:teuthology.orchestra.run.smithi062.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-10-08T11:58:30.613 INFO:teuthology.orchestra.run.smithi062.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-10-08T11:58:30.613 INFO:teuthology.orchestra.run.smithi062.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-10-08T11:58:30.614 INFO:teuthology.orchestra.run.smithi062.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.9-0ubuntu0.22.04.1 [1,222 kB] 2023-10-08T11:58:30.625 INFO:teuthology.orchestra.run.smithi062.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-10-08T11:58:30.626 INFO:teuthology.orchestra.run.smithi062.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.9-0ubuntu0.22.04.1 [16.1 MB] 2023-10-08T11:58:30.636 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-10-08T11:58:30.831 INFO:teuthology.orchestra.run.smithi062.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-10-08T11:58:30.831 INFO:teuthology.orchestra.run.smithi062.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-10-08T11:58:30.831 INFO:teuthology.orchestra.run.smithi062.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-10-08T11:58:30.831 INFO:teuthology.orchestra.run.smithi062.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-10-08T11:58:30.832 INFO:teuthology.orchestra.run.smithi062.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-10-08T11:58:30.832 INFO:teuthology.orchestra.run.smithi062.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-10-08T11:58:30.843 INFO:teuthology.orchestra.run.smithi062.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-10-08T11:58:30.844 INFO:teuthology.orchestra.run.smithi062.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-10-08T11:58:30.888 INFO:teuthology.orchestra.run.smithi156.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-10-08T11:58:30.888 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-10-08T11:58:30.901 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.10_amd64.deb ... 2023-10-08T11:58:30.947 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-10-08T11:58:30.970 INFO:teuthology.orchestra.run.smithi156.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-10-08T11:58:30.970 INFO:teuthology.orchestra.run.smithi156.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-10-08T11:58:30.971 INFO:teuthology.orchestra.run.smithi156.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-10-08T11:58:31.060 INFO:teuthology.orchestra.run.smithi156.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-10-08T11:58:31.066 INFO:teuthology.orchestra.run.smithi156.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-10-08T11:58:31.263 INFO:teuthology.orchestra.run.smithi062.stdout:Preconfiguring packages ... 2023-10-08T11:58:31.497 INFO:teuthology.orchestra.run.smithi062.stdout:Fetched 54.6 MB in 1s (60.7 MB/s) 2023-10-08T11:58:31.524 INFO:teuthology.orchestra.run.smithi156.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-10-08T11:58:31.526 INFO:teuthology.orchestra.run.smithi156.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-10-08T11:58:31.641 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package flex. 2023-10-08T11:58:31.731 INFO:teuthology.orchestra.run.smithi062.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 137425 files and directories currently installed.) 2023-10-08T11:58:31.736 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-10-08T11:58:31.795 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-10-08T11:58:31.814 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking flex (2.6.4-8build2) ... 2023-10-08T11:58:31.817 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-10-08T11:58:31.853 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-10-08T11:58:31.923 INFO:teuthology.orchestra.run.smithi156.stdout:Preconfiguring packages ... 2023-10-08T11:58:32.081 INFO:teuthology.orchestra.run.smithi156.stdout:Fetched 54.6 MB in 5s (11.5 MB/s) 2023-10-08T11:58:32.189 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package modemmanager. 2023-10-08T11:58:32.211 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-10-08T11:58:32.216 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package flex. 2023-10-08T11:58:32.256 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-10-08T11:58:32.291 INFO:teuthology.orchestra.run.smithi156.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139855 files and directories currently installed.) 2023-10-08T11:58:32.295 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-10-08T11:58:32.332 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking flex (2.6.4-8build2) ... 2023-10-08T11:58:32.450 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.10_amd64.deb ... 2023-10-08T11:58:32.628 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.10) over (3.0.2-0ubuntu1.7) ... 2023-10-08T11:58:32.872 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package network-manager. 2023-10-08T11:58:32.885 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.10_amd64.deb ... 2023-10-08T11:58:32.893 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-10-08T11:58:32.937 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-10-08T11:58:33.055 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.10) over (3.0.2-0ubuntu1.7) ... 2023-10-08T11:58:33.101 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.10) ... 2023-10-08T11:58:33.461 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.10) ... 2023-10-08T11:58:33.595 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ppp. 2023-10-08T11:58:33.617 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-10-08T11:58:33.696 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package bison. 2023-10-08T11:58:33.787 INFO:teuthology.orchestra.run.smithi062.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 137498 files and directories currently installed.) 2023-10-08T11:58:33.792 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-10-08T11:58:33.856 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-10-08T11:58:33.952 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-10-08T11:58:34.005 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package bison. 2023-10-08T11:58:34.079 INFO:teuthology.orchestra.run.smithi156.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139928 files and directories currently installed.) 2023-10-08T11:58:34.083 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-10-08T11:58:34.133 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-10-08T11:58:34.269 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package pptp-linux. 2023-10-08T11:58:34.291 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-10-08T11:58:34.317 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-10-08T11:58:34.335 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-10-08T11:58:34.339 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-10-08T11:58:34.409 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-10-08T11:58:34.567 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-10-08T11:58:34.581 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-10-08T11:58:34.588 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package network-manager-pptp. 2023-10-08T11:58:34.601 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-10-08T11:58:34.625 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-10-08T11:58:34.637 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-10-08T11:58:34.770 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package dump. 2023-10-08T11:58:34.793 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-10-08T11:58:34.837 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking dump (0.4b47-3) ... 2023-10-08T11:58:34.925 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package postgresql-client-common. 2023-10-08T11:58:34.947 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package dump. 2023-10-08T11:58:34.947 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-10-08T11:58:34.960 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-10-08T11:58:34.991 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking postgresql-client-common (238) ... 2023-10-08T11:58:34.999 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking dump (0.4b47-3) ... 2023-10-08T11:58:35.157 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package indent. 2023-10-08T11:58:35.170 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-10-08T11:58:35.207 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-10-08T11:58:35.240 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package indent. 2023-10-08T11:58:35.255 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-10-08T11:58:35.290 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-10-08T11:58:35.298 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package postgresql-client-14. 2023-10-08T11:58:35.308 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../27-postgresql-client-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-10-08T11:58:35.345 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-10-08T11:58:35.501 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-10-08T11:58:35.523 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-10-08T11:58:35.542 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-10-08T11:58:35.557 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-10-08T11:58:35.593 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-10-08T11:58:35.601 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-10-08T11:58:35.938 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-10-08T11:58:35.941 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package postgresql-common. 2023-10-08T11:58:35.947 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-10-08T11:58:35.953 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-10-08T11:58:35.964 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-10-08T11:58:35.969 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-10-08T11:58:35.996 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-10-08T11:58:36.005 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-10-08T11:58:36.067 INFO:teuthology.orchestra.run.smithi130.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-10-08T11:58:36.089 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking postgresql-common (238) ... 2023-10-08T11:58:36.240 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-10-08T11:58:36.256 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-10-08T11:58:36.290 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-10-08T11:58:36.299 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-10-08T11:58:36.321 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-10-08T11:58:36.366 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-10-08T11:58:36.533 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package postgresql-14. 2023-10-08T11:58:36.555 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../29-postgresql-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-10-08T11:58:36.602 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-10-08T11:58:36.618 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libfl2:amd64. 2023-10-08T11:58:36.634 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-10-08T11:58:36.677 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-10-08T11:58:36.912 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libfl2:amd64. 2023-10-08T11:58:36.935 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-10-08T11:58:36.971 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-10-08T11:58:36.978 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-10-08T11:58:36.987 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-10-08T11:58:37.030 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-10-08T11:58:37.264 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-10-08T11:58:37.286 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-10-08T11:58:37.316 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libjson-perl. 2023-10-08T11:58:37.331 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-10-08T11:58:37.356 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-10-08T11:58:37.365 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-10-08T11:58:37.627 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libllvm14:amd64. 2023-10-08T11:58:37.642 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-10-08T11:58:37.643 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libjson-perl. 2023-10-08T11:58:37.656 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-10-08T11:58:37.677 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-10-08T11:58:37.700 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-10-08T11:58:38.054 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libllvm14:amd64. 2023-10-08T11:58:38.076 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-10-08T11:58:38.103 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package postgresql. 2023-10-08T11:58:38.117 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-10-08T11:58:38.120 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-10-08T11:58:38.161 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking postgresql (14+238) ... 2023-10-08T11:58:38.405 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package postgresql-client. 2023-10-08T11:58:38.418 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-10-08T11:58:38.456 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking postgresql-client (14+238) ... 2023-10-08T11:58:38.683 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package postgresql-contrib. 2023-10-08T11:58:38.695 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-10-08T11:58:38.725 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking postgresql-contrib (14+238) ... 2023-10-08T11:58:39.036 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package tcl8.6. 2023-10-08T11:58:39.058 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-10-08T11:58:39.102 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-10-08T11:58:39.105 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-10-08T11:58:39.120 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-10-08T11:58:39.163 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-10-08T11:58:39.388 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package tcl. 2023-10-08T11:58:39.410 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-10-08T11:58:39.424 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libmbim-proxy. 2023-10-08T11:58:39.439 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-10-08T11:58:39.460 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-10-08T11:58:39.482 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-10-08T11:58:39.760 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-10-08T11:58:39.775 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-10-08T11:58:39.809 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-10-08T11:58:39.825 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package wpasupplicant. 2023-10-08T11:58:39.847 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-10-08T11:58:39.883 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-10-08T11:58:39.932 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-10-08T11:58:39.954 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-10-08T11:58:39.998 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-10-08T11:58:40.162 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libndp0:amd64. 2023-10-08T11:58:40.178 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-10-08T11:58:40.221 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-10-08T11:58:40.280 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-10-08T11:58:40.294 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-10-08T11:58:40.318 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libmbim-proxy. 2023-10-08T11:58:40.331 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-10-08T11:58:40.371 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-10-08T11:58:40.376 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-10-08T11:58:40.549 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libnm0:amd64. 2023-10-08T11:58:40.564 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-10-08T11:58:40.607 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-10-08T11:58:40.750 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package usb-modeswitch. 2023-10-08T11:58:40.754 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-10-08T11:58:40.772 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-10-08T11:58:40.775 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-10-08T11:58:40.824 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-10-08T11:58:40.828 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-10-08T11:58:40.959 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libpq5:amd64. 2023-10-08T11:58:40.974 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../16-libpq5_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-10-08T11:58:41.009 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-10-08T11:58:41.091 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up postgresql-client-common (238) ... 2023-10-08T11:58:41.279 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-10-08T11:58:41.294 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-10-08T11:58:41.298 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up flex (2.6.4-8build2) ... 2023-10-08T11:58:41.333 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libndp0:amd64. 2023-10-08T11:58:41.354 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-10-08T11:58:41.355 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-10-08T11:58:41.398 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-10-08T11:58:41.423 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-10-08T11:58:41.549 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-10-08T11:58:41.656 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libqmi-proxy. 2023-10-08T11:58:41.671 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-10-08T11:58:41.675 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-10-08T11:58:41.715 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-10-08T11:58:41.785 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-10-08T11:58:41.793 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libnm0:amd64. 2023-10-08T11:58:41.816 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-10-08T11:58:41.903 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-10-08T11:58:41.958 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-10-08T11:58:41.960 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-10-08T11:58:41.973 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.10_amd64.deb ... 2023-10-08T11:58:42.034 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-10-08T11:58:42.305 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libpq5:amd64. 2023-10-08T11:58:42.327 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../16-libpq5_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-10-08T11:58:42.363 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-10-08T11:58:42.371 INFO:teuthology.orchestra.run.smithi130.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-10-08T11:58:42.458 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-10-08T11:58:42.547 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-10-08T11:58:42.561 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-10-08T11:58:42.622 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-10-08T11:58:42.749 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-10-08T11:58:42.771 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-10-08T11:58:42.811 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-08T11:58:42.811 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-08T11:58:42.815 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-10-08T11:58:42.941 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package modemmanager. 2023-10-08T11:58:42.956 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-10-08T11:58:42.999 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-10-08T11:58:43.177 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libqmi-proxy. 2023-10-08T11:58:43.199 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-10-08T11:58:43.244 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-10-08T11:58:43.411 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-10-08T11:58:43.513 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-10-08T11:58:43.535 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.10_amd64.deb ... 2023-10-08T11:58:43.537 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-10-08T11:58:43.579 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-10-08T11:58:43.616 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package network-manager. 2023-10-08T11:58:43.631 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-10-08T11:58:43.663 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-10-08T11:58:43.682 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-10-08T11:58:43.798 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-10-08T11:58:43.899 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-10-08T11:58:44.000 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-10-08T11:58:44.101 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-10-08T11:58:44.217 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-10-08T11:58:44.238 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-10-08T11:58:44.247 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package ppp. 2023-10-08T11:58:44.262 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-10-08T11:58:44.291 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-10-08T11:58:44.618 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-10-08T11:58:44.696 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package modemmanager. 2023-10-08T11:58:44.718 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-10-08T11:58:44.769 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-10-08T11:58:44.773 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-10-08T11:58:44.875 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up dump (0.4b47-3) ... 2023-10-08T11:58:44.952 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package pptp-linux. 2023-10-08T11:58:44.966 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-10-08T11:58:45.010 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-10-08T11:58:45.024 INFO:teuthology.orchestra.run.smithi130.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-10-08T11:58:45.093 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-10-08T11:58:45.220 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-10-08T11:58:45.287 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package network-manager-pptp. 2023-10-08T11:58:45.301 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-10-08T11:58:45.345 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up tcl (8.6.11+1build2) ... 2023-10-08T11:58:45.346 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-10-08T11:58:45.468 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package network-manager. 2023-10-08T11:58:45.471 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libjson-perl (4.04000-1) ... 2023-10-08T11:58:45.490 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-10-08T11:58:45.542 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-10-08T11:58:45.597 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-10-08T11:58:45.624 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package postgresql-client-common. 2023-10-08T11:58:45.638 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-10-08T11:58:45.674 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking postgresql-client-common (238) ... 2023-10-08T11:58:45.688 INFO:teuthology.orchestra.run.smithi130.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-10-08T11:58:45.766 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-10-08T11:58:45.867 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-10-08T11:58:45.977 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package postgresql-client-14. 2023-10-08T11:58:45.991 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../27-postgresql-client-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-10-08T11:58:46.010 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-10-08T11:58:46.036 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-10-08T11:58:46.136 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-10-08T11:58:46.233 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ppp. 2023-10-08T11:58:46.255 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-10-08T11:58:46.262 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-10-08T11:58:46.430 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up postgresql-client (14+238) ... 2023-10-08T11:58:46.557 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-10-08T11:58:46.632 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package postgresql-common. 2023-10-08T11:58:46.646 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-10-08T11:58:46.648 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-10-08T11:58:46.707 INFO:teuthology.orchestra.run.smithi156.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-10-08T11:58:46.739 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking postgresql-common (238) ... 2023-10-08T11:58:47.156 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package postgresql-14. 2023-10-08T11:58:47.170 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../29-postgresql-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-10-08T11:58:47.216 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-10-08T11:58:47.222 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package pptp-linux. 2023-10-08T11:58:47.245 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-10-08T11:58:47.290 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-08T11:58:47.290 INFO:teuthology.orchestra.run.smithi130.stdout:The following network interfaces were found in /etc/network/interfaces 2023-10-08T11:58:47.291 INFO:teuthology.orchestra.run.smithi130.stdout:which means they are currently configured by ifupdown: 2023-10-08T11:58:47.291 INFO:teuthology.orchestra.run.smithi130.stdout:- enp3s0f1 2023-10-08T11:58:47.291 INFO:teuthology.orchestra.run.smithi130.stdout:If you want to manage those interfaces with NetworkManager instead 2023-10-08T11:58:47.291 INFO:teuthology.orchestra.run.smithi130.stdout:remove their configuration from /etc/network/interfaces. 2023-10-08T11:58:47.291 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-08T11:58:47.423 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-10-08T11:58:47.695 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-10-08T11:58:47.767 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-10-08T11:58:48.093 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package network-manager-pptp. 2023-10-08T11:58:48.107 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-10-08T11:58:48.151 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-10-08T11:58:48.155 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-10-08T11:58:48.479 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package postgresql-client-common. 2023-10-08T11:58:48.502 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-10-08T11:58:48.579 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking postgresql-client-common (238) ... 2023-10-08T11:58:48.618 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package postgresql. 2023-10-08T11:58:48.633 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-10-08T11:58:48.677 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking postgresql (14+238) ... 2023-10-08T11:58:48.735 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-10-08T11:58:48.878 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-10-08T11:58:48.908 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package postgresql-client-14. 2023-10-08T11:58:48.920 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package postgresql-client. 2023-10-08T11:58:48.931 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../27-postgresql-client-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-10-08T11:58:48.934 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-10-08T11:58:48.966 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-10-08T11:58:48.979 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking postgresql-client (14+238) ... 2023-10-08T11:58:49.004 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-10-08T11:58:49.155 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up postgresql-common (238) ... 2023-10-08T11:58:49.248 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package postgresql-contrib. 2023-10-08T11:58:49.262 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-10-08T11:58:49.306 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking postgresql-contrib (14+238) ... 2023-10-08T11:58:49.583 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package tcl8.6. 2023-10-08T11:58:49.597 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-10-08T11:58:49.621 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package postgresql-common. 2023-10-08T11:58:49.633 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-10-08T11:58:49.644 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-10-08T11:58:49.706 INFO:teuthology.orchestra.run.smithi062.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-10-08T11:58:49.753 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking postgresql-common (238) ... 2023-10-08T11:58:49.869 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package tcl. 2023-10-08T11:58:49.883 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-10-08T11:58:49.931 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-10-08T11:58:50.055 INFO:teuthology.orchestra.run.smithi130.stdout:Adding user postgres to group ssl-cert 2023-10-08T11:58:50.230 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package wpasupplicant. 2023-10-08T11:58:50.247 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-10-08T11:58:50.263 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-08T11:58:50.263 INFO:teuthology.orchestra.run.smithi130.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-10-08T11:58:50.280 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-10-08T11:58:50.371 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package postgresql-14. 2023-10-08T11:58:50.395 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../29-postgresql-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-10-08T11:58:50.441 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-10-08T11:58:50.447 INFO:teuthology.orchestra.run.smithi130.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-10-08T11:58:50.448 INFO:teuthology.orchestra.run.smithi130.stdout:Removing obsolete dictionary files: 2023-10-08T11:58:50.634 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-10-08T11:58:50.648 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-10-08T11:58:50.692 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-10-08T11:58:51.070 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package usb-modeswitch. 2023-10-08T11:58:51.078 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-10-08T11:58:51.085 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-10-08T11:58:51.136 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-10-08T11:58:51.429 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up postgresql-client-common (238) ... 2023-10-08T11:58:51.524 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-10-08T11:58:51.659 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up flex (2.6.4-8build2) ... 2023-10-08T11:58:51.732 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package postgresql. 2023-10-08T11:58:51.746 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-10-08T11:58:51.786 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-10-08T11:58:51.790 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking postgresql (14+238) ... 2023-10-08T11:58:51.849 INFO:teuthology.orchestra.run.smithi130.stdout:Creating new PostgreSQL cluster 14/main ... 2023-10-08T11:58:51.880 INFO:teuthology.orchestra.run.smithi130.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-10-08T11:58:51.911 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-10-08T11:58:51.971 INFO:teuthology.orchestra.run.smithi130.stdout:The files belonging to this database system will be owned by user "postgres". 2023-10-08T11:58:51.971 INFO:teuthology.orchestra.run.smithi130.stdout:This user must also own the server process. 2023-10-08T11:58:51.971 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-08T11:58:51.972 INFO:teuthology.orchestra.run.smithi130.stdout:The database cluster will be initialized with locale "en_US". 2023-10-08T11:58:51.972 INFO:teuthology.orchestra.run.smithi130.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-10-08T11:58:51.972 INFO:teuthology.orchestra.run.smithi130.stdout:The default text search configuration will be set to "english". 2023-10-08T11:58:51.972 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-08T11:58:51.973 INFO:teuthology.orchestra.run.smithi130.stdout:Data page checksums are disabled. 2023-10-08T11:58:51.973 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-08T11:58:51.973 INFO:teuthology.orchestra.run.smithi130.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-10-08T11:58:51.973 INFO:teuthology.orchestra.run.smithi130.stdout:creating subdirectories ... ok 2023-10-08T11:58:51.973 INFO:teuthology.orchestra.run.smithi130.stdout:selecting dynamic shared memory implementation ... posix 2023-10-08T11:58:51.989 INFO:teuthology.orchestra.run.smithi130.stdout:selecting default max_connections ... 100 2023-10-08T11:58:52.010 INFO:teuthology.orchestra.run.smithi130.stdout:selecting default shared_buffers ... 128MB 2023-10-08T11:58:52.020 INFO:teuthology.orchestra.run.smithi130.stdout:selecting default time zone ... Etc/UTC 2023-10-08T11:58:52.021 INFO:teuthology.orchestra.run.smithi130.stdout:creating configuration files ... ok 2023-10-08T11:58:52.037 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-10-08T11:58:52.060 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package postgresql-client. 2023-10-08T11:58:52.074 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-10-08T11:58:52.110 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking postgresql-client (14+238) ... 2023-10-08T11:58:52.134 INFO:teuthology.orchestra.run.smithi130.stdout:running bootstrap script ... ok 2023-10-08T11:58:52.164 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-10-08T11:58:52.389 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-10-08T11:58:52.395 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package postgresql-contrib. 2023-10-08T11:58:52.409 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-10-08T11:58:52.470 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking postgresql-contrib (14+238) ... 2023-10-08T11:58:52.775 INFO:teuthology.orchestra.run.smithi130.stdout:performing post-bootstrap initialization ... ok 2023-10-08T11:58:52.857 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package tcl8.6. 2023-10-08T11:58:52.879 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-10-08T11:58:52.923 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-10-08T11:58:53.243 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package tcl. 2023-10-08T11:58:53.265 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-10-08T11:58:53.339 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-10-08T11:58:53.413 INFO:teuthology.orchestra.run.smithi156.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-10-08T11:58:53.511 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-10-08T11:58:53.569 INFO:teuthology.orchestra.run.smithi130.stdout:syncing data to disk ... ok 2023-10-08T11:58:53.721 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package wpasupplicant. 2023-10-08T11:58:53.744 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-10-08T11:58:53.787 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-10-08T11:58:53.888 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-08T11:58:53.888 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-08T11:58:54.012 INFO:teuthology.orchestra.run.smithi130.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-10-08T11:58:54.192 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-10-08T11:58:54.205 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-10-08T11:58:54.242 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-10-08T11:58:54.631 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-10-08T11:58:54.654 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package usb-modeswitch. 2023-10-08T11:58:54.676 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-10-08T11:58:54.720 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-10-08T11:58:54.749 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-10-08T11:58:54.849 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-10-08T11:58:54.951 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-10-08T11:58:55.005 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up postgresql-client-common (238) ... 2023-10-08T11:58:55.068 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-10-08T11:58:55.194 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-10-08T11:58:55.243 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up flex (2.6.4-8build2) ... 2023-10-08T11:58:55.320 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-10-08T11:58:55.395 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-10-08T11:58:55.520 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-10-08T11:58:55.671 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-10-08T11:58:55.773 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-10-08T11:58:55.933 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-10-08T11:58:55.993 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-10-08T11:58:56.093 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up dump (0.4b47-3) ... 2023-10-08T11:58:56.188 INFO:teuthology.orchestra.run.smithi156.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-10-08T11:58:56.253 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-10-08T11:58:56.379 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-10-08T11:58:56.471 INFO:teuthology.orchestra.run.smithi062.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-10-08T11:58:56.522 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up tcl (8.6.11+1build2) ... 2023-10-08T11:58:56.588 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-10-08T11:58:56.647 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libjson-perl (4.04000-1) ... 2023-10-08T11:58:56.807 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-10-08T11:58:56.822 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-10-08T11:58:56.897 INFO:teuthology.orchestra.run.smithi156.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-10-08T11:58:56.940 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up postgresql-contrib (14+238) ... 2023-10-08T11:58:56.967 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-10-08T11:58:56.977 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-08T11:58:56.977 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-08T11:58:57.050 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up postgresql (14+238) ... 2023-10-08T11:58:57.067 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-10-08T11:58:57.151 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-10-08T11:58:57.227 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-10-08T11:58:57.252 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-10-08T11:58:57.353 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-10-08T11:58:57.507 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-10-08T11:58:57.507 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-10-08T11:58:57.529 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-10-08T11:58:57.532 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-10-08T11:58:57.697 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up postgresql-client (14+238) ... 2023-10-08T11:58:57.700 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-10-08T11:58:57.832 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-10-08T11:58:57.835 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-10-08T11:58:58.069 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-10-08T11:58:58.113 INFO:teuthology.orchestra.run.smithi130.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-10-08T11:58:58.237 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-10-08T11:58:58.397 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-10-08T11:58:58.423 INFO:teuthology.orchestra.run.smithi130.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-10-08T11:58:58.498 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-10-08T11:58:58.592 INFO:teuthology.orchestra.run.smithi130.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-10-08T11:58:58.767 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-10-08T11:58:58.767 INFO:teuthology.orchestra.run.smithi156.stdout:The following network interfaces were found in /etc/network/interfaces 2023-10-08T11:58:58.767 INFO:teuthology.orchestra.run.smithi156.stdout:which means they are currently configured by ifupdown: 2023-10-08T11:58:58.767 INFO:teuthology.orchestra.run.smithi156.stdout:- enp3s0f1 2023-10-08T11:58:58.767 INFO:teuthology.orchestra.run.smithi156.stdout:If you want to manage those interfaces with NetworkManager instead 2023-10-08T11:58:58.767 INFO:teuthology.orchestra.run.smithi156.stdout:remove their configuration from /etc/network/interfaces. 2023-10-08T11:58:58.767 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-10-08T11:58:58.899 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-10-08T11:58:59.300 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-10-08T11:58:59.345 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-10-08T11:58:59.471 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up dump (0.4b47-3) ... 2023-10-08T11:58:59.600 INFO:teuthology.orchestra.run.smithi062.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-10-08T11:58:59.665 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-10-08T11:58:59.714 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-10-08T11:58:59.791 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-10-08T11:58:59.942 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up tcl (8.6.11+1build2) ... 2023-10-08T11:58:59.979 INFO:teuthology.orchestra.run.smithi130.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-10-08T11:59:00.068 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libjson-perl (4.04000-1) ... 2023-10-08T11:59:00.079 INFO:teuthology.orchestra.run.smithi130.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-10-08T11:59:00.227 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-10-08T11:59:00.319 INFO:teuthology.orchestra.run.smithi062.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-10-08T11:59:00.379 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-10-08T11:59:00.426 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-10-08T11:59:00.538 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-10-08T11:59:00.552 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-10-08T11:59:00.686 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-10-08T11:59:00.689 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-10-08T11:59:00.750 INFO:teuthology.orchestra.run.smithi130.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-08T11:59:00.753 DEBUG:teuthology.parallel:result is None 2023-10-08T11:59:00.837 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up postgresql-common (238) ... 2023-10-08T11:59:00.841 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-10-08T11:59:00.967 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-10-08T11:59:01.177 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up postgresql-client (14+238) ... 2023-10-08T11:59:01.345 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-10-08T11:59:01.649 INFO:teuthology.orchestra.run.smithi156.stdout:Adding user postgres to group ssl-cert 2023-10-08T11:59:01.865 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T11:59:01.865 INFO:teuthology.orchestra.run.smithi062.stdout:The following network interfaces were found in /etc/network/interfaces 2023-10-08T11:59:01.865 INFO:teuthology.orchestra.run.smithi062.stdout:which means they are currently configured by ifupdown: 2023-10-08T11:59:01.865 INFO:teuthology.orchestra.run.smithi062.stdout:- enp3s0f1 2023-10-08T11:59:01.866 INFO:teuthology.orchestra.run.smithi062.stdout:If you want to manage those interfaces with NetworkManager instead 2023-10-08T11:59:01.866 INFO:teuthology.orchestra.run.smithi062.stdout:remove their configuration from /etc/network/interfaces. 2023-10-08T11:59:01.866 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T11:59:01.910 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-10-08T11:59:01.910 INFO:teuthology.orchestra.run.smithi156.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-10-08T11:59:01.999 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-10-08T11:59:02.172 INFO:teuthology.orchestra.run.smithi156.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-10-08T11:59:02.172 INFO:teuthology.orchestra.run.smithi156.stdout:Removing obsolete dictionary files: 2023-10-08T11:59:02.401 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-10-08T11:59:02.763 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-10-08T11:59:02.872 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-10-08T11:59:03.314 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-10-08T11:59:03.381 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-10-08T11:59:03.724 INFO:teuthology.orchestra.run.smithi156.stdout:Creating new PostgreSQL cluster 14/main ... 2023-10-08T11:59:03.742 INFO:teuthology.orchestra.run.smithi156.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-10-08T11:59:03.797 INFO:teuthology.orchestra.run.smithi156.stdout:The files belonging to this database system will be owned by user "postgres". 2023-10-08T11:59:03.797 INFO:teuthology.orchestra.run.smithi156.stdout:This user must also own the server process. 2023-10-08T11:59:03.797 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-10-08T11:59:03.797 INFO:teuthology.orchestra.run.smithi156.stdout:The database cluster will be initialized with locale "en_US". 2023-10-08T11:59:03.798 INFO:teuthology.orchestra.run.smithi156.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-10-08T11:59:03.798 INFO:teuthology.orchestra.run.smithi156.stdout:The default text search configuration will be set to "english". 2023-10-08T11:59:03.798 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-10-08T11:59:03.798 INFO:teuthology.orchestra.run.smithi156.stdout:Data page checksums are disabled. 2023-10-08T11:59:03.798 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-10-08T11:59:03.798 INFO:teuthology.orchestra.run.smithi156.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-10-08T11:59:03.799 INFO:teuthology.orchestra.run.smithi156.stdout:creating subdirectories ... ok 2023-10-08T11:59:03.799 INFO:teuthology.orchestra.run.smithi156.stdout:selecting dynamic shared memory implementation ... posix 2023-10-08T11:59:03.822 INFO:teuthology.orchestra.run.smithi156.stdout:selecting default max_connections ... 100 2023-10-08T11:59:03.833 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-10-08T11:59:03.857 INFO:teuthology.orchestra.run.smithi156.stdout:selecting default shared_buffers ... 128MB 2023-10-08T11:59:03.871 INFO:teuthology.orchestra.run.smithi156.stdout:selecting default time zone ... Etc/UTC 2023-10-08T11:59:03.871 INFO:teuthology.orchestra.run.smithi156.stdout:creating configuration files ... ok 2023-10-08T11:59:04.001 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-10-08T11:59:04.047 INFO:teuthology.orchestra.run.smithi156.stdout:running bootstrap script ... ok 2023-10-08T11:59:04.127 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up postgresql-common (238) ... 2023-10-08T11:59:04.673 INFO:teuthology.orchestra.run.smithi156.stdout:performing post-bootstrap initialization ... ok 2023-10-08T11:59:05.144 INFO:teuthology.orchestra.run.smithi062.stdout:Adding user postgres to group ssl-cert 2023-10-08T11:59:05.219 INFO:teuthology.orchestra.run.smithi156.stdout:syncing data to disk ... ok 2023-10-08T11:59:05.374 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T11:59:05.375 INFO:teuthology.orchestra.run.smithi062.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-10-08T11:59:05.565 INFO:teuthology.orchestra.run.smithi062.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-10-08T11:59:05.565 INFO:teuthology.orchestra.run.smithi062.stdout:Removing obsolete dictionary files: 2023-10-08T11:59:05.726 INFO:teuthology.orchestra.run.smithi156.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-10-08T11:59:06.160 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-10-08T11:59:06.596 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-10-08T11:59:07.047 INFO:teuthology.orchestra.run.smithi062.stdout:Creating new PostgreSQL cluster 14/main ... 2023-10-08T11:59:07.067 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-10-08T11:59:07.117 INFO:teuthology.orchestra.run.smithi062.stdout:The files belonging to this database system will be owned by user "postgres". 2023-10-08T11:59:07.118 INFO:teuthology.orchestra.run.smithi062.stdout:This user must also own the server process. 2023-10-08T11:59:07.118 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T11:59:07.118 INFO:teuthology.orchestra.run.smithi062.stdout:The database cluster will be initialized with locale "en_US". 2023-10-08T11:59:07.118 INFO:teuthology.orchestra.run.smithi062.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-10-08T11:59:07.118 INFO:teuthology.orchestra.run.smithi062.stdout:The default text search configuration will be set to "english". 2023-10-08T11:59:07.119 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T11:59:07.119 INFO:teuthology.orchestra.run.smithi062.stdout:Data page checksums are disabled. 2023-10-08T11:59:07.119 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T11:59:07.119 INFO:teuthology.orchestra.run.smithi062.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-10-08T11:59:07.119 INFO:teuthology.orchestra.run.smithi062.stdout:creating subdirectories ... ok 2023-10-08T11:59:07.119 INFO:teuthology.orchestra.run.smithi062.stdout:selecting dynamic shared memory implementation ... posix 2023-10-08T11:59:07.130 INFO:teuthology.orchestra.run.smithi062.stdout:selecting default max_connections ... 100 2023-10-08T11:59:07.153 INFO:teuthology.orchestra.run.smithi062.stdout:selecting default shared_buffers ... 128MB 2023-10-08T11:59:07.163 INFO:teuthology.orchestra.run.smithi062.stdout:selecting default time zone ... Etc/UTC 2023-10-08T11:59:07.164 INFO:teuthology.orchestra.run.smithi062.stdout:creating configuration files ... ok 2023-10-08T11:59:07.277 INFO:teuthology.orchestra.run.smithi062.stdout:running bootstrap script ... ok 2023-10-08T11:59:07.956 INFO:teuthology.orchestra.run.smithi062.stdout:performing post-bootstrap initialization ... ok 2023-10-08T11:59:08.740 INFO:teuthology.orchestra.run.smithi062.stdout:syncing data to disk ... ok 2023-10-08T11:59:08.805 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-10-08T11:59:08.939 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up postgresql-contrib (14+238) ... 2023-10-08T11:59:09.065 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up postgresql (14+238) ... 2023-10-08T11:59:09.152 INFO:teuthology.orchestra.run.smithi062.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-10-08T11:59:09.191 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-10-08T11:59:09.300 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-10-08T11:59:09.533 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-10-08T11:59:09.533 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-10-08T11:59:10.286 INFO:teuthology.orchestra.run.smithi156.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-10-08T11:59:10.621 INFO:teuthology.orchestra.run.smithi156.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-10-08T11:59:10.756 INFO:teuthology.orchestra.run.smithi156.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-10-08T11:59:11.961 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-10-08T11:59:12.087 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up postgresql-contrib (14+238) ... 2023-10-08T11:59:12.167 INFO:teuthology.orchestra.run.smithi156.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-10-08T11:59:12.230 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up postgresql (14+238) ... 2023-10-08T11:59:12.292 INFO:teuthology.orchestra.run.smithi156.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-10-08T11:59:12.339 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-10-08T11:59:12.499 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-10-08T11:59:12.761 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-10-08T11:59:12.761 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-10-08T11:59:12.991 INFO:teuthology.orchestra.run.smithi156.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-08T11:59:12.995 DEBUG:teuthology.parallel:result is None 2023-10-08T11:59:13.377 INFO:teuthology.orchestra.run.smithi062.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-10-08T11:59:13.696 INFO:teuthology.orchestra.run.smithi062.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-10-08T11:59:13.847 INFO:teuthology.orchestra.run.smithi062.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-10-08T11:59:15.518 INFO:teuthology.orchestra.run.smithi062.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-10-08T11:59:15.618 INFO:teuthology.orchestra.run.smithi062.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-10-08T11:59:16.313 INFO:teuthology.orchestra.run.smithi062.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-08T11:59:16.316 DEBUG:teuthology.parallel:result is None 2023-10-08T11:59:16.316 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7b3143bae3b6870a749bfb9810ed6e7d0e89d7de 2023-10-08T11:59:16.494 DEBUG:teuthology.orchestra.run.smithi062:> dpkg-query -W -f '${Version}' ceph 2023-10-08T11:59:16.511 INFO:teuthology.orchestra.run.smithi062.stdout:18.0.0-6639-g7b3143ba-1jammy 2023-10-08T11:59:16.511 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6639-g7b3143ba-1jammy 2023-10-08T11:59:16.512 INFO:teuthology.task.install:The correct ceph version 18.0.0-6639-g7b3143ba-1jammy is installed. 2023-10-08T11:59:16.512 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7b3143bae3b6870a749bfb9810ed6e7d0e89d7de 2023-10-08T11:59:16.737 DEBUG:teuthology.orchestra.run.smithi130:> dpkg-query -W -f '${Version}' ceph 2023-10-08T11:59:16.757 INFO:teuthology.orchestra.run.smithi130.stdout:18.0.0-6639-g7b3143ba-1jammy 2023-10-08T11:59:16.758 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6639-g7b3143ba-1jammy 2023-10-08T11:59:16.758 INFO:teuthology.task.install:The correct ceph version 18.0.0-6639-g7b3143ba-1jammy is installed. 2023-10-08T11:59:16.758 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7b3143bae3b6870a749bfb9810ed6e7d0e89d7de 2023-10-08T11:59:16.906 DEBUG:teuthology.orchestra.run.smithi156:> dpkg-query -W -f '${Version}' ceph 2023-10-08T11:59:16.930 INFO:teuthology.orchestra.run.smithi156.stdout:18.0.0-6639-g7b3143ba-1jammy 2023-10-08T11:59:16.930 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6639-g7b3143ba-1jammy 2023-10-08T11:59:16.931 INFO:teuthology.task.install:The correct ceph version 18.0.0-6639-g7b3143ba-1jammy is installed. 2023-10-08T11:59:16.931 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-08T11:59:16.931 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-10-08T11:59:16.931 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-08T11:59:16.946 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-08T11:59:16.947 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-08T11:59:16.962 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-10-08T11:59:16.962 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-08T11:59:16.998 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-08T11:59:16.998 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-10-08T11:59:16.998 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/usr/bin/daemon-helper 2023-10-08T11:59:17.011 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-08T11:59:17.065 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-08T11:59:17.066 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/usr/bin/daemon-helper 2023-10-08T11:59:17.079 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-08T11:59:17.133 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-10-08T11:59:17.133 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/usr/bin/daemon-helper 2023-10-08T11:59:17.155 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-08T11:59:17.220 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-08T11:59:17.221 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-10-08T11:59:17.221 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-08T11:59:17.235 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-08T11:59:17.290 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-08T11:59:17.290 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-08T11:59:17.303 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-08T11:59:17.357 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-10-08T11:59:17.358 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-08T11:59:17.381 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-08T11:59:17.445 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-08T11:59:17.445 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-10-08T11:59:17.445 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/usr/bin/stdin-killer 2023-10-08T11:59:17.460 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-08T11:59:17.516 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-08T11:59:17.516 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/usr/bin/stdin-killer 2023-10-08T11:59:17.534 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-08T11:59:17.595 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-10-08T11:59:17.595 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/usr/bin/stdin-killer 2023-10-08T11:59:17.619 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-08T11:59:17.685 INFO:teuthology.run_tasks:Running task ceph... 2023-10-08T11:59:17.760 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-08T11:59:17.761 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 777 /var/log/ceph 2023-10-08T11:59:17.765 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 777 /var/log/ceph 2023-10-08T11:59:17.769 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod 777 /var/log/ceph 2023-10-08T11:59:17.792 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-08T11:59:17.793 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-08T11:59:17.825 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-08T11:59:17.832 DEBUG:teuthology.orchestra.run.smithi156:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-08T11:59:17.858 INFO:tasks.ceph:Creating extra log directories... 2023-10-08T11:59:17.858 DEBUG:teuthology.orchestra.run.smithi062:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-08T11:59:17.883 DEBUG:teuthology.orchestra.run.smithi130:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-08T11:59:17.887 DEBUG:teuthology.orchestra.run.smithi156:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-08T11:59:17.927 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-10-08T11:59:17.929 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-10-08T11:59:17.929 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-10-08T11:59:17.930 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-10-08T11:59:17.930 DEBUG:teuthology.orchestra.run.smithi062:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-08T11:59:17.942 DEBUG:teuthology.orchestra.run.smithi062:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-08T11:59:18.018 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-08T11:59:18.018 DEBUG:teuthology.orchestra.run.smithi130:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-08T11:59:18.024 DEBUG:teuthology.orchestra.run.smithi130:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-08T11:59:18.096 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-10-08T11:59:18.096 DEBUG:teuthology.orchestra.run.smithi156:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-08T11:59:18.106 DEBUG:teuthology.orchestra.run.smithi156:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-08T11:59:18.204 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-08T11:59:18.204 INFO:tasks.ceph:config {'conf': {'global': {'mon pg warn min per osd': 0, 'ms die on skipped message': False}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-08T11:59:18.204 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417909', 'branch': 'wip-batrick-testing-20231007.154158', 'description': 'fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down pg-warn} tasks/{0-client 1-tests/fscrypt-common}}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7417909', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-batrick-testing-20231007.154158'}, 'ceph': {'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'global': {'mon pg warn min per osd': 0, 'ms die on skipped message': False}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '7b3143bae3b6870a749bfb9810ed6e7d0e89d7de'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '7b3143bae3b6870a749bfb9810ed6e7d0e89d7de'}}, 'kclient': {'syntax': 'v2'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-batrick-testing-20231007.154158', 'sha1': '7b3143bae3b6870a749bfb9810ed6e7d0e89d7de'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 75, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'], ['client.0']], 'seed': 8022, 'sha1': '7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'sleep_before_teardown': 0, 'subset': '128/256', 'suite': 'fs', 'suite_branch': 'wip-batrick-testing-20231007.154158', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi062.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIaUqRNPzeivdAVjFxbTE7aegqU+fsew94mFIIW4Bbrcm+dCuxqbCKl38HqySkaqYTzzpw/J8xgW7f5TdvCZPFI=', 'smithi130.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIji4vv7exnV643mesL2el1iARgG8BVYXW8k+rqmDyCXXRYO0qoq1qd8SQ0ndb4WJWo+zcvGXJKzjZpE5rsCLZ0=', 'smithi156.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOlORvHIdXG0sJbmFe/N9QLhlHbr6DQQcMN4J6HH+Pco0bSoxOugndRHezHtmbyKJXwrplayFWNCdyetZ4wHuG0='}, 'task': None, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '7b3143bae3b6870a749bfb9810ed6e7d0e89d7de'}}, {'ceph': {'create_rbd_pool': False, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'global': {'mon pg warn min per osd': 0, 'ms die on skipped message': False}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_fscrypt']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end', 'if not is_kupstream() then reject() end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '54e62bcbac4e53d9685e08328b790d3b20d71cae', 'timestamp': '2023-10-07_20:01:29', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-08T11:59:18.205 DEBUG:teuthology.orchestra.run.smithi062:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-08T11:59:18.207 DEBUG:teuthology.orchestra.run.smithi130:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-08T11:59:18.209 DEBUG:teuthology.orchestra.run.smithi156:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-08T11:59:18.218 DEBUG:teuthology.orchestra.run.smithi062:> sudo install -d -m0777 -- /var/run/ceph 2023-10-08T11:59:18.255 DEBUG:teuthology.orchestra.run.smithi130:> sudo install -d -m0777 -- /var/run/ceph 2023-10-08T11:59:18.257 DEBUG:teuthology.orchestra.run.smithi156:> sudo install -d -m0777 -- /var/run/ceph 2023-10-08T11:59:18.284 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-10-08T11:59:18.284 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/scratch_devs of=/dev/stdout 2023-10-08T11:59:18.314 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-08T11:59:18.314 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_1 2023-10-08T11:59:18.362 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-08T11:59:18.362 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T11:59:18.362 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 5h/5d Inode: 882 Links: 1 2023-10-08T11:59:18.363 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T11:59:18.363 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2023-10-08 11:52:31.318839487 +0000 2023-10-08T11:59:18.363 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2023-10-08 11:52:30.938842882 +0000 2023-10-08T11:59:18.363 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2023-10-08 11:52:30.938842882 +0000 2023-10-08T11:59:18.363 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: - 2023-10-08T11:59:18.363 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-08T11:59:18.417 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2023-10-08T11:59:18.417 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2023-10-08T11:59:18.417 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000572966 s, 894 kB/s 2023-10-08T11:59:18.418 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-08T11:59:18.467 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_2 2023-10-08T11:59:18.514 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-08T11:59:18.514 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T11:59:18.514 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 5h/5d Inode: 902 Links: 1 2023-10-08T11:59:18.514 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T11:59:18.514 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2023-10-08 11:52:31.950833843 +0000 2023-10-08T11:59:18.514 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2023-10-08 11:52:31.586837094 +0000 2023-10-08T11:59:18.514 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2023-10-08 11:52:31.586837094 +0000 2023-10-08T11:59:18.514 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: - 2023-10-08T11:59:18.515 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-08T11:59:18.572 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2023-10-08T11:59:18.573 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2023-10-08T11:59:18.573 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000563962 s, 908 kB/s 2023-10-08T11:59:18.574 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-08T11:59:18.623 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_3 2023-10-08T11:59:18.670 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-08T11:59:18.670 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T11:59:18.670 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 5h/5d Inode: 914 Links: 1 2023-10-08T11:59:18.670 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T11:59:18.670 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2023-10-08 11:52:32.566828341 +0000 2023-10-08T11:59:18.671 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2023-10-08 11:52:32.194831663 +0000 2023-10-08T11:59:18.671 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2023-10-08 11:52:32.194831663 +0000 2023-10-08T11:59:18.671 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: - 2023-10-08T11:59:18.671 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-08T11:59:18.724 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2023-10-08T11:59:18.725 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2023-10-08T11:59:18.725 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000586099 s, 874 kB/s 2023-10-08T11:59:18.726 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-08T11:59:18.776 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_4 2023-10-08T11:59:18.821 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-08T11:59:18.822 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T11:59:18.822 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 5h/5d Inode: 937 Links: 1 2023-10-08T11:59:18.822 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T11:59:18.822 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2023-10-08 11:52:33.154823088 +0000 2023-10-08T11:59:18.822 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2023-10-08 11:52:32.794826304 +0000 2023-10-08T11:59:18.822 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2023-10-08 11:52:32.794826304 +0000 2023-10-08T11:59:18.822 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: - 2023-10-08T11:59:18.822 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-08T11:59:18.878 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2023-10-08T11:59:18.878 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2023-10-08T11:59:18.878 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000402103 s, 1.3 MB/s 2023-10-08T11:59:18.879 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-08T11:59:18.927 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-08T11:59:18.927 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-08T11:59:18.927 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/scratch_devs of=/dev/stdout 2023-10-08T11:59:18.933 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-08T11:59:18.933 DEBUG:teuthology.orchestra.run.smithi130:> stat /dev/vg_nvme/lv_1 2023-10-08T11:59:18.983 INFO:teuthology.orchestra.run.smithi130.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-08T11:59:18.983 INFO:teuthology.orchestra.run.smithi130.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T11:59:18.983 INFO:teuthology.orchestra.run.smithi130.stdout:Device: 5h/5d Inode: 867 Links: 1 2023-10-08T11:59:18.983 INFO:teuthology.orchestra.run.smithi130.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T11:59:18.983 INFO:teuthology.orchestra.run.smithi130.stdout:Access: 2023-10-08 11:52:25.359573026 +0000 2023-10-08T11:59:18.983 INFO:teuthology.orchestra.run.smithi130.stdout:Modify: 2023-10-08 11:52:24.987576349 +0000 2023-10-08T11:59:18.983 INFO:teuthology.orchestra.run.smithi130.stdout:Change: 2023-10-08 11:52:24.987576349 +0000 2023-10-08T11:59:18.983 INFO:teuthology.orchestra.run.smithi130.stdout: Birth: - 2023-10-08T11:59:18.984 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-08T11:59:19.037 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records in 2023-10-08T11:59:19.037 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records out 2023-10-08T11:59:19.037 INFO:teuthology.orchestra.run.smithi130.stderr:512 bytes copied, 0.000606195 s, 845 kB/s 2023-10-08T11:59:19.038 DEBUG:teuthology.orchestra.run.smithi130:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-08T11:59:19.087 DEBUG:teuthology.orchestra.run.smithi130:> stat /dev/vg_nvme/lv_2 2023-10-08T11:59:19.134 INFO:teuthology.orchestra.run.smithi130.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-08T11:59:19.134 INFO:teuthology.orchestra.run.smithi130.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T11:59:19.134 INFO:teuthology.orchestra.run.smithi130.stdout:Device: 5h/5d Inode: 882 Links: 1 2023-10-08T11:59:19.135 INFO:teuthology.orchestra.run.smithi130.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T11:59:19.135 INFO:teuthology.orchestra.run.smithi130.stdout:Access: 2023-10-08 11:52:25.963567631 +0000 2023-10-08T11:59:19.135 INFO:teuthology.orchestra.run.smithi130.stdout:Modify: 2023-10-08 11:52:25.599570883 +0000 2023-10-08T11:59:19.135 INFO:teuthology.orchestra.run.smithi130.stdout:Change: 2023-10-08 11:52:25.599570883 +0000 2023-10-08T11:59:19.135 INFO:teuthology.orchestra.run.smithi130.stdout: Birth: - 2023-10-08T11:59:19.135 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-08T11:59:19.189 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records in 2023-10-08T11:59:19.189 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records out 2023-10-08T11:59:19.189 INFO:teuthology.orchestra.run.smithi130.stderr:512 bytes copied, 0.000472036 s, 1.1 MB/s 2023-10-08T11:59:19.190 DEBUG:teuthology.orchestra.run.smithi130:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-08T11:59:19.239 DEBUG:teuthology.orchestra.run.smithi130:> stat /dev/vg_nvme/lv_3 2023-10-08T11:59:19.286 INFO:teuthology.orchestra.run.smithi130.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-08T11:59:19.286 INFO:teuthology.orchestra.run.smithi130.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T11:59:19.286 INFO:teuthology.orchestra.run.smithi130.stdout:Device: 5h/5d Inode: 905 Links: 1 2023-10-08T11:59:19.286 INFO:teuthology.orchestra.run.smithi130.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T11:59:19.286 INFO:teuthology.orchestra.run.smithi130.stdout:Access: 2023-10-08 11:52:26.539562487 +0000 2023-10-08T11:59:19.286 INFO:teuthology.orchestra.run.smithi130.stdout:Modify: 2023-10-08 11:52:26.179565702 +0000 2023-10-08T11:59:19.287 INFO:teuthology.orchestra.run.smithi130.stdout:Change: 2023-10-08 11:52:26.179565702 +0000 2023-10-08T11:59:19.287 INFO:teuthology.orchestra.run.smithi130.stdout: Birth: - 2023-10-08T11:59:19.287 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-08T11:59:19.340 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records in 2023-10-08T11:59:19.341 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records out 2023-10-08T11:59:19.341 INFO:teuthology.orchestra.run.smithi130.stderr:512 bytes copied, 0.000500726 s, 1.0 MB/s 2023-10-08T11:59:19.342 DEBUG:teuthology.orchestra.run.smithi130:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-08T11:59:19.391 DEBUG:teuthology.orchestra.run.smithi130:> stat /dev/vg_nvme/lv_4 2023-10-08T11:59:19.438 INFO:teuthology.orchestra.run.smithi130.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-08T11:59:19.438 INFO:teuthology.orchestra.run.smithi130.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T11:59:19.438 INFO:teuthology.orchestra.run.smithi130.stdout:Device: 5h/5d Inode: 920 Links: 1 2023-10-08T11:59:19.438 INFO:teuthology.orchestra.run.smithi130.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T11:59:19.438 INFO:teuthology.orchestra.run.smithi130.stdout:Access: 2023-10-08 11:52:27.115557342 +0000 2023-10-08T11:59:19.438 INFO:teuthology.orchestra.run.smithi130.stdout:Modify: 2023-10-08 11:52:26.763560486 +0000 2023-10-08T11:59:19.438 INFO:teuthology.orchestra.run.smithi130.stdout:Change: 2023-10-08 11:52:26.763560486 +0000 2023-10-08T11:59:19.439 INFO:teuthology.orchestra.run.smithi130.stdout: Birth: - 2023-10-08T11:59:19.439 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-08T11:59:19.492 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records in 2023-10-08T11:59:19.492 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records out 2023-10-08T11:59:19.492 INFO:teuthology.orchestra.run.smithi130.stderr:512 bytes copied, 0.000503643 s, 1.0 MB/s 2023-10-08T11:59:19.493 DEBUG:teuthology.orchestra.run.smithi130:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-08T11:59:19.543 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-08T11:59:19.543 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi062.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi130.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-08T11:59:19.544 INFO:tasks.ceph:Generating config... 2023-10-08T11:59:19.545 INFO:tasks.ceph:[global] mon pg warn min per osd = 0 2023-10-08T11:59:19.545 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-10-08T11:59:19.545 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-08T11:59:19.545 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-08T11:59:19.545 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-08T11:59:19.545 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-08T11:59:19.545 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-08T11:59:19.545 INFO:tasks.ceph:[osd] bdev async discard = True 2023-10-08T11:59:19.546 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-10-08T11:59:19.546 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-10-08T11:59:19.546 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-08T11:59:19.546 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-08T11:59:19.546 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-10-08T11:59:19.546 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-10-08T11:59:19.546 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-08T11:59:19.546 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-08T11:59:19.546 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-10-08T11:59:19.546 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-08T11:59:19.547 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-08T11:59:19.547 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-08T11:59:19.547 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-10-08T11:59:19.547 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-10-08T11:59:19.547 INFO:tasks.ceph:Setting up mon.a... 2023-10-08T11:59:19.547 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-08T11:59:19.585 INFO:teuthology.orchestra.run.smithi062.stdout:creating /etc/ceph/ceph.keyring 2023-10-08T11:59:19.597 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-08T11:59:19.676 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-08T11:59:19.729 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.62'), ('mon.b', '172.21.15.130'), ('mon.c', '[v2:172.21.15.130:3301,v1:172.21.15.130:6790]')] 2023-10-08T11:59:19.730 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.62,172.21.15.130,[v2:172.21.15.130:3301,v1:172.21.15.130:6790]', 'mon pg warn min per osd': 0, 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}} 2023-10-08T11:59:19.730 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-10-08T11:59:19.730 DEBUG:teuthology.orchestra.run.smithi062:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-08T11:59:19.782 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.62 --add b 172.21.15.130 --addv c '[v2:172.21.15.130:3301,v1:172.21.15.130:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-08T11:59:19.868 INFO:teuthology.orchestra.run.smithi062.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-08T11:59:19.869 INFO:teuthology.orchestra.run.smithi062.stdout:monmaptool: generated fsid 3e777930-c2c1-4f2b-a903-c07ee4ca2c52 2023-10-08T11:59:19.869 INFO:teuthology.orchestra.run.smithi062.stdout:setting min_mon_release = pacific 2023-10-08T11:59:19.869 INFO:teuthology.orchestra.run.smithi062.stdout:epoch 0 2023-10-08T11:59:19.869 INFO:teuthology.orchestra.run.smithi062.stdout:fsid 3e777930-c2c1-4f2b-a903-c07ee4ca2c52 2023-10-08T11:59:19.869 INFO:teuthology.orchestra.run.smithi062.stdout:last_changed 2023-10-08T11:59:19.870927+0000 2023-10-08T11:59:19.869 INFO:teuthology.orchestra.run.smithi062.stdout:created 2023-10-08T11:59:19.870927+0000 2023-10-08T11:59:19.869 INFO:teuthology.orchestra.run.smithi062.stdout:min_mon_release 16 (pacific) 2023-10-08T11:59:19.869 INFO:teuthology.orchestra.run.smithi062.stdout:election_strategy: 1 2023-10-08T11:59:19.869 INFO:teuthology.orchestra.run.smithi062.stdout:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2023-10-08T11:59:19.869 INFO:teuthology.orchestra.run.smithi062.stdout:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2023-10-08T11:59:19.870 INFO:teuthology.orchestra.run.smithi062.stdout:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2023-10-08T11:59:19.870 INFO:teuthology.orchestra.run.smithi062.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-08T11:59:19.871 DEBUG:teuthology.orchestra.run.smithi062:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-08T11:59:19.918 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 3e777930-c2c1-4f2b-a903-c07ee4ca2c52... 2023-10-08T11:59:19.918 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-08T11:59:19.962 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-08T11:59:19.965 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-08T11:59:19.989 INFO:teuthology.orchestra.run.smithi062.stdout:[global] 2023-10-08T11:59:19.989 INFO:teuthology.orchestra.run.smithi062.stdout: chdir = "" 2023-10-08T11:59:19.989 INFO:teuthology.orchestra.run.smithi062.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-08T11:59:19.989 INFO:teuthology.orchestra.run.smithi062.stdout: auth supported = cephx 2023-10-08T11:59:19.990 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T11:59:19.990 INFO:teuthology.orchestra.run.smithi062.stdout: filestore xattr use omap = true 2023-10-08T11:59:19.990 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T11:59:19.990 INFO:teuthology.orchestra.run.smithi062.stdout: mon clock drift allowed = 1.000 2023-10-08T11:59:19.990 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T11:59:19.990 INFO:teuthology.orchestra.run.smithi062.stdout: osd crush chooseleaf type = 0 2023-10-08T11:59:19.990 INFO:teuthology.orchestra.run.smithi062.stdout: auth debug = true 2023-10-08T11:59:19.990 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T11:59:19.990 INFO:teuthology.orchestra.run.smithi062.stdout: ms die on old message = true 2023-10-08T11:59:19.990 INFO:teuthology.orchestra.run.smithi062.stdout: ms die on bug = true 2023-10-08T11:59:19.990 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T11:59:19.991 INFO:teuthology.orchestra.run.smithi062.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-08T11:59:19.991 INFO:teuthology.orchestra.run.smithi062.stdout: mon pg warn max object skew = 0 2023-10-08T11:59:19.991 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T11:59:19.991 INFO:teuthology.orchestra.run.smithi062.stdout: # disable pg_autoscaler by default for new pools 2023-10-08T11:59:19.991 INFO:teuthology.orchestra.run.smithi062.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-08T11:59:19.991 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T11:59:19.991 INFO:teuthology.orchestra.run.smithi062.stdout: osd pool default size = 2 2023-10-08T11:59:19.991 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T11:59:19.992 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd allow primary affinity = true 2023-10-08T11:59:19.992 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd allow pg remap = true 2023-10-08T11:59:19.993 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on legacy crush tunables = false 2023-10-08T11:59:19.993 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on crush straw calc version zero = false 2023-10-08T11:59:19.993 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on no sortbitwise = false 2023-10-08T11:59:19.993 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on osd down out interval zero = false 2023-10-08T11:59:19.993 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on too few osds = false 2023-10-08T11:59:19.993 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-08T11:59:19.993 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-08T11:59:19.993 INFO:teuthology.orchestra.run.smithi062.stdout: mon_allow_pool_size_one = true 2023-10-08T11:59:19.993 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T11:59:19.993 INFO:teuthology.orchestra.run.smithi062.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-08T11:59:19.994 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T11:59:19.994 INFO:teuthology.orchestra.run.smithi062.stdout: osd default data pool replay window = 5 2023-10-08T11:59:19.994 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T11:59:19.994 INFO:teuthology.orchestra.run.smithi062.stdout: mon allow pool delete = true 2023-10-08T11:59:19.994 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T11:59:19.994 INFO:teuthology.orchestra.run.smithi062.stdout: mon cluster log file level = debug 2023-10-08T11:59:19.994 INFO:teuthology.orchestra.run.smithi062.stdout: debug asserts on shutdown = true 2023-10-08T11:59:19.994 INFO:teuthology.orchestra.run.smithi062.stdout: mon health detail to clog = false 2023-10-08T11:59:19.994 INFO:teuthology.orchestra.run.smithi062.stdout: mon host = "172.21.15.62,172.21.15.130,[v2:172.21.15.130:3301,v1:172.21.15.130:6790]" 2023-10-08T11:59:19.994 INFO:teuthology.orchestra.run.smithi062.stdout: mon pg warn min per osd = 0 2023-10-08T11:59:19.994 INFO:teuthology.orchestra.run.smithi062.stdout: ms die on skipped message = False 2023-10-08T11:59:19.995 INFO:teuthology.orchestra.run.smithi062.stdout: fsid = 3e777930-c2c1-4f2b-a903-c07ee4ca2c52 2023-10-08T11:59:19.995 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T11:59:19.995 INFO:teuthology.orchestra.run.smithi062.stdout:[osd] 2023-10-08T11:59:19.995 INFO:teuthology.orchestra.run.smithi062.stdout: osd journal size = 100 2023-10-08T11:59:19.995 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T11:59:19.995 INFO:teuthology.orchestra.run.smithi062.stdout: osd scrub load threshold = 5.0 2023-10-08T11:59:19.995 INFO:teuthology.orchestra.run.smithi062.stdout: osd scrub max interval = 600 2023-10-08T11:59:19.995 INFO:teuthology.orchestra.run.smithi062.stdout: osd mclock profile = high_recovery_ops 2023-10-08T11:59:19.995 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T11:59:19.995 INFO:teuthology.orchestra.run.smithi062.stdout: osd recover clone overlap = true 2023-10-08T11:59:19.995 INFO:teuthology.orchestra.run.smithi062.stdout: osd recovery max chunk = 1048576 2023-10-08T11:59:19.995 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T11:59:19.996 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug shutdown = true 2023-10-08T11:59:19.996 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug op order = true 2023-10-08T11:59:19.996 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug verify stray on activate = true 2023-10-08T11:59:19.996 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T11:59:19.996 INFO:teuthology.orchestra.run.smithi062.stdout: osd open classes on start = true 2023-10-08T11:59:19.996 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug pg log writeout = true 2023-10-08T11:59:19.996 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T11:59:19.996 INFO:teuthology.orchestra.run.smithi062.stdout: osd deep scrub update digest min age = 30 2023-10-08T11:59:19.996 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T11:59:19.996 INFO:teuthology.orchestra.run.smithi062.stdout: osd map max advance = 10 2023-10-08T11:59:19.996 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T11:59:19.996 INFO:teuthology.orchestra.run.smithi062.stdout: journal zero on create = true 2023-10-08T11:59:19.997 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T11:59:19.997 INFO:teuthology.orchestra.run.smithi062.stdout: filestore ondisk finisher threads = 3 2023-10-08T11:59:19.997 INFO:teuthology.orchestra.run.smithi062.stdout: filestore apply finisher threads = 3 2023-10-08T11:59:19.997 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T11:59:19.997 INFO:teuthology.orchestra.run.smithi062.stdout: bdev debug aio = true 2023-10-08T11:59:19.997 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug misdirected ops = true 2023-10-08T11:59:19.997 INFO:teuthology.orchestra.run.smithi062.stdout: bdev async discard = True 2023-10-08T11:59:19.997 INFO:teuthology.orchestra.run.smithi062.stdout: bdev enable discard = True 2023-10-08T11:59:19.997 INFO:teuthology.orchestra.run.smithi062.stdout: bluestore allocator = bitmap 2023-10-08T11:59:19.997 INFO:teuthology.orchestra.run.smithi062.stdout: bluestore block size = 96636764160 2023-10-08T11:59:19.997 INFO:teuthology.orchestra.run.smithi062.stdout: bluestore fsck on mount = True 2023-10-08T11:59:19.997 INFO:teuthology.orchestra.run.smithi062.stdout: debug bluefs = 1/20 2023-10-08T11:59:19.998 INFO:teuthology.orchestra.run.smithi062.stdout: debug bluestore = 1/20 2023-10-08T11:59:19.998 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2023-10-08T11:59:19.998 INFO:teuthology.orchestra.run.smithi062.stdout: debug osd = 20 2023-10-08T11:59:19.998 INFO:teuthology.orchestra.run.smithi062.stdout: debug rocksdb = 4/10 2023-10-08T11:59:19.998 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd backfillfull_ratio = 0.85 2023-10-08T11:59:19.998 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd full ratio = 0.9 2023-10-08T11:59:19.998 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd nearfull ratio = 0.8 2023-10-08T11:59:19.998 INFO:teuthology.orchestra.run.smithi062.stdout: osd failsafe full ratio = 0.95 2023-10-08T11:59:19.998 INFO:teuthology.orchestra.run.smithi062.stdout: osd objectstore = bluestore 2023-10-08T11:59:19.998 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T11:59:19.998 INFO:teuthology.orchestra.run.smithi062.stdout:[mgr] 2023-10-08T11:59:19.999 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2023-10-08T11:59:19.999 INFO:teuthology.orchestra.run.smithi062.stdout: debug mgr = 20 2023-10-08T11:59:19.999 INFO:teuthology.orchestra.run.smithi062.stdout: debug mon = 20 2023-10-08T11:59:19.999 INFO:teuthology.orchestra.run.smithi062.stdout: debug auth = 20 2023-10-08T11:59:19.999 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min pgs per osd = 4 2023-10-08T11:59:19.999 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min bytes per osd = 10 2023-10-08T11:59:19.999 INFO:teuthology.orchestra.run.smithi062.stdout: mgr/telemetry/nag = false 2023-10-08T11:59:19.999 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T11:59:19.999 INFO:teuthology.orchestra.run.smithi062.stdout:[mon] 2023-10-08T11:59:19.999 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2023-10-08T11:59:19.999 INFO:teuthology.orchestra.run.smithi062.stdout: debug mon = 20 2023-10-08T11:59:19.999 INFO:teuthology.orchestra.run.smithi062.stdout: debug paxos = 20 2023-10-08T11:59:20.000 INFO:teuthology.orchestra.run.smithi062.stdout: debug auth = 20 2023-10-08T11:59:20.000 INFO:teuthology.orchestra.run.smithi062.stdout: mon data avail warn = 5 2023-10-08T11:59:20.000 INFO:teuthology.orchestra.run.smithi062.stdout: mon mgr mkfs grace = 240 2023-10-08T11:59:20.000 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min pgs per osd = 4 2023-10-08T11:59:20.000 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd reporter subtree level = osd 2023-10-08T11:59:20.000 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd prime pg temp = true 2023-10-08T11:59:20.000 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min bytes per osd = 10 2023-10-08T11:59:20.000 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T11:59:20.000 INFO:teuthology.orchestra.run.smithi062.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-08T11:59:20.000 INFO:teuthology.orchestra.run.smithi062.stdout: auth mon ticket ttl = 660 # 11m 2023-10-08T11:59:20.000 INFO:teuthology.orchestra.run.smithi062.stdout: auth service ticket ttl = 240 # 4m 2023-10-08T11:59:20.000 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T11:59:20.001 INFO:teuthology.orchestra.run.smithi062.stdout: # don't complain about insecure global_id in the test suite 2023-10-08T11:59:20.001 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-08T11:59:20.001 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-08T11:59:20.001 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T11:59:20.001 INFO:teuthology.orchestra.run.smithi062.stdout: # 1m isn't quite enough 2023-10-08T11:59:20.001 INFO:teuthology.orchestra.run.smithi062.stdout: mon_down_mkfs_grace = 2m 2023-10-08T11:59:20.001 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T11:59:20.001 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_filestore_osds = false 2023-10-08T11:59:20.001 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T11:59:20.001 INFO:teuthology.orchestra.run.smithi062.stdout:[client] 2023-10-08T11:59:20.001 INFO:teuthology.orchestra.run.smithi062.stdout: rgw cache enabled = true 2023-10-08T11:59:20.002 INFO:teuthology.orchestra.run.smithi062.stdout: rgw enable ops log = true 2023-10-08T11:59:20.002 INFO:teuthology.orchestra.run.smithi062.stdout: rgw enable usage log = true 2023-10-08T11:59:20.002 INFO:teuthology.orchestra.run.smithi062.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-08T11:59:20.002 INFO:teuthology.orchestra.run.smithi062.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-08T11:59:20.002 INFO:teuthology.orchestra.run.smithi062.stdout:[mon.a] 2023-10-08T11:59:20.002 INFO:teuthology.orchestra.run.smithi062.stdout:[mon.b] 2023-10-08T11:59:20.002 INFO:teuthology.orchestra.run.smithi062.stdout:[mon.c] 2023-10-08T11:59:20.002 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.a] 2023-10-08T11:59:20.002 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.c] 2023-10-08T11:59:20.002 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.b] 2023-10-08T11:59:20.004 INFO:teuthology.orchestra.run.smithi130.stdout:[global] 2023-10-08T11:59:20.004 INFO:teuthology.orchestra.run.smithi130.stdout: chdir = "" 2023-10-08T11:59:20.004 INFO:teuthology.orchestra.run.smithi130.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-08T11:59:20.004 INFO:teuthology.orchestra.run.smithi130.stdout: auth supported = cephx 2023-10-08T11:59:20.005 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-08T11:59:20.005 INFO:teuthology.orchestra.run.smithi130.stdout: filestore xattr use omap = true 2023-10-08T11:59:20.005 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-08T11:59:20.005 INFO:teuthology.orchestra.run.smithi130.stdout: mon clock drift allowed = 1.000 2023-10-08T11:59:20.005 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-08T11:59:20.005 INFO:teuthology.orchestra.run.smithi130.stdout: osd crush chooseleaf type = 0 2023-10-08T11:59:20.005 INFO:teuthology.orchestra.run.smithi130.stdout: auth debug = true 2023-10-08T11:59:20.005 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-08T11:59:20.005 INFO:teuthology.orchestra.run.smithi130.stdout: ms die on old message = true 2023-10-08T11:59:20.005 INFO:teuthology.orchestra.run.smithi130.stdout: ms die on bug = true 2023-10-08T11:59:20.005 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-08T11:59:20.006 INFO:teuthology.orchestra.run.smithi130.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-08T11:59:20.006 INFO:teuthology.orchestra.run.smithi130.stdout: mon pg warn max object skew = 0 2023-10-08T11:59:20.006 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-08T11:59:20.006 INFO:teuthology.orchestra.run.smithi130.stdout: # disable pg_autoscaler by default for new pools 2023-10-08T11:59:20.006 INFO:teuthology.orchestra.run.smithi130.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-08T11:59:20.006 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-08T11:59:20.006 INFO:teuthology.orchestra.run.smithi130.stdout: osd pool default size = 2 2023-10-08T11:59:20.006 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-08T11:59:20.006 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd allow primary affinity = true 2023-10-08T11:59:20.006 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd allow pg remap = true 2023-10-08T11:59:20.006 INFO:teuthology.orchestra.run.smithi130.stdout: mon warn on legacy crush tunables = false 2023-10-08T11:59:20.007 INFO:teuthology.orchestra.run.smithi130.stdout: mon warn on crush straw calc version zero = false 2023-10-08T11:59:20.007 INFO:teuthology.orchestra.run.smithi130.stdout: mon warn on no sortbitwise = false 2023-10-08T11:59:20.007 INFO:teuthology.orchestra.run.smithi130.stdout: mon warn on osd down out interval zero = false 2023-10-08T11:59:20.007 INFO:teuthology.orchestra.run.smithi130.stdout: mon warn on too few osds = false 2023-10-08T11:59:20.007 INFO:teuthology.orchestra.run.smithi130.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-08T11:59:20.007 INFO:teuthology.orchestra.run.smithi130.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-08T11:59:20.007 INFO:teuthology.orchestra.run.smithi130.stdout: mon_allow_pool_size_one = true 2023-10-08T11:59:20.007 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-08T11:59:20.007 INFO:teuthology.orchestra.run.smithi130.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-08T11:59:20.007 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-08T11:59:20.007 INFO:teuthology.orchestra.run.smithi130.stdout: osd default data pool replay window = 5 2023-10-08T11:59:20.007 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-08T11:59:20.008 INFO:teuthology.orchestra.run.smithi130.stdout: mon allow pool delete = true 2023-10-08T11:59:20.008 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-08T11:59:20.008 INFO:teuthology.orchestra.run.smithi130.stdout: mon cluster log file level = debug 2023-10-08T11:59:20.008 INFO:teuthology.orchestra.run.smithi130.stdout: debug asserts on shutdown = true 2023-10-08T11:59:20.008 INFO:teuthology.orchestra.run.smithi130.stdout: mon health detail to clog = false 2023-10-08T11:59:20.008 INFO:teuthology.orchestra.run.smithi130.stdout: mon host = "172.21.15.62,172.21.15.130,[v2:172.21.15.130:3301,v1:172.21.15.130:6790]" 2023-10-08T11:59:20.008 INFO:teuthology.orchestra.run.smithi130.stdout: mon pg warn min per osd = 0 2023-10-08T11:59:20.008 INFO:teuthology.orchestra.run.smithi130.stdout: ms die on skipped message = False 2023-10-08T11:59:20.008 INFO:teuthology.orchestra.run.smithi130.stdout: fsid = 3e777930-c2c1-4f2b-a903-c07ee4ca2c52 2023-10-08T11:59:20.008 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-08T11:59:20.008 INFO:teuthology.orchestra.run.smithi130.stdout:[osd] 2023-10-08T11:59:20.008 INFO:teuthology.orchestra.run.smithi130.stdout: osd journal size = 100 2023-10-08T11:59:20.008 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-08T11:59:20.009 INFO:teuthology.orchestra.run.smithi130.stdout: osd scrub load threshold = 5.0 2023-10-08T11:59:20.009 INFO:teuthology.orchestra.run.smithi130.stdout: osd scrub max interval = 600 2023-10-08T11:59:20.009 INFO:teuthology.orchestra.run.smithi130.stdout: osd mclock profile = high_recovery_ops 2023-10-08T11:59:20.009 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-08T11:59:20.009 INFO:teuthology.orchestra.run.smithi130.stdout: osd recover clone overlap = true 2023-10-08T11:59:20.009 INFO:teuthology.orchestra.run.smithi130.stdout: osd recovery max chunk = 1048576 2023-10-08T11:59:20.009 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-08T11:59:20.009 INFO:teuthology.orchestra.run.smithi130.stdout: osd debug shutdown = true 2023-10-08T11:59:20.009 INFO:teuthology.orchestra.run.smithi130.stdout: osd debug op order = true 2023-10-08T11:59:20.009 INFO:teuthology.orchestra.run.smithi130.stdout: osd debug verify stray on activate = true 2023-10-08T11:59:20.009 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-08T11:59:20.009 INFO:teuthology.orchestra.run.smithi130.stdout: osd open classes on start = true 2023-10-08T11:59:20.010 INFO:teuthology.orchestra.run.smithi130.stdout: osd debug pg log writeout = true 2023-10-08T11:59:20.010 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-08T11:59:20.010 INFO:teuthology.orchestra.run.smithi130.stdout: osd deep scrub update digest min age = 30 2023-10-08T11:59:20.010 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-08T11:59:20.010 INFO:teuthology.orchestra.run.smithi130.stdout: osd map max advance = 10 2023-10-08T11:59:20.010 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-08T11:59:20.010 INFO:teuthology.orchestra.run.smithi130.stdout: journal zero on create = true 2023-10-08T11:59:20.010 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-08T11:59:20.010 INFO:teuthology.orchestra.run.smithi130.stdout: filestore ondisk finisher threads = 3 2023-10-08T11:59:20.010 INFO:teuthology.orchestra.run.smithi130.stdout: filestore apply finisher threads = 3 2023-10-08T11:59:20.010 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-08T11:59:20.011 INFO:teuthology.orchestra.run.smithi130.stdout: bdev debug aio = true 2023-10-08T11:59:20.011 INFO:teuthology.orchestra.run.smithi130.stdout: osd debug misdirected ops = true 2023-10-08T11:59:20.011 INFO:teuthology.orchestra.run.smithi130.stdout: bdev async discard = True 2023-10-08T11:59:20.011 INFO:teuthology.orchestra.run.smithi130.stdout: bdev enable discard = True 2023-10-08T11:59:20.011 INFO:teuthology.orchestra.run.smithi130.stdout: bluestore allocator = bitmap 2023-10-08T11:59:20.011 INFO:teuthology.orchestra.run.smithi130.stdout: bluestore block size = 96636764160 2023-10-08T11:59:20.011 INFO:teuthology.orchestra.run.smithi130.stdout: bluestore fsck on mount = True 2023-10-08T11:59:20.011 INFO:teuthology.orchestra.run.smithi130.stdout: debug bluefs = 1/20 2023-10-08T11:59:20.011 INFO:teuthology.orchestra.run.smithi130.stdout: debug bluestore = 1/20 2023-10-08T11:59:20.011 INFO:teuthology.orchestra.run.smithi130.stdout: debug ms = 1 2023-10-08T11:59:20.011 INFO:teuthology.orchestra.run.smithi130.stdout: debug osd = 20 2023-10-08T11:59:20.011 INFO:teuthology.orchestra.run.smithi130.stdout: debug rocksdb = 4/10 2023-10-08T11:59:20.011 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd backfillfull_ratio = 0.85 2023-10-08T11:59:20.012 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd full ratio = 0.9 2023-10-08T11:59:20.012 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd nearfull ratio = 0.8 2023-10-08T11:59:20.012 INFO:teuthology.orchestra.run.smithi130.stdout: osd failsafe full ratio = 0.95 2023-10-08T11:59:20.012 INFO:teuthology.orchestra.run.smithi130.stdout: osd objectstore = bluestore 2023-10-08T11:59:20.012 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-08T11:59:20.012 INFO:teuthology.orchestra.run.smithi130.stdout:[mgr] 2023-10-08T11:59:20.012 INFO:teuthology.orchestra.run.smithi130.stdout: debug ms = 1 2023-10-08T11:59:20.012 INFO:teuthology.orchestra.run.smithi130.stdout: debug mgr = 20 2023-10-08T11:59:20.012 INFO:teuthology.orchestra.run.smithi130.stdout: debug mon = 20 2023-10-08T11:59:20.012 INFO:teuthology.orchestra.run.smithi130.stdout: debug auth = 20 2023-10-08T11:59:20.012 INFO:teuthology.orchestra.run.smithi130.stdout: mon reweight min pgs per osd = 4 2023-10-08T11:59:20.013 INFO:teuthology.orchestra.run.smithi130.stdout: mon reweight min bytes per osd = 10 2023-10-08T11:59:20.013 INFO:teuthology.orchestra.run.smithi130.stdout: mgr/telemetry/nag = false 2023-10-08T11:59:20.013 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-08T11:59:20.013 INFO:teuthology.orchestra.run.smithi130.stdout:[mon] 2023-10-08T11:59:20.013 INFO:teuthology.orchestra.run.smithi130.stdout: debug ms = 1 2023-10-08T11:59:20.013 INFO:teuthology.orchestra.run.smithi130.stdout: debug mon = 20 2023-10-08T11:59:20.013 INFO:teuthology.orchestra.run.smithi130.stdout: debug paxos = 20 2023-10-08T11:59:20.014 INFO:teuthology.orchestra.run.smithi130.stdout: debug auth = 20 2023-10-08T11:59:20.014 INFO:teuthology.orchestra.run.smithi130.stdout: mon data avail warn = 5 2023-10-08T11:59:20.014 INFO:teuthology.orchestra.run.smithi130.stdout: mon mgr mkfs grace = 240 2023-10-08T11:59:20.014 INFO:teuthology.orchestra.run.smithi130.stdout: mon reweight min pgs per osd = 4 2023-10-08T11:59:20.014 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd reporter subtree level = osd 2023-10-08T11:59:20.014 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd prime pg temp = true 2023-10-08T11:59:20.014 INFO:teuthology.orchestra.run.smithi130.stdout: mon reweight min bytes per osd = 10 2023-10-08T11:59:20.014 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-08T11:59:20.014 INFO:teuthology.orchestra.run.smithi130.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-08T11:59:20.014 INFO:teuthology.orchestra.run.smithi130.stdout: auth mon ticket ttl = 660 # 11m 2023-10-08T11:59:20.014 INFO:teuthology.orchestra.run.smithi130.stdout: auth service ticket ttl = 240 # 4m 2023-10-08T11:59:20.014 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-08T11:59:20.015 INFO:teuthology.orchestra.run.smithi130.stdout: # don't complain about insecure global_id in the test suite 2023-10-08T11:59:20.015 INFO:teuthology.orchestra.run.smithi130.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-08T11:59:20.015 INFO:teuthology.orchestra.run.smithi130.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-08T11:59:20.015 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-08T11:59:20.015 INFO:teuthology.orchestra.run.smithi130.stdout: # 1m isn't quite enough 2023-10-08T11:59:20.015 INFO:teuthology.orchestra.run.smithi130.stdout: mon_down_mkfs_grace = 2m 2023-10-08T11:59:20.015 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-08T11:59:20.015 INFO:teuthology.orchestra.run.smithi130.stdout: mon_warn_on_filestore_osds = false 2023-10-08T11:59:20.015 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-08T11:59:20.015 INFO:teuthology.orchestra.run.smithi130.stdout:[client] 2023-10-08T11:59:20.015 INFO:teuthology.orchestra.run.smithi130.stdout: rgw cache enabled = true 2023-10-08T11:59:20.015 INFO:teuthology.orchestra.run.smithi130.stdout: rgw enable ops log = true 2023-10-08T11:59:20.016 INFO:teuthology.orchestra.run.smithi130.stdout: rgw enable usage log = true 2023-10-08T11:59:20.016 INFO:teuthology.orchestra.run.smithi130.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-08T11:59:20.017 INFO:teuthology.orchestra.run.smithi130.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-08T11:59:20.017 INFO:teuthology.orchestra.run.smithi130.stdout:[mon.a] 2023-10-08T11:59:20.017 INFO:teuthology.orchestra.run.smithi130.stdout:[mon.b] 2023-10-08T11:59:20.017 INFO:teuthology.orchestra.run.smithi130.stdout:[mon.c] 2023-10-08T11:59:20.017 INFO:teuthology.orchestra.run.smithi130.stdout:[mds.a] 2023-10-08T11:59:20.017 INFO:teuthology.orchestra.run.smithi130.stdout:[mds.c] 2023-10-08T11:59:20.017 INFO:teuthology.orchestra.run.smithi130.stdout:[mds.b] 2023-10-08T11:59:20.018 INFO:teuthology.orchestra.run.smithi156.stdout:[global] 2023-10-08T11:59:20.018 INFO:teuthology.orchestra.run.smithi156.stdout: chdir = "" 2023-10-08T11:59:20.018 INFO:teuthology.orchestra.run.smithi156.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-08T11:59:20.018 INFO:teuthology.orchestra.run.smithi156.stdout: auth supported = cephx 2023-10-08T11:59:20.018 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-10-08T11:59:20.018 INFO:teuthology.orchestra.run.smithi156.stdout: filestore xattr use omap = true 2023-10-08T11:59:20.018 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-10-08T11:59:20.018 INFO:teuthology.orchestra.run.smithi156.stdout: mon clock drift allowed = 1.000 2023-10-08T11:59:20.018 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-10-08T11:59:20.018 INFO:teuthology.orchestra.run.smithi156.stdout: osd crush chooseleaf type = 0 2023-10-08T11:59:20.018 INFO:teuthology.orchestra.run.smithi156.stdout: auth debug = true 2023-10-08T11:59:20.019 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-10-08T11:59:20.019 INFO:teuthology.orchestra.run.smithi156.stdout: ms die on old message = true 2023-10-08T11:59:20.019 INFO:teuthology.orchestra.run.smithi156.stdout: ms die on bug = true 2023-10-08T11:59:20.019 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-10-08T11:59:20.019 INFO:teuthology.orchestra.run.smithi156.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-08T11:59:20.019 INFO:teuthology.orchestra.run.smithi156.stdout: mon pg warn max object skew = 0 2023-10-08T11:59:20.019 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-10-08T11:59:20.019 INFO:teuthology.orchestra.run.smithi156.stdout: # disable pg_autoscaler by default for new pools 2023-10-08T11:59:20.019 INFO:teuthology.orchestra.run.smithi156.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-08T11:59:20.019 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-10-08T11:59:20.019 INFO:teuthology.orchestra.run.smithi156.stdout: osd pool default size = 2 2023-10-08T11:59:20.020 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-10-08T11:59:20.020 INFO:teuthology.orchestra.run.smithi156.stdout: mon osd allow primary affinity = true 2023-10-08T11:59:20.020 INFO:teuthology.orchestra.run.smithi156.stdout: mon osd allow pg remap = true 2023-10-08T11:59:20.020 INFO:teuthology.orchestra.run.smithi156.stdout: mon warn on legacy crush tunables = false 2023-10-08T11:59:20.020 INFO:teuthology.orchestra.run.smithi156.stdout: mon warn on crush straw calc version zero = false 2023-10-08T11:59:20.020 INFO:teuthology.orchestra.run.smithi156.stdout: mon warn on no sortbitwise = false 2023-10-08T11:59:20.020 INFO:teuthology.orchestra.run.smithi156.stdout: mon warn on osd down out interval zero = false 2023-10-08T11:59:20.020 INFO:teuthology.orchestra.run.smithi156.stdout: mon warn on too few osds = false 2023-10-08T11:59:20.020 INFO:teuthology.orchestra.run.smithi156.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-08T11:59:20.020 INFO:teuthology.orchestra.run.smithi156.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-08T11:59:20.020 INFO:teuthology.orchestra.run.smithi156.stdout: mon_allow_pool_size_one = true 2023-10-08T11:59:20.020 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-10-08T11:59:20.020 INFO:teuthology.orchestra.run.smithi156.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-08T11:59:20.021 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-10-08T11:59:20.021 INFO:teuthology.orchestra.run.smithi156.stdout: osd default data pool replay window = 5 2023-10-08T11:59:20.021 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-10-08T11:59:20.021 INFO:teuthology.orchestra.run.smithi156.stdout: mon allow pool delete = true 2023-10-08T11:59:20.021 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-10-08T11:59:20.021 INFO:teuthology.orchestra.run.smithi156.stdout: mon cluster log file level = debug 2023-10-08T11:59:20.021 INFO:teuthology.orchestra.run.smithi156.stdout: debug asserts on shutdown = true 2023-10-08T11:59:20.021 INFO:teuthology.orchestra.run.smithi156.stdout: mon health detail to clog = false 2023-10-08T11:59:20.021 INFO:teuthology.orchestra.run.smithi156.stdout: mon host = "172.21.15.62,172.21.15.130,[v2:172.21.15.130:3301,v1:172.21.15.130:6790]" 2023-10-08T11:59:20.021 INFO:teuthology.orchestra.run.smithi156.stdout: mon pg warn min per osd = 0 2023-10-08T11:59:20.021 INFO:teuthology.orchestra.run.smithi156.stdout: ms die on skipped message = False 2023-10-08T11:59:20.021 INFO:teuthology.orchestra.run.smithi156.stdout: fsid = 3e777930-c2c1-4f2b-a903-c07ee4ca2c52 2023-10-08T11:59:20.021 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-10-08T11:59:20.022 INFO:teuthology.orchestra.run.smithi156.stdout:[osd] 2023-10-08T11:59:20.022 INFO:teuthology.orchestra.run.smithi156.stdout: osd journal size = 100 2023-10-08T11:59:20.022 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-10-08T11:59:20.022 INFO:teuthology.orchestra.run.smithi156.stdout: osd scrub load threshold = 5.0 2023-10-08T11:59:20.022 INFO:teuthology.orchestra.run.smithi156.stdout: osd scrub max interval = 600 2023-10-08T11:59:20.022 INFO:teuthology.orchestra.run.smithi156.stdout: osd mclock profile = high_recovery_ops 2023-10-08T11:59:20.022 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-10-08T11:59:20.022 INFO:teuthology.orchestra.run.smithi156.stdout: osd recover clone overlap = true 2023-10-08T11:59:20.022 INFO:teuthology.orchestra.run.smithi156.stdout: osd recovery max chunk = 1048576 2023-10-08T11:59:20.022 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-10-08T11:59:20.022 INFO:teuthology.orchestra.run.smithi156.stdout: osd debug shutdown = true 2023-10-08T11:59:20.022 INFO:teuthology.orchestra.run.smithi156.stdout: osd debug op order = true 2023-10-08T11:59:20.023 INFO:teuthology.orchestra.run.smithi156.stdout: osd debug verify stray on activate = true 2023-10-08T11:59:20.023 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-10-08T11:59:20.023 INFO:teuthology.orchestra.run.smithi156.stdout: osd open classes on start = true 2023-10-08T11:59:20.023 INFO:teuthology.orchestra.run.smithi156.stdout: osd debug pg log writeout = true 2023-10-08T11:59:20.023 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-10-08T11:59:20.023 INFO:teuthology.orchestra.run.smithi156.stdout: osd deep scrub update digest min age = 30 2023-10-08T11:59:20.023 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-10-08T11:59:20.023 INFO:teuthology.orchestra.run.smithi156.stdout: osd map max advance = 10 2023-10-08T11:59:20.023 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-10-08T11:59:20.023 INFO:teuthology.orchestra.run.smithi156.stdout: journal zero on create = true 2023-10-08T11:59:20.023 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-10-08T11:59:20.023 INFO:teuthology.orchestra.run.smithi156.stdout: filestore ondisk finisher threads = 3 2023-10-08T11:59:20.023 INFO:teuthology.orchestra.run.smithi156.stdout: filestore apply finisher threads = 3 2023-10-08T11:59:20.024 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-10-08T11:59:20.024 INFO:teuthology.orchestra.run.smithi156.stdout: bdev debug aio = true 2023-10-08T11:59:20.024 INFO:teuthology.orchestra.run.smithi156.stdout: osd debug misdirected ops = true 2023-10-08T11:59:20.024 INFO:teuthology.orchestra.run.smithi156.stdout: bdev async discard = True 2023-10-08T11:59:20.024 INFO:teuthology.orchestra.run.smithi156.stdout: bdev enable discard = True 2023-10-08T11:59:20.024 INFO:teuthology.orchestra.run.smithi156.stdout: bluestore allocator = bitmap 2023-10-08T11:59:20.024 INFO:teuthology.orchestra.run.smithi156.stdout: bluestore block size = 96636764160 2023-10-08T11:59:20.024 INFO:teuthology.orchestra.run.smithi156.stdout: bluestore fsck on mount = True 2023-10-08T11:59:20.024 INFO:teuthology.orchestra.run.smithi156.stdout: debug bluefs = 1/20 2023-10-08T11:59:20.024 INFO:teuthology.orchestra.run.smithi156.stdout: debug bluestore = 1/20 2023-10-08T11:59:20.024 INFO:teuthology.orchestra.run.smithi156.stdout: debug ms = 1 2023-10-08T11:59:20.024 INFO:teuthology.orchestra.run.smithi156.stdout: debug osd = 20 2023-10-08T11:59:20.025 INFO:teuthology.orchestra.run.smithi156.stdout: debug rocksdb = 4/10 2023-10-08T11:59:20.025 INFO:teuthology.orchestra.run.smithi156.stdout: mon osd backfillfull_ratio = 0.85 2023-10-08T11:59:20.025 INFO:teuthology.orchestra.run.smithi156.stdout: mon osd full ratio = 0.9 2023-10-08T11:59:20.025 INFO:teuthology.orchestra.run.smithi156.stdout: mon osd nearfull ratio = 0.8 2023-10-08T11:59:20.025 INFO:teuthology.orchestra.run.smithi156.stdout: osd failsafe full ratio = 0.95 2023-10-08T11:59:20.025 INFO:teuthology.orchestra.run.smithi156.stdout: osd objectstore = bluestore 2023-10-08T11:59:20.025 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-10-08T11:59:20.025 INFO:teuthology.orchestra.run.smithi156.stdout:[mgr] 2023-10-08T11:59:20.025 INFO:teuthology.orchestra.run.smithi156.stdout: debug ms = 1 2023-10-08T11:59:20.025 INFO:teuthology.orchestra.run.smithi156.stdout: debug mgr = 20 2023-10-08T11:59:20.025 INFO:teuthology.orchestra.run.smithi156.stdout: debug mon = 20 2023-10-08T11:59:20.025 INFO:teuthology.orchestra.run.smithi156.stdout: debug auth = 20 2023-10-08T11:59:20.025 INFO:teuthology.orchestra.run.smithi156.stdout: mon reweight min pgs per osd = 4 2023-10-08T11:59:20.026 INFO:teuthology.orchestra.run.smithi156.stdout: mon reweight min bytes per osd = 10 2023-10-08T11:59:20.026 INFO:teuthology.orchestra.run.smithi156.stdout: mgr/telemetry/nag = false 2023-10-08T11:59:20.026 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-10-08T11:59:20.026 INFO:teuthology.orchestra.run.smithi156.stdout:[mon] 2023-10-08T11:59:20.026 INFO:teuthology.orchestra.run.smithi156.stdout: debug ms = 1 2023-10-08T11:59:20.026 INFO:teuthology.orchestra.run.smithi156.stdout: debug mon = 20 2023-10-08T11:59:20.026 INFO:teuthology.orchestra.run.smithi156.stdout: debug paxos = 20 2023-10-08T11:59:20.026 INFO:teuthology.orchestra.run.smithi156.stdout: debug auth = 20 2023-10-08T11:59:20.026 INFO:teuthology.orchestra.run.smithi156.stdout: mon data avail warn = 5 2023-10-08T11:59:20.026 INFO:teuthology.orchestra.run.smithi156.stdout: mon mgr mkfs grace = 240 2023-10-08T11:59:20.026 INFO:teuthology.orchestra.run.smithi156.stdout: mon reweight min pgs per osd = 4 2023-10-08T11:59:20.026 INFO:teuthology.orchestra.run.smithi156.stdout: mon osd reporter subtree level = osd 2023-10-08T11:59:20.027 INFO:teuthology.orchestra.run.smithi156.stdout: mon osd prime pg temp = true 2023-10-08T11:59:20.027 INFO:teuthology.orchestra.run.smithi156.stdout: mon reweight min bytes per osd = 10 2023-10-08T11:59:20.027 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-10-08T11:59:20.027 INFO:teuthology.orchestra.run.smithi156.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-08T11:59:20.027 INFO:teuthology.orchestra.run.smithi156.stdout: auth mon ticket ttl = 660 # 11m 2023-10-08T11:59:20.027 INFO:teuthology.orchestra.run.smithi156.stdout: auth service ticket ttl = 240 # 4m 2023-10-08T11:59:20.029 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-10-08T11:59:20.029 INFO:teuthology.orchestra.run.smithi156.stdout: # don't complain about insecure global_id in the test suite 2023-10-08T11:59:20.029 INFO:teuthology.orchestra.run.smithi156.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-08T11:59:20.029 INFO:teuthology.orchestra.run.smithi156.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-08T11:59:20.029 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-10-08T11:59:20.029 INFO:teuthology.orchestra.run.smithi156.stdout: # 1m isn't quite enough 2023-10-08T11:59:20.029 INFO:teuthology.orchestra.run.smithi156.stdout: mon_down_mkfs_grace = 2m 2023-10-08T11:59:20.030 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-10-08T11:59:20.030 INFO:teuthology.orchestra.run.smithi156.stdout: mon_warn_on_filestore_osds = false 2023-10-08T11:59:20.030 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-10-08T11:59:20.030 INFO:teuthology.orchestra.run.smithi156.stdout:[client] 2023-10-08T11:59:20.030 INFO:teuthology.orchestra.run.smithi156.stdout: rgw cache enabled = true 2023-10-08T11:59:20.030 INFO:teuthology.orchestra.run.smithi156.stdout: rgw enable ops log = true 2023-10-08T11:59:20.030 INFO:teuthology.orchestra.run.smithi156.stdout: rgw enable usage log = true 2023-10-08T11:59:20.030 INFO:teuthology.orchestra.run.smithi156.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-08T11:59:20.030 INFO:teuthology.orchestra.run.smithi156.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-08T11:59:20.030 INFO:teuthology.orchestra.run.smithi156.stdout:[mon.a] 2023-10-08T11:59:20.030 INFO:teuthology.orchestra.run.smithi156.stdout:[mon.b] 2023-10-08T11:59:20.030 INFO:teuthology.orchestra.run.smithi156.stdout:[mon.c] 2023-10-08T11:59:20.031 INFO:teuthology.orchestra.run.smithi156.stdout:[mds.a] 2023-10-08T11:59:20.031 INFO:teuthology.orchestra.run.smithi156.stdout:[mds.c] 2023-10-08T11:59:20.031 INFO:teuthology.orchestra.run.smithi156.stdout:[mds.b] 2023-10-08T11:59:20.032 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-08T11:59:20.032 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-08T11:59:20.093 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-08T11:59:20.094 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-10-08T11:59:20.094 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-08T11:59:20.099 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-10-08T11:59:20.099 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-08T11:59:20.146 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi062.front.sepia.ceph.com 2023-10-08T11:59:20.146 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-10-08T11:59:20.146 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-08T11:59:20.146 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-08T11:59:20.216 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-10-08T11:59:20.216 DEBUG:teuthology.orchestra.run.smithi062:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-08T11:59:20.273 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi130.front.sepia.ceph.com 2023-10-08T11:59:20.273 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-08T11:59:20.273 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-08T11:59:20.273 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-08T11:59:20.295 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-08T11:59:20.295 DEBUG:teuthology.orchestra.run.smithi130:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-08T11:59:20.342 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi156.front.sepia.ceph.com 2023-10-08T11:59:20.342 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-10-08T11:59:20.342 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-08T11:59:20.342 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-08T11:59:20.379 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-10-08T11:59:20.379 DEBUG:teuthology.orchestra.run.smithi156:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-08T11:59:20.431 INFO:tasks.ceph:Setting up mon nodes... 2023-10-08T11:59:20.431 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-08T11:59:20.432 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-10-08T11:59:20.476 INFO:teuthology.orchestra.run.smithi062.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-10-08T11:59:20.479 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-08T11:59:20.521 INFO:teuthology.orchestra.run.smithi130.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-08T11:59:20.536 INFO:tasks.ceph:Setting up mds nodes... 2023-10-08T11:59:20.536 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-08T11:59:20.580 INFO:teuthology.orchestra.run.smithi062.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-08T11:59:20.583 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-08T11:59:20.637 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-10-08T11:59:20.725 INFO:teuthology.orchestra.run.smithi062.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-10-08T11:59:20.727 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-10-08T11:59:20.781 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-10-08T11:59:20.827 INFO:teuthology.orchestra.run.smithi130.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-10-08T11:59:20.830 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-10-08T11:59:20.843 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-08T11:59:20.843 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-08T11:59:20.891 INFO:teuthology.orchestra.run.smithi156.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-08T11:59:20.925 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-08T11:59:20.925 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi062.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi130.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-08T11:59:20.925 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-08T11:59:20.939 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-08T11:59:20.939 INFO:tasks.ceph:role: osd.0 2023-10-08T11:59:20.939 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi062.front.sepia.ceph.com 2023-10-08T11:59:20.939 DEBUG:teuthology.orchestra.run.smithi062:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-08T11:59:21.001 INFO:teuthology.orchestra.run.smithi062.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T11:59:21.002 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T11:59:21.002 INFO:teuthology.orchestra.run.smithi062.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T11:59:21.002 INFO:teuthology.orchestra.run.smithi062.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-08T11:59:21.002 INFO:teuthology.orchestra.run.smithi062.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T11:59:21.002 INFO:teuthology.orchestra.run.smithi062.stdout: = sunit=0 swidth=0 blks 2023-10-08T11:59:21.002 INFO:teuthology.orchestra.run.smithi062.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T11:59:21.002 INFO:teuthology.orchestra.run.smithi062.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T11:59:21.002 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T11:59:21.003 INFO:teuthology.orchestra.run.smithi062.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T11:59:21.452 INFO:teuthology.orchestra.run.smithi062.stdout:Discarding blocks...Done. 2023-10-08T11:59:21.454 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi062.front.sepia.ceph.com -o noatime 2023-10-08T11:59:21.455 DEBUG:teuthology.orchestra.run.smithi062:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-08T11:59:21.544 DEBUG:teuthology.orchestra.run.smithi062:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-08T11:59:21.594 INFO:teuthology.orchestra.run.smithi062.stderr:sudo: /sbin/restorecon: command not found 2023-10-08T11:59:21.595 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T11:59:21.595 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-08T11:59:21.649 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-08T11:59:21.649 INFO:tasks.ceph:role: osd.1 2023-10-08T11:59:21.649 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi062.front.sepia.ceph.com 2023-10-08T11:59:21.650 DEBUG:teuthology.orchestra.run.smithi062:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-08T11:59:21.714 INFO:teuthology.orchestra.run.smithi062.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T11:59:21.714 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T11:59:21.714 INFO:teuthology.orchestra.run.smithi062.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T11:59:21.714 INFO:teuthology.orchestra.run.smithi062.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-08T11:59:21.714 INFO:teuthology.orchestra.run.smithi062.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T11:59:21.714 INFO:teuthology.orchestra.run.smithi062.stdout: = sunit=0 swidth=0 blks 2023-10-08T11:59:21.714 INFO:teuthology.orchestra.run.smithi062.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T11:59:21.714 INFO:teuthology.orchestra.run.smithi062.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T11:59:21.715 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T11:59:21.715 INFO:teuthology.orchestra.run.smithi062.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T11:59:22.179 INFO:teuthology.orchestra.run.smithi062.stdout:Discarding blocks...Done. 2023-10-08T11:59:22.181 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi062.front.sepia.ceph.com -o noatime 2023-10-08T11:59:22.181 DEBUG:teuthology.orchestra.run.smithi062:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-08T11:59:22.333 DEBUG:teuthology.orchestra.run.smithi062:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-08T11:59:22.345 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T11:59:22.345 INFO:teuthology.orchestra.run.smithi062.stderr:sudo: /sbin/restorecon: command not found 2023-10-08T11:59:22.346 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-08T11:59:22.400 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-08T11:59:22.400 INFO:tasks.ceph:role: osd.2 2023-10-08T11:59:22.400 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi062.front.sepia.ceph.com 2023-10-08T11:59:22.401 DEBUG:teuthology.orchestra.run.smithi062:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-08T11:59:22.461 INFO:teuthology.orchestra.run.smithi062.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T11:59:22.461 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T11:59:22.461 INFO:teuthology.orchestra.run.smithi062.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T11:59:22.461 INFO:teuthology.orchestra.run.smithi062.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-08T11:59:22.462 INFO:teuthology.orchestra.run.smithi062.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T11:59:22.462 INFO:teuthology.orchestra.run.smithi062.stdout: = sunit=0 swidth=0 blks 2023-10-08T11:59:22.462 INFO:teuthology.orchestra.run.smithi062.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T11:59:22.462 INFO:teuthology.orchestra.run.smithi062.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T11:59:22.462 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T11:59:22.462 INFO:teuthology.orchestra.run.smithi062.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T11:59:22.937 INFO:teuthology.orchestra.run.smithi062.stdout:Discarding blocks...Done. 2023-10-08T11:59:22.939 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi062.front.sepia.ceph.com -o noatime 2023-10-08T11:59:22.939 DEBUG:teuthology.orchestra.run.smithi062:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-08T11:59:23.077 DEBUG:teuthology.orchestra.run.smithi062:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-08T11:59:23.089 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T11:59:23.089 INFO:teuthology.orchestra.run.smithi062.stderr:sudo: /sbin/restorecon: command not found 2023-10-08T11:59:23.090 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-08T11:59:23.146 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-08T11:59:23.146 INFO:tasks.ceph:role: osd.3 2023-10-08T11:59:23.146 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi062.front.sepia.ceph.com 2023-10-08T11:59:23.147 DEBUG:teuthology.orchestra.run.smithi062:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-08T11:59:23.209 INFO:teuthology.orchestra.run.smithi062.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T11:59:23.210 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T11:59:23.210 INFO:teuthology.orchestra.run.smithi062.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T11:59:23.210 INFO:teuthology.orchestra.run.smithi062.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-08T11:59:23.210 INFO:teuthology.orchestra.run.smithi062.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T11:59:23.210 INFO:teuthology.orchestra.run.smithi062.stdout: = sunit=0 swidth=0 blks 2023-10-08T11:59:23.210 INFO:teuthology.orchestra.run.smithi062.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T11:59:23.210 INFO:teuthology.orchestra.run.smithi062.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T11:59:23.210 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T11:59:23.210 INFO:teuthology.orchestra.run.smithi062.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T11:59:23.637 INFO:teuthology.orchestra.run.smithi062.stdout:Discarding blocks...Done. 2023-10-08T11:59:23.639 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi062.front.sepia.ceph.com -o noatime 2023-10-08T11:59:23.639 DEBUG:teuthology.orchestra.run.smithi062:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-08T11:59:23.725 DEBUG:teuthology.orchestra.run.smithi062:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-08T11:59:23.735 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T11:59:23.735 INFO:teuthology.orchestra.run.smithi062.stderr:sudo: /sbin/restorecon: command not found 2023-10-08T11:59:23.736 DEBUG:teuthology.orchestra.run.smithi062:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T11:59:23.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:23.841+0000 7fb189bdc640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-08T11:59:23.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:23.841+0000 7fb189bdc640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-08T11:59:23.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:23.841+0000 7fb189bdc640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-08T11:59:23.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:23.841+0000 7fb189bdc640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-08T11:59:23.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:23.841+0000 7fb189bdc640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-08T11:59:23.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:23.841+0000 7fb189bdc640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-10-08T11:59:26.900 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-08T11:59:26.914 DEBUG:teuthology.orchestra.run.smithi062:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T11:59:26.998 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:26.997+0000 7fd9a843c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-08T11:59:26.999 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:26.997+0000 7fd9a843c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-08T11:59:26.999 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:26.997+0000 7fd9a843c640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-08T11:59:26.999 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:26.997+0000 7fd9a843c640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-08T11:59:26.999 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:26.997+0000 7fd9a843c640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-08T11:59:26.999 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:26.997+0000 7fd9a843c640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-10-08T11:59:30.012 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-08T11:59:30.070 DEBUG:teuthology.orchestra.run.smithi062:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T11:59:30.154 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:30.153+0000 7fa6f36ba640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-08T11:59:30.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:30.153+0000 7fa6f36ba640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-08T11:59:30.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:30.153+0000 7fa6f36ba640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-08T11:59:30.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:30.153+0000 7fa6f36ba640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-08T11:59:30.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:30.153+0000 7fa6f36ba640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-08T11:59:30.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:30.153+0000 7fa6f36ba640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-10-08T11:59:33.161 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-08T11:59:33.222 DEBUG:teuthology.orchestra.run.smithi062:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T11:59:33.306 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:33.305+0000 7f8851dd3640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-08T11:59:33.306 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:33.305+0000 7f8851dd3640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-08T11:59:33.306 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:33.305+0000 7f8851dd3640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-08T11:59:33.307 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:33.305+0000 7f8851dd3640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-08T11:59:33.307 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:33.305+0000 7f8851dd3640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-08T11:59:33.307 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:33.305+0000 7f8851dd3640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-10-08T11:59:36.322 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-08T11:59:36.378 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-10-08T11:59:36.392 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-08T11:59:36.392 INFO:tasks.ceph:role: osd.4 2023-10-08T11:59:36.392 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi130.front.sepia.ceph.com 2023-10-08T11:59:36.392 DEBUG:teuthology.orchestra.run.smithi130:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-08T11:59:36.454 INFO:teuthology.orchestra.run.smithi130.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T11:59:36.454 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T11:59:36.454 INFO:teuthology.orchestra.run.smithi130.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T11:59:36.454 INFO:teuthology.orchestra.run.smithi130.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-08T11:59:36.454 INFO:teuthology.orchestra.run.smithi130.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T11:59:36.454 INFO:teuthology.orchestra.run.smithi130.stdout: = sunit=0 swidth=0 blks 2023-10-08T11:59:36.454 INFO:teuthology.orchestra.run.smithi130.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T11:59:36.455 INFO:teuthology.orchestra.run.smithi130.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T11:59:36.455 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T11:59:36.455 INFO:teuthology.orchestra.run.smithi130.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T11:59:36.911 INFO:teuthology.orchestra.run.smithi130.stdout:Discarding blocks...Done. 2023-10-08T11:59:36.912 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi130.front.sepia.ceph.com -o noatime 2023-10-08T11:59:36.913 DEBUG:teuthology.orchestra.run.smithi130:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-10-08T11:59:37.064 DEBUG:teuthology.orchestra.run.smithi130:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-10-08T11:59:37.075 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T11:59:37.075 INFO:teuthology.orchestra.run.smithi130.stderr:sudo: /sbin/restorecon: command not found 2023-10-08T11:59:37.076 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-10-08T11:59:37.129 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-08T11:59:37.129 INFO:tasks.ceph:role: osd.5 2023-10-08T11:59:37.129 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi130.front.sepia.ceph.com 2023-10-08T11:59:37.130 DEBUG:teuthology.orchestra.run.smithi130:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-08T11:59:37.197 INFO:teuthology.orchestra.run.smithi130.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T11:59:37.197 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T11:59:37.197 INFO:teuthology.orchestra.run.smithi130.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T11:59:37.198 INFO:teuthology.orchestra.run.smithi130.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-08T11:59:37.198 INFO:teuthology.orchestra.run.smithi130.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T11:59:37.198 INFO:teuthology.orchestra.run.smithi130.stdout: = sunit=0 swidth=0 blks 2023-10-08T11:59:37.198 INFO:teuthology.orchestra.run.smithi130.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T11:59:37.198 INFO:teuthology.orchestra.run.smithi130.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T11:59:37.198 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T11:59:37.198 INFO:teuthology.orchestra.run.smithi130.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T11:59:37.630 INFO:teuthology.orchestra.run.smithi130.stdout:Discarding blocks...Done. 2023-10-08T11:59:37.632 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi130.front.sepia.ceph.com -o noatime 2023-10-08T11:59:37.633 DEBUG:teuthology.orchestra.run.smithi130:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-10-08T11:59:37.711 DEBUG:teuthology.orchestra.run.smithi130:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-10-08T11:59:37.762 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T11:59:37.763 INFO:teuthology.orchestra.run.smithi130.stderr:sudo: /sbin/restorecon: command not found 2023-10-08T11:59:37.763 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-10-08T11:59:37.816 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-08T11:59:37.816 INFO:tasks.ceph:role: osd.6 2023-10-08T11:59:37.816 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi130.front.sepia.ceph.com 2023-10-08T11:59:37.817 DEBUG:teuthology.orchestra.run.smithi130:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-08T11:59:37.878 INFO:teuthology.orchestra.run.smithi130.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T11:59:37.878 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T11:59:37.878 INFO:teuthology.orchestra.run.smithi130.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T11:59:37.878 INFO:teuthology.orchestra.run.smithi130.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-08T11:59:37.878 INFO:teuthology.orchestra.run.smithi130.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T11:59:37.878 INFO:teuthology.orchestra.run.smithi130.stdout: = sunit=0 swidth=0 blks 2023-10-08T11:59:37.878 INFO:teuthology.orchestra.run.smithi130.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T11:59:37.878 INFO:teuthology.orchestra.run.smithi130.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T11:59:37.878 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T11:59:37.879 INFO:teuthology.orchestra.run.smithi130.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T11:59:38.333 INFO:teuthology.orchestra.run.smithi130.stdout:Discarding blocks...Done. 2023-10-08T11:59:38.335 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi130.front.sepia.ceph.com -o noatime 2023-10-08T11:59:38.335 DEBUG:teuthology.orchestra.run.smithi130:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-10-08T11:59:38.451 DEBUG:teuthology.orchestra.run.smithi130:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-10-08T11:59:38.461 INFO:teuthology.orchestra.run.smithi130.stderr:sudo: /sbin/restorecon: command not found 2023-10-08T11:59:38.462 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T11:59:38.462 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-10-08T11:59:38.517 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-08T11:59:38.518 INFO:tasks.ceph:role: osd.7 2023-10-08T11:59:38.518 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi130.front.sepia.ceph.com 2023-10-08T11:59:38.518 DEBUG:teuthology.orchestra.run.smithi130:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-08T11:59:38.582 INFO:teuthology.orchestra.run.smithi130.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T11:59:38.582 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T11:59:38.582 INFO:teuthology.orchestra.run.smithi130.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T11:59:38.582 INFO:teuthology.orchestra.run.smithi130.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-08T11:59:38.582 INFO:teuthology.orchestra.run.smithi130.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T11:59:38.582 INFO:teuthology.orchestra.run.smithi130.stdout: = sunit=0 swidth=0 blks 2023-10-08T11:59:38.583 INFO:teuthology.orchestra.run.smithi130.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T11:59:38.583 INFO:teuthology.orchestra.run.smithi130.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T11:59:38.583 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T11:59:38.583 INFO:teuthology.orchestra.run.smithi130.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T11:59:39.067 INFO:teuthology.orchestra.run.smithi130.stdout:Discarding blocks...Done. 2023-10-08T11:59:39.069 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi130.front.sepia.ceph.com -o noatime 2023-10-08T11:59:39.070 DEBUG:teuthology.orchestra.run.smithi130:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-10-08T11:59:39.201 DEBUG:teuthology.orchestra.run.smithi130:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-10-08T11:59:39.211 INFO:teuthology.orchestra.run.smithi130.stderr:sudo: /sbin/restorecon: command not found 2023-10-08T11:59:39.212 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T11:59:39.213 DEBUG:teuthology.orchestra.run.smithi130:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T11:59:39.326 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:39.325+0000 7f92cce4a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-10-08T11:59:39.330 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:39.329+0000 7f92cce4a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-10-08T11:59:39.330 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:39.329+0000 7f92cce4a640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-08T11:59:39.330 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:39.329+0000 7f92cce4a640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-08T11:59:39.330 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:39.329+0000 7f92cce4a640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-08T11:59:39.335 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:39.333+0000 7f92cce4a640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-10-08T11:59:42.339 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-10-08T11:59:42.354 DEBUG:teuthology.orchestra.run.smithi130:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T11:59:42.436 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:42.433+0000 7f9420f01640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-10-08T11:59:42.437 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:42.433+0000 7f9420f01640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-10-08T11:59:42.437 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:42.433+0000 7f9420f01640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-08T11:59:42.437 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:42.433+0000 7f9420f01640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-08T11:59:42.437 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:42.433+0000 7f9420f01640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-08T11:59:42.437 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:42.437+0000 7f9420f01640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-10-08T11:59:45.454 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-10-08T11:59:45.510 DEBUG:teuthology.orchestra.run.smithi130:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T11:59:45.594 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:45.593+0000 7f147b34a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-10-08T11:59:45.595 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:45.593+0000 7f147b34a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-10-08T11:59:45.595 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:45.593+0000 7f147b34a640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-08T11:59:45.595 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:45.593+0000 7f147b34a640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-08T11:59:45.595 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:45.593+0000 7f147b34a640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-08T11:59:45.595 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:45.593+0000 7f147b34a640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-10-08T11:59:48.207 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:59:48.209 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:59:48.212 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:59:48.619 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-10-08T11:59:48.633 DEBUG:teuthology.orchestra.run.smithi130:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T11:59:48.715 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:48.713+0000 7fdf84f5f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-10-08T11:59:48.718 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:48.713+0000 7fdf84f5f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-10-08T11:59:48.719 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:48.713+0000 7fdf84f5f640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-08T11:59:48.719 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:48.713+0000 7fdf84f5f640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-08T11:59:48.719 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:48.713+0000 7fdf84f5f640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-08T11:59:48.719 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:48.713+0000 7fdf84f5f640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-10-08T11:59:51.735 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-10-08T11:59:51.794 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-08T11:59:51.794 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-10-08T11:59:51.795 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-10-08T11:59:51.810 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-10-08T11:59:51.810 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-08T11:59:51.868 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-10-08T11:59:51.869 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-10-08T11:59:51.926 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-10-08T11:59:51.927 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-08T11:59:51.981 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-10-08T11:59:51.982 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-08T11:59:52.038 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-10-08T11:59:52.038 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-08T11:59:52.093 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-10-08T11:59:52.093 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-08T11:59:52.149 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-08T11:59:52.150 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-08T11:59:52.163 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-08T11:59:52.163 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-10-08T11:59:52.217 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-08T11:59:52.217 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-10-08T11:59:52.273 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-08T11:59:52.273 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-10-08T11:59:52.325 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-08T11:59:52.325 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-10-08T11:59:52.376 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-08T11:59:52.376 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-10-08T11:59:52.428 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-10-08T11:59:52.428 DEBUG:teuthology.orchestra.run.smithi156:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-08T11:59:52.438 INFO:tasks.ceph:Adding keys to all mons... 2023-10-08T11:59:52.438 DEBUG:teuthology.orchestra.run.smithi062:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-08T11:59:52.440 DEBUG:teuthology.orchestra.run.smithi130:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-08T11:59:52.474 INFO:teuthology.orchestra.run.smithi062.stdout:[mgr.y] 2023-10-08T11:59:52.474 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCYmSJl0HKDHBAArxllDY8oWIw4v3wCk216Tw== 2023-10-08T11:59:52.474 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.a] 2023-10-08T11:59:52.474 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCYmSJlV1m0IhAAit8j5cckFTGj5Ck9pkgdow== 2023-10-08T11:59:52.474 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.c] 2023-10-08T11:59:52.474 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCYmSJlZ7BXKxAACUYVyd3CDiAodvuJf8/TKg== 2023-10-08T11:59:52.475 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.0] 2023-10-08T11:59:52.475 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCbmSJlybBIMhAACXbg4KPq75PvktnaGq1hQQ== 2023-10-08T11:59:52.475 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.1] 2023-10-08T11:59:52.475 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCfmSJlbaoJABAA3XGl48fcJJo1ItCgJhTQ8g== 2023-10-08T11:59:52.475 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.2] 2023-10-08T11:59:52.475 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCimSJlIWRSCRAAZu4ha3rV+cUfFl9c8W+lLA== 2023-10-08T11:59:52.475 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.3] 2023-10-08T11:59:52.475 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQClmSJlH1pgEhAAMSvbx7GwyT05uRpuQTabUA== 2023-10-08T11:59:52.476 INFO:teuthology.orchestra.run.smithi062.stdout:[mgr.x] 2023-10-08T11:59:52.476 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCYmSJl1nIwHxAA6/TWuNto52pYRuPXCrO72Q== 2023-10-08T11:59:52.476 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.b] 2023-10-08T11:59:52.476 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCYmSJlYOBtMRAAWfADuNr0+eolLmNKB9xNpQ== 2023-10-08T11:59:52.476 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.4] 2023-10-08T11:59:52.476 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCrmSJlgUuZExAAQV7ijxzeMNZPD5gv3GnMeg== 2023-10-08T11:59:52.476 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.5] 2023-10-08T11:59:52.476 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCumSJlvlUjGhAA2ZSKh9+qHnSVYMqrjMgpqQ== 2023-10-08T11:59:52.476 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.6] 2023-10-08T11:59:52.476 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCxmSJl3YWJIxAAddhU34JikV7hryh98pmbEg== 2023-10-08T11:59:52.476 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.7] 2023-10-08T11:59:52.476 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQC0mSJlHnrNKhAAOvh0v9xMi33fb/ryK+8/3w== 2023-10-08T11:59:52.477 INFO:teuthology.orchestra.run.smithi062.stdout:[client.0] 2023-10-08T11:59:52.477 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCYmSJlBqVKNRAAty1+t99MyOB+ME+wqN8uCA== 2023-10-08T11:59:52.480 INFO:teuthology.orchestra.run.smithi130.stdout:[mgr.y] 2023-10-08T11:59:52.480 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQCYmSJl0HKDHBAArxllDY8oWIw4v3wCk216Tw== 2023-10-08T11:59:52.480 INFO:teuthology.orchestra.run.smithi130.stdout:[mds.a] 2023-10-08T11:59:52.480 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQCYmSJlV1m0IhAAit8j5cckFTGj5Ck9pkgdow== 2023-10-08T11:59:52.480 INFO:teuthology.orchestra.run.smithi130.stdout:[mds.c] 2023-10-08T11:59:52.480 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQCYmSJlZ7BXKxAACUYVyd3CDiAodvuJf8/TKg== 2023-10-08T11:59:52.480 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.0] 2023-10-08T11:59:52.480 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQCbmSJlybBIMhAACXbg4KPq75PvktnaGq1hQQ== 2023-10-08T11:59:52.480 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.1] 2023-10-08T11:59:52.480 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQCfmSJlbaoJABAA3XGl48fcJJo1ItCgJhTQ8g== 2023-10-08T11:59:52.480 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.2] 2023-10-08T11:59:52.481 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQCimSJlIWRSCRAAZu4ha3rV+cUfFl9c8W+lLA== 2023-10-08T11:59:52.481 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.3] 2023-10-08T11:59:52.481 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQClmSJlH1pgEhAAMSvbx7GwyT05uRpuQTabUA== 2023-10-08T11:59:52.481 INFO:teuthology.orchestra.run.smithi130.stdout:[mgr.x] 2023-10-08T11:59:52.481 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQCYmSJl1nIwHxAA6/TWuNto52pYRuPXCrO72Q== 2023-10-08T11:59:52.481 INFO:teuthology.orchestra.run.smithi130.stdout:[mds.b] 2023-10-08T11:59:52.481 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQCYmSJlYOBtMRAAWfADuNr0+eolLmNKB9xNpQ== 2023-10-08T11:59:52.481 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.4] 2023-10-08T11:59:52.481 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQCrmSJlgUuZExAAQV7ijxzeMNZPD5gv3GnMeg== 2023-10-08T11:59:52.481 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.5] 2023-10-08T11:59:52.481 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQCumSJlvlUjGhAA2ZSKh9+qHnSVYMqrjMgpqQ== 2023-10-08T11:59:52.481 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.6] 2023-10-08T11:59:52.482 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQCxmSJl3YWJIxAAddhU34JikV7hryh98pmbEg== 2023-10-08T11:59:52.482 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.7] 2023-10-08T11:59:52.482 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQC0mSJlHnrNKhAAOvh0v9xMi33fb/ryK+8/3w== 2023-10-08T11:59:52.482 INFO:teuthology.orchestra.run.smithi130.stdout:[client.0] 2023-10-08T11:59:52.482 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQCYmSJlBqVKNRAAty1+t99MyOB+ME+wqN8uCA== 2023-10-08T11:59:52.484 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-08T11:59:52.534 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-08T11:59:52.589 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-08T11:59:52.633 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-08T11:59:52.681 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-08T11:59:52.684 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-08T11:59:52.731 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T11:59:52.771 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T11:59:52.818 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T11:59:52.855 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T11:59:52.903 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T11:59:52.939 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T11:59:52.988 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T11:59:53.022 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T11:59:53.073 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-08T11:59:53.111 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-08T11:59:53.159 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-08T11:59:53.194 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-08T11:59:53.243 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T11:59:53.283 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T11:59:53.331 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T11:59:53.370 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T11:59:53.415 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T11:59:53.418 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T11:59:53.495 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T11:59:53.502 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T11:59:53.574 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-08T11:59:53.588 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-08T11:59:53.660 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-08T11:59:53.660 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-08T11:59:53.674 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-08T11:59:53.781 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-08T11:59:53.793 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-08T11:59:53.807 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-08T11:59:53.904 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-08T11:59:53.916 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-08T11:59:53.968 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-08T11:59:54.063 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-08T11:59:54.073 DEBUG:teuthology.orchestra.run.smithi062:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-08T11:59:54.076 DEBUG:teuthology.orchestra.run.smithi130:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-08T11:59:54.121 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-08T11:59:54.121 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-08T11:59:54.121 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-08T11:59:54.124 INFO:tasks.ceph.mon.a:Started 2023-10-08T11:59:54.124 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-08T11:59:54.124 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-08T11:59:54.167 INFO:tasks.ceph.mon.b:Started 2023-10-08T11:59:54.167 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-08T11:59:54.167 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-08T11:59:54.170 INFO:tasks.ceph.mon.c:Started 2023-10-08T11:59:54.170 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-08T11:59:54.170 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-08T11:59:54.170 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-10-08T11:59:54.173 INFO:tasks.ceph.mgr.y:Started 2023-10-08T11:59:54.173 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-08T11:59:54.173 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-08T11:59:54.175 INFO:tasks.ceph.mgr.x:Started 2023-10-08T11:59:54.175 INFO:tasks.ceph:setting config [client] client_mount_timeout = 600 2023-10-08T11:59:54.176 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph config set client client_mount_timeout 600 2023-10-08T11:59:54.178 INFO:tasks.ceph:setting config [client] debug_client = 20 2023-10-08T11:59:54.178 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph config set client debug_client 20 2023-10-08T11:59:54.226 INFO:tasks.ceph:setting config [client] debug_ms = 1 2023-10-08T11:59:54.226 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph config set client debug_ms 1 2023-10-08T11:59:54.270 INFO:tasks.ceph:setting config [client] rados_mon_op_timeout = 900 2023-10-08T11:59:54.270 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph config set client rados_mon_op_timeout 900 2023-10-08T11:59:54.318 INFO:tasks.ceph:setting config [client] rados_osd_op_timeout = 900 2023-10-08T11:59:54.318 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph config set client rados_osd_op_timeout 900 2023-10-08T11:59:54.362 INFO:tasks.ceph:setting config [mds] debug_mds = 20 2023-10-08T11:59:54.362 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph config set mds debug_mds 20 2023-10-08T11:59:54.406 INFO:tasks.ceph:setting config [mds] debug_mds_balancer = 20 2023-10-08T11:59:54.406 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph config set mds debug_mds_balancer 20 2023-10-08T11:59:54.454 INFO:tasks.ceph:setting config [mds] debug_ms = 1 2023-10-08T11:59:54.454 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph config set mds debug_ms 1 2023-10-08T11:59:54.502 INFO:tasks.ceph:setting config [mds] mds_bal_fragment_size_max = 10000 2023-10-08T11:59:54.502 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph config set mds mds_bal_fragment_size_max 10000 2023-10-08T11:59:54.546 INFO:tasks.ceph:setting config [mds] mds_bal_merge_size = 5 2023-10-08T11:59:54.546 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph config set mds mds_bal_merge_size 5 2023-10-08T11:59:54.590 INFO:tasks.ceph:setting config [mds] mds_bal_split_bits = 3 2023-10-08T11:59:54.590 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph config set mds mds_bal_split_bits 3 2023-10-08T11:59:54.638 INFO:tasks.ceph:setting config [mds] mds_bal_split_size = 100 2023-10-08T11:59:54.638 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph config set mds mds_bal_split_size 100 2023-10-08T11:59:54.686 INFO:tasks.ceph:setting config [mds] mds_debug_frag = True 2023-10-08T11:59:54.686 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph config set mds mds_debug_frag True 2023-10-08T11:59:54.730 INFO:tasks.ceph:setting config [mds] mds_debug_scatterstat = True 2023-10-08T11:59:54.730 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph config set mds mds_debug_scatterstat True 2023-10-08T11:59:54.753 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-08T11:59:54.748+0000 7fed6f59f180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T11:59:54.754 INFO:tasks.ceph:setting config [mds] mds_op_complaint_time = 180 2023-10-08T11:59:54.755 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph config set mds mds_op_complaint_time 180 2023-10-08T11:59:54.795 INFO:tasks.ceph:setting config [mds] mds_verify_scatter = True 2023-10-08T11:59:54.795 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph config set mds mds_verify_scatter True 2023-10-08T11:59:54.811 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.808+0000 7f870effd640 1 -- 172.21.15.62:0/3626138051 <== mon.2 v2:172.21.15.130:3301/0 12 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v7)=0 v7) v1 ==== 109+0+0 (secure 0 0 0) 0x7f8708005020 con 0x7f871806cf00 2023-10-08T11:59:54.812 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.808+0000 7ff766f07640 1 -- 172.21.15.62:0/1664658214 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff7600b9a70 msgr2=0x7ff760099da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:54.812 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.808+0000 7ff766f07640 1 --2- 172.21.15.62:0/1664658214 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff7600b9a70 0x7ff760099da0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff758009bf0 tx=0x7ff75801cae0 comp rx=0 tx=0).stop 2023-10-08T11:59:54.812 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.808+0000 7ff766f07640 1 -- 172.21.15.62:0/1664658214 shutdown_connections 2023-10-08T11:59:54.812 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.808+0000 7ff766f07640 1 --2- 172.21.15.62:0/1664658214 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff7600b9a70 0x7ff760099da0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:54.812 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.808+0000 7ff766f07640 1 -- 172.21.15.62:0/1664658214 >> 172.21.15.62:0/1664658214 conn(0x7ff76009c600 msgr2=0x7ff76009ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T11:59:54.812 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.808+0000 7ff766f07640 1 -- 172.21.15.62:0/1664658214 shutdown_connections 2023-10-08T11:59:54.813 INFO:tasks.ceph:setting config [mds] osd_op_complaint_time = 180 2023-10-08T11:59:54.813 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph config set mds osd_op_complaint_time 180 2023-10-08T11:59:54.814 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.808+0000 7ff766f07640 1 -- 172.21.15.62:0/1664658214 wait complete. 2023-10-08T11:59:54.814 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.812+0000 7ff766f07640 1 Processor -- start 2023-10-08T11:59:54.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.812+0000 7ff766f07640 1 -- start start 2023-10-08T11:59:54.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.812+0000 7ff766f07640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff7600af870 0x7ff76006fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T11:59:54.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.812+0000 7ff766f07640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7600b6d40 0x7ff7601fd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T11:59:54.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.812+0000 7ff766f07640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7600b9a70 0x7ff76009e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T11:59:54.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.812+0000 7ff766f07640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff760087700 con 0x7ff7600b9a70 2023-10-08T11:59:54.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.812+0000 7ff766f07640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7600b23d0 con 0x7ff7600b6d40 2023-10-08T11:59:54.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.812+0000 7ff766f07640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7601fcc90 con 0x7ff7600af870 2023-10-08T11:59:54.816 INFO:tasks.ceph:setting config [mds] rados_mon_op_timeout = 900 2023-10-08T11:59:54.816 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph config set mds rados_mon_op_timeout 900 2023-10-08T11:59:54.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.812+0000 7ff764ca3640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff7600af870 0x7ff76006fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T11:59:54.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.812+0000 7ff75ffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7600b6d40 0x7ff7601fd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T11:59:54.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.812+0000 7ff764ca3640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff7600af870 0x7ff76006fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.62:32850/0 (socket says 172.21.15.62:32850) 2023-10-08T11:59:54.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.812+0000 7ff75ffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7600b6d40 0x7ff7601fd3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.62:39668/0 (socket says 172.21.15.62:39668) 2023-10-08T11:59:54.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.812+0000 7ff764ca3640 1 -- 172.21.15.62:0/668317062 learned_addr learned my addr 172.21.15.62:0/668317062 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T11:59:54.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.812+0000 7ff75ffff640 1 -- 172.21.15.62:0/668317062 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff7600af870 msgr2=0x7ff76006fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:54.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.812+0000 7ff75ffff640 1 --2- 172.21.15.62:0/668317062 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff7600af870 0x7ff76006fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:54.818 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.812+0000 7ff75ffff640 1 -- 172.21.15.62:0/668317062 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7600b9a70 msgr2=0x7ff76009e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:54.818 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.812+0000 7ff75ffff640 1 --2- 172.21.15.62:0/668317062 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7600b9a70 0x7ff76009e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:54.818 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.812+0000 7ff75ffff640 1 -- 172.21.15.62:0/668317062 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff758009820 con 0x7ff7600b6d40 2023-10-08T11:59:54.818 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.812+0000 7ff75ffff640 1 --2- 172.21.15.62:0/668317062 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7600b6d40 0x7ff7601fd3c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff75000c3c0 tx=0x7ff75000c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T11:59:54.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.824+0000 7ff75d7fa640 1 -- 172.21.15.62:0/668317062 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7500052d0 con 0x7ff7600b6d40 2023-10-08T11:59:54.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.824+0000 7ff75d7fa640 1 -- 172.21.15.62:0/668317062 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff750003600 con 0x7ff7600b6d40 2023-10-08T11:59:54.826 INFO:tasks.ceph:setting config [mds] rados_osd_op_timeout = 900 2023-10-08T11:59:54.826 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph config set mds rados_osd_op_timeout 900 2023-10-08T11:59:54.826 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.824+0000 7ff766f07640 1 -- 172.21.15.62:0/668317062 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff76009da00 con 0x7ff7600b6d40 2023-10-08T11:59:54.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.824+0000 7ff75d7fa640 1 -- 172.21.15.62:0/668317062 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7500039f0 con 0x7ff7600b6d40 2023-10-08T11:59:54.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.824+0000 7ff766f07640 1 -- 172.21.15.62:0/668317062 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7600b20f0 con 0x7ff7600b6d40 2023-10-08T11:59:54.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.824+0000 7ff75d7fa640 1 -- 172.21.15.62:0/668317062 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff750011590 con 0x7ff7600b6d40 2023-10-08T11:59:54.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.824+0000 7ff75d7fa640 1 -- 172.21.15.62:0/668317062 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7ff75001c780 con 0x7ff7600b6d40 2023-10-08T11:59:54.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.832+0000 7f87206aa640 1 -- 172.21.15.62:0/3626138051 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f871806cf00 msgr2=0x7f871809f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:54.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.832+0000 7f87206aa640 1 --2- 172.21.15.62:0/3626138051 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f871806cf00 0x7f871809f0e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8708010a70 tx=0x7f8708010f30 comp rx=0 tx=0).stop 2023-10-08T11:59:54.834 INFO:tasks.ceph:setting config [mon] mon_op_complaint_time = 120 2023-10-08T11:59:54.834 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph config set mon mon_op_complaint_time 120 2023-10-08T11:59:54.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.832+0000 7f87206aa640 1 -- 172.21.15.62:0/3626138051 shutdown_connections 2023-10-08T11:59:54.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.832+0000 7f87206aa640 1 --2- 172.21.15.62:0/3626138051 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f871806cf00 0x7f871809f0e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:54.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.832+0000 7f87206aa640 1 --2- 172.21.15.62:0/3626138051 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f87180b9b30 0x7f871809ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:54.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.832+0000 7f87206aa640 1 --2- 172.21.15.62:0/3626138051 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f87180699f0 0x7f87180702d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:54.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.832+0000 7ff766f07640 1 -- 172.21.15.62:0/668317062 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff740005260 con 0x7ff7600b6d40 2023-10-08T11:59:54.837 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.832+0000 7f87206aa640 1 -- 172.21.15.62:0/3626138051 >> 172.21.15.62:0/3626138051 conn(0x7f87180b82f0 msgr2=0x7f87181d4fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T11:59:54.837 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.832+0000 7f87206aa640 1 -- 172.21.15.62:0/3626138051 shutdown_connections 2023-10-08T11:59:54.837 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.832+0000 7f87206aa640 1 -- 172.21.15.62:0/3626138051 wait complete. 2023-10-08T11:59:54.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.832+0000 7ffb6515d640 1 -- 172.21.15.62:0/2008008967 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffb600b6c60 msgr2=0x7ffb601462b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:54.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.832+0000 7ffb6515d640 1 --2- 172.21.15.62:0/2008008967 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffb600b6c60 0x7ffb601462b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ffb500011d0 tx=0x7ffb50001690 comp rx=0 tx=0).stop 2023-10-08T11:59:54.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.836+0000 7ffb6515d640 1 -- 172.21.15.62:0/2008008967 shutdown_connections 2023-10-08T11:59:54.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.836+0000 7ffb6515d640 1 --2- 172.21.15.62:0/2008008967 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffb600b7460 0x7ffb601497c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:54.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.836+0000 7ffb6515d640 1 --2- 172.21.15.62:0/2008008967 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffb600b6c60 0x7ffb601462b0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:54.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.836+0000 7ffb6515d640 1 --2- 172.21.15.62:0/2008008967 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb60097a70 0x7ffb60146e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:54.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.836+0000 7ffb6515d640 1 -- 172.21.15.62:0/2008008967 >> 172.21.15.62:0/2008008967 conn(0x7ffb600ba770 msgr2=0x7ffb601589f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T11:59:54.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.836+0000 7ffb6515d640 1 -- 172.21.15.62:0/2008008967 shutdown_connections 2023-10-08T11:59:54.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.836+0000 7ffb6515d640 1 -- 172.21.15.62:0/2008008967 wait complete. 2023-10-08T11:59:54.840 INFO:tasks.ceph:setting config [osd] osd_op_complaint_time = 180 2023-10-08T11:59:54.841 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph config set osd osd_op_complaint_time 180 2023-10-08T11:59:54.849 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.840+0000 7ff75d7fa640 1 -- 172.21.15.62:0/668317062 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7ff750017070 con 0x7ff7600b6d40 2023-10-08T11:59:54.864 DEBUG:tasks.ceph:set 21 configs 2023-10-08T11:59:54.864 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi062') 2023-10-08T11:59:54.865 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi062') 2023-10-08T11:59:54.865 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi062') 2023-10-08T11:59:54.865 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi062') 2023-10-08T11:59:54.865 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi062') 2023-10-08T11:59:54.865 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi062') 2023-10-08T11:59:54.866 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi062') 2023-10-08T11:59:54.869 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_ms', '1'], check_status=True, hostname='smithi062') 2023-10-08T11:59:54.890 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.888+0000 7f039aafa640 1 -- 172.21.15.62:0/760800378 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f03940b88b0 msgr2=0x7f0394099da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:54.890 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.888+0000 7f039aafa640 1 --2- 172.21.15.62:0/760800378 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f03940b88b0 0x7f0394099da0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0384009840 tx=0x7f0384021240 comp rx=0 tx=0).stop 2023-10-08T11:59:54.891 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.888+0000 7f039aafa640 1 -- 172.21.15.62:0/760800378 shutdown_connections 2023-10-08T11:59:54.891 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.888+0000 7f039aafa640 1 --2- 172.21.15.62:0/760800378 >> v2:172.21.15.130:3300/0 conn(0x7f03940b6d40 0x7f03940b0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:54.891 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.888+0000 7f039aafa640 1 --2- 172.21.15.62:0/760800378 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f03940b88b0 0x7f0394099da0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:54.891 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.888+0000 7f039aafa640 1 -- 172.21.15.62:0/760800378 >> 172.21.15.62:0/760800378 conn(0x7f039409c600 msgr2=0x7f039409ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T11:59:54.891 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.888+0000 7f039aafa640 1 -- 172.21.15.62:0/760800378 shutdown_connections 2023-10-08T11:59:54.892 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.888+0000 7f039aafa640 1 -- 172.21.15.62:0/760800378 wait complete. 2023-10-08T11:59:54.892 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.888+0000 7f039aafa640 1 Processor -- start 2023-10-08T11:59:54.894 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.888+0000 7f039aafa640 1 -- start start 2023-10-08T11:59:54.894 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.892+0000 7f039aafa640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f03940b6d40 0x7f0394156c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T11:59:54.894 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.892+0000 7f039aafa640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03940b88b0 0x7f03941f7d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T11:59:54.894 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.892+0000 7f039aafa640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f03940b9a70 0x7f039414ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T11:59:54.894 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.892+0000 7f039aafa640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03941524d0 con 0x7f03940b88b0 2023-10-08T11:59:54.895 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.892+0000 7f039aafa640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0394087e60 con 0x7f03940b6d40 2023-10-08T11:59:54.895 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.892+0000 7f039aafa640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03941f87d0 con 0x7f03940b9a70 2023-10-08T11:59:54.895 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.892+0000 7f0393fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03940b88b0 0x7f03941f7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T11:59:54.895 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.892+0000 7f0393fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03940b88b0 0x7f03941f7d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60428/0 (socket says 172.21.15.62:60428) 2023-10-08T11:59:54.895 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.892+0000 7f0393fff640 1 -- 172.21.15.62:0/2752046920 learned_addr learned my addr 172.21.15.62:0/2752046920 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T11:59:54.895 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.892+0000 7f0399097640 1 --2- 172.21.15.62:0/2752046920 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f03940b9a70 0x7f039414ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T11:59:54.895 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.892+0000 7f0398896640 1 --2- 172.21.15.62:0/2752046920 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f03940b6d40 0x7f0394156c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T11:59:54.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.892+0000 7f0393fff640 1 -- 172.21.15.62:0/2752046920 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f03940b9a70 msgr2=0x7f039414ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:54.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.892+0000 7f0393fff640 1 --2- 172.21.15.62:0/2752046920 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f03940b9a70 0x7f039414ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:54.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.892+0000 7f0393fff640 1 -- 172.21.15.62:0/2752046920 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f03940b6d40 msgr2=0x7f0394156c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:54.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.892+0000 7f0393fff640 1 --2- 172.21.15.62:0/2752046920 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f03940b6d40 0x7f0394156c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:54.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.892+0000 7f0393fff640 1 -- 172.21.15.62:0/2752046920 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03840094a0 con 0x7f03940b88b0 2023-10-08T11:59:54.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.892+0000 7f0399097640 1 --2- 172.21.15.62:0/2752046920 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f03940b9a70 0x7f039414ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T11:59:54.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.892+0000 7f0393fff640 1 --2- 172.21.15.62:0/2752046920 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03940b88b0 0x7f03941f7d80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f038c00bb20 tx=0x7f038c00c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T11:59:54.898 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.896+0000 7f03917fa640 1 -- 172.21.15.62:0/2752046920 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038c011070 con 0x7f03940b88b0 2023-10-08T11:59:54.899 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.896+0000 7f03917fa640 1 -- 172.21.15.62:0/2752046920 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f038c00c870 con 0x7f03940b88b0 2023-10-08T11:59:54.899 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.896+0000 7f03917fa640 1 -- 172.21.15.62:0/2752046920 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038c009830 con 0x7f03940b88b0 2023-10-08T11:59:54.899 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.896+0000 7f039aafa640 1 -- 172.21.15.62:0/2752046920 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0394151e10 con 0x7f03940b88b0 2023-10-08T11:59:54.899 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.896+0000 7f039aafa640 1 -- 172.21.15.62:0/2752046920 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03941512d0 con 0x7f03940b88b0 2023-10-08T11:59:54.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.896+0000 7f03917fa640 1 -- 172.21.15.62:0/2752046920 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f038c015070 con 0x7f03940b88b0 2023-10-08T11:59:54.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.896+0000 7f03917fa640 1 -- 172.21.15.62:0/2752046920 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f038c017a50 con 0x7f03940b88b0 2023-10-08T11:59:54.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.896+0000 7f85e603f640 1 -- 172.21.15.62:0/3392607713 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) v1 -- 0x7f85bc000f20 con 0x7f85e00b6d40 2023-10-08T11:59:54.901 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.900+0000 7f039aafa640 1 -- 172.21.15.62:0/2752046920 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f039404da80 con 0x7f03940b88b0 2023-10-08T11:59:54.905 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.904+0000 7f03917fa640 1 -- 172.21.15.62:0/2752046920 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f038c026060 con 0x7f03940b88b0 2023-10-08T11:59:54.909 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.908+0000 7f85cffff640 1 -- 172.21.15.62:0/3392607713 <== mon.0 v2:172.21.15.62:3300/0 10 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v9)=0 v9) v1 ==== 127+0+0 (secure 0 0 0) 0x7f85d40290c0 con 0x7f85e00b6d40 2023-10-08T11:59:54.917 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.916+0000 7fd76a7be640 1 -- 172.21.15.62:0/939069207 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) v1 -- 0x7fd73c005150 con 0x7fd7640b1140 2023-10-08T11:59:54.928 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.924+0000 7fd759ffb640 1 -- 172.21.15.62:0/939069207 <== mon.2 v2:172.21.15.130:3301/0 11 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v10)=0 v10) v1 ==== 106+0+0 (secure 0 0 0) 0x7fd7600bc9d0 con 0x7fd7640b1140 2023-10-08T11:59:54.928 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.924+0000 7f85e603f640 1 -- 172.21.15.62:0/3392607713 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85e00b6d40 msgr2=0x7f85e01dccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:54.928 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.924+0000 7f85e603f640 1 --2- 172.21.15.62:0/3392607713 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85e00b6d40 0x7f85e01dccc0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f85d40011c0 tx=0x7f85d4001680 comp rx=0 tx=0).stop 2023-10-08T11:59:54.941 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.940+0000 7f85e603f640 1 -- 172.21.15.62:0/3392607713 shutdown_connections 2023-10-08T11:59:54.941 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.940+0000 7f85e603f640 1 --2- 172.21.15.62:0/3392607713 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f85e00b9a70 0x7f85e01dfcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:54.942 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.940+0000 7fd76a7be640 1 -- 172.21.15.62:0/939069207 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd7640b1140 msgr2=0x7fd7641ceaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:54.942 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.940+0000 7f85e603f640 1 --2- 172.21.15.62:0/3392607713 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f85e00b88b0 0x7f85e009e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:54.942 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.940+0000 7f85e603f640 1 --2- 172.21.15.62:0/3392607713 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85e00b6d40 0x7f85e01dccc0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:54.942 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.940+0000 7f85e603f640 1 -- 172.21.15.62:0/3392607713 >> 172.21.15.62:0/3392607713 conn(0x7f85e009c600 msgr2=0x7f85e00994e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T11:59:54.943 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.940+0000 7fd76a7be640 1 --2- 172.21.15.62:0/939069207 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd7640b1140 0x7fd7641ceaf0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd76001bce0 tx=0x7fd76001be70 comp rx=0 tx=0).stop 2023-10-08T11:59:54.943 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.940+0000 7f85e603f640 1 -- 172.21.15.62:0/3392607713 shutdown_connections 2023-10-08T11:59:54.943 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.940+0000 7f85e603f640 1 -- 172.21.15.62:0/3392607713 wait complete. 2023-10-08T11:59:54.944 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.940+0000 7fd76a7be640 1 -- 172.21.15.62:0/939069207 shutdown_connections 2023-10-08T11:59:54.944 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.940+0000 7fd76a7be640 1 --2- 172.21.15.62:0/939069207 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd7640b1140 0x7fd7641ceaf0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:54.944 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.940+0000 7fd76a7be640 1 --2- 172.21.15.62:0/939069207 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd7640af9c0 0x7fd7640b4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:54.944 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.940+0000 7fd76a7be640 1 --2- 172.21.15.62:0/939069207 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd76409f080 0x7fd7641cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:54.945 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.940+0000 7fd76a7be640 1 -- 172.21.15.62:0/939069207 >> 172.21.15.62:0/939069207 conn(0x7fd7640b8420 msgr2=0x7fd76413b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T11:59:54.945 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.940+0000 7fd76a7be640 1 -- 172.21.15.62:0/939069207 shutdown_connections 2023-10-08T11:59:54.945 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:54.940+0000 7fd76a7be640 1 -- 172.21.15.62:0/939069207 wait complete. 2023-10-08T11:59:55.000 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='smithi062') 2023-10-08T11:59:55.000 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='smithi062') 2023-10-08T11:59:55.026 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.024+0000 7fa2bf137640 1 -- 172.21.15.62:0/441650984 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa2b809ce60 msgr2=0x7fa2b8148dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:55.027 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.024+0000 7fa2bf137640 1 --2- 172.21.15.62:0/441650984 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa2b809ce60 0x7fa2b8148dc0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa2b4009870 tx=0x7fa2b401d870 comp rx=0 tx=0).stop 2023-10-08T11:59:55.027 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.024+0000 7fa2bf137640 1 -- 172.21.15.62:0/441650984 shutdown_connections 2023-10-08T11:59:55.027 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.024+0000 7fa2bf137640 1 --2- 172.21.15.62:0/441650984 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa2b809ce60 0x7fa2b8148dc0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.027 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.024+0000 7fa2bf137640 1 -- 172.21.15.62:0/441650984 >> 172.21.15.62:0/441650984 conn(0x7fa2b80b8420 msgr2=0x7fa2b80b8830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T11:59:55.037 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.036+0000 7fa2bf137640 1 -- 172.21.15.62:0/441650984 shutdown_connections 2023-10-08T11:59:55.037 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.036+0000 7fa2bf137640 1 -- 172.21.15.62:0/441650984 wait complete. 2023-10-08T11:59:55.038 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.036+0000 7fa2bf137640 1 Processor -- start 2023-10-08T11:59:55.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.036+0000 7fa2bf137640 1 -- start start 2023-10-08T11:59:55.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.036+0000 7fa2bf137640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2b806aa90 0x7fa2b813b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T11:59:55.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.036+0000 7fa2bf137640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa2b813f530 0x7fa2b8138da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T11:59:55.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.036+0000 7fa2bf137640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2b8138470 0x7fa2b81d1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T11:59:55.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.036+0000 7fa2bf137640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b81d1740 con 0x7fa2b806aa90 2023-10-08T11:59:55.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.036+0000 7fa2bf137640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b8138990 con 0x7fa2b8138470 2023-10-08T11:59:55.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.036+0000 7fa2bf137640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b813c8d0 con 0x7fa2b813f530 2023-10-08T11:59:55.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.036+0000 7fa2bd934640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa2b813f530 0x7fa2b8138da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T11:59:55.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.036+0000 7fa2be135640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2b806aa90 0x7fa2b813b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T11:59:55.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.036+0000 7fa2be135640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2b806aa90 0x7fa2b813b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60432/0 (socket says 172.21.15.62:60432) 2023-10-08T11:59:55.042 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.036+0000 7fa2be135640 1 -- 172.21.15.62:0/1088817695 learned_addr learned my addr 172.21.15.62:0/1088817695 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T11:59:55.042 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.036+0000 7fa2be936640 1 --2- 172.21.15.62:0/1088817695 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2b8138470 0x7fa2b81d1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T11:59:55.042 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.040+0000 7fa2bd934640 1 -- 172.21.15.62:0/1088817695 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2b8138470 msgr2=0x7fa2b81d1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:55.042 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.040+0000 7fa2bd934640 1 --2- 172.21.15.62:0/1088817695 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2b8138470 0x7fa2b81d1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.042 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.040+0000 7fa2bd934640 1 -- 172.21.15.62:0/1088817695 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2b806aa90 msgr2=0x7fa2b813b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:55.042 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.040+0000 7fa2bd934640 1 --2- 172.21.15.62:0/1088817695 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2b806aa90 0x7fa2b813b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.042 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.040+0000 7fa2bd934640 1 -- 172.21.15.62:0/1088817695 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2b40094a0 con 0x7fa2b813f530 2023-10-08T11:59:55.042 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.040+0000 7fa2bd934640 1 --2- 172.21.15.62:0/1088817695 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa2b813f530 0x7fa2b8138da0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa2b40ad000 tx=0x7fa2b400c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T11:59:55.060 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.056+0000 7fa2aeffd640 1 -- 172.21.15.62:0/1088817695 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b4004500 con 0x7fa2b813f530 2023-10-08T11:59:55.060 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.056+0000 7fa2aeffd640 1 -- 172.21.15.62:0/1088817695 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa2b40048e0 con 0x7fa2b813f530 2023-10-08T11:59:55.061 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.060+0000 7fa2aeffd640 1 -- 172.21.15.62:0/1088817695 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b4004cf0 con 0x7fa2b813f530 2023-10-08T11:59:55.061 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.060+0000 7fa2bf137640 1 -- 172.21.15.62:0/1088817695 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2b813cb70 con 0x7fa2b813f530 2023-10-08T11:59:55.061 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.060+0000 7fa2bf137640 1 -- 172.21.15.62:0/1088817695 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2b813aac0 con 0x7fa2b813f530 2023-10-08T11:59:55.062 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.060+0000 7fa2aeffd640 1 -- 172.21.15.62:0/1088817695 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa2b40b5070 con 0x7fa2b813f530 2023-10-08T11:59:55.062 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.060+0000 7fa2aeffd640 1 -- 172.21.15.62:0/1088817695 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fa2b40c0780 con 0x7fa2b813f530 2023-10-08T11:59:55.071 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.068+0000 7fa2bf137640 1 -- 172.21.15.62:0/1088817695 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2b813ad70 con 0x7fa2b813f530 2023-10-08T11:59:55.077 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.076+0000 7fa2aeffd640 1 -- 172.21.15.62:0/1088817695 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fa2b813ad70 con 0x7fa2b813f530 2023-10-08T11:59:55.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.076+0000 7ff766f07640 1 -- 172.21.15.62:0/668317062 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) v1 -- 0x7ff7400050d0 con 0x7ff7600b6d40 2023-10-08T11:59:55.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.080+0000 7f039aafa640 1 -- 172.21.15.62:0/2752046920 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) v1 -- 0x7f03940b6640 con 0x7f03940b88b0 2023-10-08T11:59:55.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.084+0000 7f03917fa640 1 -- 172.21.15.62:0/2752046920 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v11)=0 v11) v1 ==== 116+0+0 (secure 0 0 0) 0x7f038c02f0b0 con 0x7f03940b88b0 2023-10-08T11:59:55.091 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.088+0000 7f039aafa640 1 -- 172.21.15.62:0/2752046920 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03940b88b0 msgr2=0x7f03941f7d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:55.091 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.088+0000 7f039aafa640 1 --2- 172.21.15.62:0/2752046920 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03940b88b0 0x7f03941f7d80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f038c00bb20 tx=0x7f038c00c040 comp rx=0 tx=0).stop 2023-10-08T11:59:55.091 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.088+0000 7f039aafa640 1 -- 172.21.15.62:0/2752046920 shutdown_connections 2023-10-08T11:59:55.091 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.088+0000 7f039aafa640 1 --2- 172.21.15.62:0/2752046920 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f03940b9a70 0x7f039414ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.091 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.088+0000 7f039aafa640 1 --2- 172.21.15.62:0/2752046920 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03940b88b0 0x7f03941f7d80 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.091 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.088+0000 7f039aafa640 1 --2- 172.21.15.62:0/2752046920 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f03940b6d40 0x7f0394156c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.092 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.088+0000 7f039aafa640 1 -- 172.21.15.62:0/2752046920 >> 172.21.15.62:0/2752046920 conn(0x7f039409c600 msgr2=0x7f03940afd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T11:59:55.092 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.088+0000 7f039aafa640 1 -- 172.21.15.62:0/2752046920 shutdown_connections 2023-10-08T11:59:55.092 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.088+0000 7f039aafa640 1 -- 172.21.15.62:0/2752046920 wait complete. 2023-10-08T11:59:55.102 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.100+0000 7ff75d7fa640 1 -- 172.21.15.62:0/668317062 <== mon.1 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v12)=0 v12) v1 ==== 116+0+0 (secure 0 0 0) 0x7ff750011a20 con 0x7ff7600b6d40 2023-10-08T11:59:55.104 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.100+0000 7fac38cb8640 1 -- 172.21.15.62:0/3880687762 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fac34149270 msgr2=0x7fac3406a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:55.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.100+0000 7fac38cb8640 1 --2- 172.21.15.62:0/3880687762 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fac34149270 0x7fac3406a9a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fac24009900 tx=0x7fac2401c850 comp rx=0 tx=0).stop 2023-10-08T11:59:55.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.100+0000 7fac38cb8640 1 -- 172.21.15.62:0/3880687762 shutdown_connections 2023-10-08T11:59:55.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.100+0000 7fac38cb8640 1 --2- 172.21.15.62:0/3880687762 >> v2:172.21.15.130:3300/0 conn(0x7fac340ba2e0 0x7fac340ba720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.100+0000 7fac38cb8640 1 --2- 172.21.15.62:0/3880687762 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fac34149270 0x7fac3406a9a0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.100+0000 7fac38cb8640 1 -- 172.21.15.62:0/3880687762 >> 172.21.15.62:0/3880687762 conn(0x7fac340a0540 msgr2=0x7fac340a0950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T11:59:55.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.100+0000 7fac38cb8640 1 -- 172.21.15.62:0/3880687762 shutdown_connections 2023-10-08T11:59:55.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.100+0000 7fac38cb8640 1 -- 172.21.15.62:0/3880687762 wait complete. 2023-10-08T11:59:55.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.100+0000 7ff766f07640 1 -- 172.21.15.62:0/668317062 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7600b6d40 msgr2=0x7ff7601fd3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:55.106 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.100+0000 7ff766f07640 1 --2- 172.21.15.62:0/668317062 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7600b6d40 0x7ff7601fd3c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff75000c3c0 tx=0x7ff75000c880 comp rx=0 tx=0).stop 2023-10-08T11:59:55.106 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.104+0000 7fac38cb8640 1 Processor -- start 2023-10-08T11:59:55.106 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.104+0000 7fac38cb8640 1 -- start start 2023-10-08T11:59:55.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.104+0000 7fac38cb8640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fac34069790 0x7fac3414bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T11:59:55.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.104+0000 7fac38cb8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac340ba2e0 0x7fac340b52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T11:59:55.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.104+0000 7fac38cb8640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac34149270 0x7fac341e69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T11:59:55.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.104+0000 7fac38cb8640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac34147410 con 0x7fac34149270 2023-10-08T11:59:55.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.104+0000 7fac38cb8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac341e65b0 con 0x7fac340ba2e0 2023-10-08T11:59:55.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.104+0000 7fac38cb8640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac340b5830 con 0x7fac34069790 2023-10-08T11:59:55.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.104+0000 7fac3259c640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fac34069790 0x7fac3414bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T11:59:55.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.104+0000 7fac3259c640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fac34069790 0x7fac3414bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.62:32938/0 (socket says 172.21.15.62:32938) 2023-10-08T11:59:55.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.104+0000 7fac3259c640 1 -- 172.21.15.62:0/3124793079 learned_addr learned my addr 172.21.15.62:0/3124793079 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T11:59:55.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.104+0000 7fac32d9d640 1 --2- 172.21.15.62:0/3124793079 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac34149270 0x7fac341e69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T11:59:55.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.104+0000 7fac31d9b640 1 --2- 172.21.15.62:0/3124793079 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac340ba2e0 0x7fac340b52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T11:59:55.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.104+0000 7fac3259c640 1 -- 172.21.15.62:0/3124793079 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac340ba2e0 msgr2=0x7fac340b52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:55.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.104+0000 7fac3259c640 1 --2- 172.21.15.62:0/3124793079 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac340ba2e0 0x7fac340b52f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.104+0000 7fac3259c640 1 -- 172.21.15.62:0/3124793079 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac34149270 msgr2=0x7fac341e69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:55.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.104+0000 7fac3259c640 1 --2- 172.21.15.62:0/3124793079 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac34149270 0x7fac341e69e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.104+0000 7fac3259c640 1 -- 172.21.15.62:0/3124793079 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac24009560 con 0x7fac34069790 2023-10-08T11:59:55.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.104+0000 7fac3259c640 1 --2- 172.21.15.62:0/3124793079 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fac34069790 0x7fac3414bf20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fac24009850 tx=0x7fac24005760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T11:59:55.110 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.104+0000 7ff766f07640 1 -- 172.21.15.62:0/668317062 shutdown_connections 2023-10-08T11:59:55.110 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.104+0000 7ff766f07640 1 --2- 172.21.15.62:0/668317062 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7600b9a70 0x7ff76009e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.110 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.104+0000 7ff766f07640 1 --2- 172.21.15.62:0/668317062 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7600b6d40 0x7ff7601fd3c0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.111 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.104+0000 7ff766f07640 1 --2- 172.21.15.62:0/668317062 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff7600af870 0x7ff76006fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.111 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.104+0000 7ff766f07640 1 -- 172.21.15.62:0/668317062 >> 172.21.15.62:0/668317062 conn(0x7ff76009c600 msgr2=0x7ff7600afca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T11:59:55.111 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.108+0000 7ff766f07640 1 -- 172.21.15.62:0/668317062 shutdown_connections 2023-10-08T11:59:55.111 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.108+0000 7ff766f07640 1 -- 172.21.15.62:0/668317062 wait complete. 2023-10-08T11:59:55.117 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.108+0000 7fac22ffd640 1 -- 172.21.15.62:0/3124793079 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac24004230 con 0x7fac34069790 2023-10-08T11:59:55.117 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.108+0000 7fac38cb8640 1 -- 172.21.15.62:0/3124793079 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac34148d10 con 0x7fac34069790 2023-10-08T11:59:55.117 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.108+0000 7fac38cb8640 1 -- 172.21.15.62:0/3124793079 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac34147130 con 0x7fac34069790 2023-10-08T11:59:55.117 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.108+0000 7fac22ffd640 1 -- 172.21.15.62:0/3124793079 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fac24004480 con 0x7fac34069790 2023-10-08T11:59:55.117 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.108+0000 7fac22ffd640 1 -- 172.21.15.62:0/3124793079 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac24004930 con 0x7fac34069790 2023-10-08T11:59:55.117 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.108+0000 7fac22ffd640 1 -- 172.21.15.62:0/3124793079 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fac240b4040 con 0x7fac34069790 2023-10-08T11:59:55.117 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.108+0000 7fac22ffd640 1 -- 172.21.15.62:0/3124793079 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fac24003d90 con 0x7fac34069790 2023-10-08T11:59:55.117 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.112+0000 7fac38cb8640 1 -- 172.21.15.62:0/3124793079 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac18005260 con 0x7fac34069790 2023-10-08T11:59:55.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.116+0000 7fac22ffd640 1 -- 172.21.15.62:0/3124793079 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fac240b2070 con 0x7fac34069790 2023-10-08T11:59:55.120 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.116+0000 7f0ec94a8640 1 -- 172.21.15.62:0/1947771336 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0ec40b9860 msgr2=0x7f0ec40b0c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:55.121 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.116+0000 7f0ec94a8640 1 --2- 172.21.15.62:0/1947771336 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0ec40b9860 0x7f0ec40b0c60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f0eb8009840 tx=0x7f0eb801c620 comp rx=0 tx=0).stop 2023-10-08T11:59:55.121 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.120+0000 7f0ec94a8640 1 -- 172.21.15.62:0/1947771336 shutdown_connections 2023-10-08T11:59:55.121 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.120+0000 7f0ec94a8640 1 --2- 172.21.15.62:0/1947771336 >> v2:172.21.15.62:3300/0 conn(0x7f0ec40b57b0 0x7f0ec406a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.122 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.120+0000 7f0ec94a8640 1 --2- 172.21.15.62:0/1947771336 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0ec40b9860 0x7f0ec40b0c60 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.122 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.120+0000 7f0ec94a8640 1 -- 172.21.15.62:0/1947771336 >> 172.21.15.62:0/1947771336 conn(0x7f0ec409c600 msgr2=0x7f0ec409ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T11:59:55.129 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.124+0000 7f0ec94a8640 1 -- 172.21.15.62:0/1947771336 shutdown_connections 2023-10-08T11:59:55.129 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.124+0000 7f0ec94a8640 1 -- 172.21.15.62:0/1947771336 wait complete. 2023-10-08T11:59:55.129 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.124+0000 7f0ec94a8640 1 Processor -- start 2023-10-08T11:59:55.131 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.128+0000 7f3133043640 1 -- 172.21.15.62:0/115538488 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f312c0b9fb0 msgr2=0x7f312c06b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:55.131 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.128+0000 7f3133043640 1 --2- 172.21.15.62:0/115538488 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f312c0b9fb0 0x7f312c06b1c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f311c009bc0 tx=0x7f311c01c9f0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.131 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.128+0000 7f0ec94a8640 1 -- start start 2023-10-08T11:59:55.132 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.128+0000 7f0ec94a8640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ec40b57b0 0x7f0ec40b7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T11:59:55.132 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.128+0000 7f0ec94a8640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0ec40b9860 0x7f0ec409dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T11:59:55.132 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.128+0000 7f0ec94a8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ec40b9c40 0x7f0ec41e3250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T11:59:55.132 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.128+0000 7f0ec94a8640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec40b7d90 con 0x7f0ec40b57b0 2023-10-08T11:59:55.132 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.128+0000 7f0ec94a8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec406e250 con 0x7f0ec40b9c40 2023-10-08T11:59:55.132 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.128+0000 7f0ec94a8640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec409eab0 con 0x7f0ec40b9860 2023-10-08T11:59:55.133 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.128+0000 7f0ec2ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ec40b57b0 0x7f0ec40b7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T11:59:55.133 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.128+0000 7f0ec2ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ec40b57b0 0x7f0ec40b7850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60480/0 (socket says 172.21.15.62:60480) 2023-10-08T11:59:55.133 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.128+0000 7f0ec2ffd640 1 -- 172.21.15.62:0/1558634083 learned_addr learned my addr 172.21.15.62:0/1558634083 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T11:59:55.133 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.128+0000 7f0ec27fc640 1 --2- 172.21.15.62:0/1558634083 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0ec40b9860 0x7f0ec409dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T11:59:55.133 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.128+0000 7f0ec37fe640 1 --2- 172.21.15.62:0/1558634083 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ec40b9c40 0x7f0ec41e3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T11:59:55.133 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.128+0000 7f0ec2ffd640 1 -- 172.21.15.62:0/1558634083 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0ec40b9860 msgr2=0x7f0ec409dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:55.133 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.128+0000 7f0ec2ffd640 1 --2- 172.21.15.62:0/1558634083 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0ec40b9860 0x7f0ec409dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.133 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.128+0000 7f0ec2ffd640 1 -- 172.21.15.62:0/1558634083 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ec40b9c40 msgr2=0x7f0ec41e3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:55.134 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.128+0000 7f0ec2ffd640 1 --2- 172.21.15.62:0/1558634083 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ec40b9c40 0x7f0ec41e3250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.134 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.128+0000 7f0ec2ffd640 1 -- 172.21.15.62:0/1558634083 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb80094a0 con 0x7f0ec40b57b0 2023-10-08T11:59:55.134 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.128+0000 7f0ec37fe640 1 --2- 172.21.15.62:0/1558634083 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ec40b9c40 0x7f0ec41e3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T11:59:55.134 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.128+0000 7f0ec2ffd640 1 --2- 172.21.15.62:0/1558634083 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ec40b57b0 0x7f0ec40b7850 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0eb8009790 tx=0x7f0eb80050c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T11:59:55.135 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.128+0000 7f3133043640 1 -- 172.21.15.62:0/115538488 shutdown_connections 2023-10-08T11:59:55.135 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.128+0000 7f3133043640 1 --2- 172.21.15.62:0/115538488 >> v2:172.21.15.62:3300/0 conn(0x7f312c0b00e0 0x7f312c0b0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.135 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.128+0000 7f3133043640 1 --2- 172.21.15.62:0/115538488 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f312c0b9fb0 0x7f312c06b1c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.135 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.128+0000 7f3133043640 1 -- 172.21.15.62:0/115538488 >> 172.21.15.62:0/115538488 conn(0x7f312c09c600 msgr2=0x7f312c09ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T11:59:55.135 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.128+0000 7f3133043640 1 -- 172.21.15.62:0/115538488 shutdown_connections 2023-10-08T11:59:55.135 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.128+0000 7f3133043640 1 -- 172.21.15.62:0/115538488 wait complete. 2023-10-08T11:59:55.135 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.132+0000 7f3133043640 1 Processor -- start 2023-10-08T11:59:55.136 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.132+0000 7f3133043640 1 -- start start 2023-10-08T11:59:55.136 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.132+0000 7f3133043640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f312c0b00e0 0x7f312c1d9b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T11:59:55.136 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.132+0000 7f3133043640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f312c0b9fb0 0x7f312c0b4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T11:59:55.136 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.132+0000 7f3133043640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f312c148910 0x7f312c1e6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T11:59:55.136 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.132+0000 7f3133043640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f312c1da060 con 0x7f312c0b00e0 2023-10-08T11:59:55.136 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.132+0000 7f3133043640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f312c1ea210 con 0x7f312c148910 2023-10-08T11:59:55.136 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.132+0000 7f3133043640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f312c1ea470 con 0x7f312c0b9fb0 2023-10-08T11:59:55.137 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.132+0000 7f0eab7fe640 1 -- 172.21.15.62:0/1558634083 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb80046d0 con 0x7f0ec40b57b0 2023-10-08T11:59:55.137 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.132+0000 7f0ec94a8640 1 -- 172.21.15.62:0/1558634083 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ec41e6d60 con 0x7f0ec40b57b0 2023-10-08T11:59:55.137 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.132+0000 7f312bfff640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f312c0b9fb0 0x7f312c0b4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T11:59:55.137 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.132+0000 7f312bfff640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f312c0b9fb0 0x7f312c0b4510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.62:32988/0 (socket says 172.21.15.62:32988) 2023-10-08T11:59:55.137 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.132+0000 7f312bfff640 1 -- 172.21.15.62:0/1445557938 learned_addr learned my addr 172.21.15.62:0/1445557938 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T11:59:55.137 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.132+0000 7f0ec94a8640 1 -- 172.21.15.62:0/1558634083 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ec41e69f0 con 0x7f0ec40b57b0 2023-10-08T11:59:55.138 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.132+0000 7f0eab7fe640 1 -- 172.21.15.62:0/1558634083 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0eb8004920 con 0x7f0ec40b57b0 2023-10-08T11:59:55.138 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.132+0000 7f3130ddf640 1 --2- 172.21.15.62:0/1445557938 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f312c0b00e0 0x7f312c1d9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T11:59:55.138 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.132+0000 7f312bfff640 1 -- 172.21.15.62:0/1445557938 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f312c148910 msgr2=0x7f312c1e6c30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T11:59:55.138 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.132+0000 7f312bfff640 1 --2- 172.21.15.62:0/1445557938 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f312c148910 0x7f312c1e6c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.138 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.132+0000 7f312bfff640 1 -- 172.21.15.62:0/1445557938 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f312c0b00e0 msgr2=0x7f312c1d9b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:55.138 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.132+0000 7f312bfff640 1 --2- 172.21.15.62:0/1445557938 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f312c0b00e0 0x7f312c1d9b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.138 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.132+0000 7f312bfff640 1 -- 172.21.15.62:0/1445557938 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f311c009820 con 0x7f312c0b9fb0 2023-10-08T11:59:55.139 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.132+0000 7f0eab7fe640 1 -- 172.21.15.62:0/1558634083 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb8004cd0 con 0x7f0ec40b57b0 2023-10-08T11:59:55.139 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.132+0000 7f0eab7fe640 1 -- 172.21.15.62:0/1558634083 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0eb80b1750 con 0x7f0ec40b57b0 2023-10-08T11:59:55.139 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.132+0000 7f0eab7fe640 1 -- 172.21.15.62:0/1558634083 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f0eb80bb7f0 con 0x7f0ec40b57b0 2023-10-08T11:59:55.139 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.132+0000 7f3130ddf640 1 --2- 172.21.15.62:0/1445557938 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f312c0b00e0 0x7f312c1d9b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T11:59:55.140 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.132+0000 7f312bfff640 1 --2- 172.21.15.62:0/1445557938 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f312c0b9fb0 0x7f312c0b4510 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f312400d980 tx=0x7f312400de40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T11:59:55.140 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.136+0000 7f31297fa640 1 -- 172.21.15.62:0/1445557938 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3124009c30 con 0x7f312c0b9fb0 2023-10-08T11:59:55.140 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.136+0000 7f280db72640 1 -- 172.21.15.62:0/2157151429 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28080b6d40 msgr2=0x7f28080b0b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:55.140 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.136+0000 7f280db72640 1 --2- 172.21.15.62:0/2157151429 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28080b6d40 0x7f28080b0b40 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f28080b8410 tx=0x7f27fc0212c0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.140 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.136+0000 7f280db72640 1 -- 172.21.15.62:0/2157151429 shutdown_connections 2023-10-08T11:59:55.141 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.136+0000 7f280db72640 1 --2- 172.21.15.62:0/2157151429 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28080b6d40 0x7f28080b0b40 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.142 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.136+0000 7f280db72640 1 --2- 172.21.15.62:0/2157151429 >> v2:172.21.15.130:3300/0 conn(0x7f28080b88b0 0x7f2808099da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.136+0000 7f280db72640 1 -- 172.21.15.62:0/2157151429 >> 172.21.15.62:0/2157151429 conn(0x7f280809c600 msgr2=0x7f280809ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T11:59:55.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.136+0000 7f280db72640 1 -- 172.21.15.62:0/2157151429 shutdown_connections 2023-10-08T11:59:55.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.136+0000 7f280db72640 1 -- 172.21.15.62:0/2157151429 wait complete. 2023-10-08T11:59:55.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.136+0000 7f280db72640 1 Processor -- start 2023-10-08T11:59:55.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.136+0000 7f280db72640 1 -- start start 2023-10-08T11:59:55.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.136+0000 7f280db72640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f28080b6d40 0x7f28081eaef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T11:59:55.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.136+0000 7f280db72640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28080b88b0 0x7f28081ea330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T11:59:55.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.136+0000 7f280db72640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f28080b9a70 0x7f28081e7720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T11:59:55.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.136+0000 7f280db72640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28081eb430 con 0x7f28080b88b0 2023-10-08T11:59:55.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.136+0000 7f280db72640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2808201050 con 0x7f28080b9a70 2023-10-08T11:59:55.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.136+0000 7f280db72640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28081e9890 con 0x7f28080b6d40 2023-10-08T11:59:55.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.136+0000 7f28077fe640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f28080b6d40 0x7f28081eaef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T11:59:55.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.136+0000 7f2806ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28080b88b0 0x7f28081ea330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T11:59:55.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.136+0000 7f2806ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28080b88b0 0x7f28081ea330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60498/0 (socket says 172.21.15.62:60498) 2023-10-08T11:59:55.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.136+0000 7f2806ffd640 1 -- 172.21.15.62:0/2671005999 learned_addr learned my addr 172.21.15.62:0/2671005999 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T11:59:55.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.140+0000 7f2807fff640 1 --2- 172.21.15.62:0/2671005999 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f28080b9a70 0x7f28081e7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T11:59:55.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.140+0000 7f2806ffd640 1 -- 172.21.15.62:0/2671005999 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f28080b6d40 msgr2=0x7f28081eaef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:55.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.140+0000 7f2806ffd640 1 --2- 172.21.15.62:0/2671005999 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f28080b6d40 0x7f28081eaef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.140+0000 7f2806ffd640 1 -- 172.21.15.62:0/2671005999 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f28080b9a70 msgr2=0x7f28081e7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:55.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.140+0000 7f2806ffd640 1 --2- 172.21.15.62:0/2671005999 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f28080b9a70 0x7f28081e7720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.140+0000 7f2806ffd640 1 -- 172.21.15.62:0/2671005999 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27fc009560 con 0x7f28080b88b0 2023-10-08T11:59:55.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.140+0000 7f2807fff640 1 --2- 172.21.15.62:0/2671005999 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f28080b9a70 0x7f28081e7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T11:59:55.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.140+0000 7f2806ffd640 1 --2- 172.21.15.62:0/2671005999 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28080b88b0 0x7f28081ea330 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f27fc01ded0 tx=0x7f27fc0056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T11:59:55.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.140+0000 7f27effff640 1 -- 172.21.15.62:0/2671005999 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27fc0b1850 con 0x7f28080b88b0 2023-10-08T11:59:55.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.140+0000 7f27effff640 1 -- 172.21.15.62:0/2671005999 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f27fc0b1aa0 con 0x7f28080b88b0 2023-10-08T11:59:55.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.140+0000 7f280db72640 1 -- 172.21.15.62:0/2671005999 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2808155980 con 0x7f28080b88b0 2023-10-08T11:59:55.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.140+0000 7f280db72640 1 -- 172.21.15.62:0/2671005999 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28081e9e10 con 0x7f28080b88b0 2023-10-08T11:59:55.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.140+0000 7f27effff640 1 -- 172.21.15.62:0/2671005999 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27fc003600 con 0x7f28080b88b0 2023-10-08T11:59:55.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.140+0000 7f27effff640 1 -- 172.21.15.62:0/2671005999 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f27fc0b8040 con 0x7f28080b88b0 2023-10-08T11:59:55.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.140+0000 7f27effff640 1 -- 172.21.15.62:0/2671005999 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f27fc003da0 con 0x7f28080b88b0 2023-10-08T11:59:55.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.140+0000 7f280db72640 1 -- 172.21.15.62:0/2671005999 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27f4005260 con 0x7f28080b88b0 2023-10-08T11:59:55.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.140+0000 7f3133043640 1 -- 172.21.15.62:0/1445557938 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f312c1ea750 con 0x7f312c0b9fb0 2023-10-08T11:59:55.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.140+0000 7f3133043640 1 -- 172.21.15.62:0/1445557938 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f312c140c70 con 0x7f312c0b9fb0 2023-10-08T11:59:55.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.140+0000 7f31297fa640 1 -- 172.21.15.62:0/1445557938 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3124009e80 con 0x7f312c0b9fb0 2023-10-08T11:59:55.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.140+0000 7f0ec94a8640 1 -- 172.21.15.62:0/1558634083 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ea4005260 con 0x7f0ec40b57b0 2023-10-08T11:59:55.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.140+0000 7f31297fa640 1 -- 172.21.15.62:0/1445557938 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31240106c0 con 0x7f312c0b9fb0 2023-10-08T11:59:55.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.140+0000 7f31297fa640 1 -- 172.21.15.62:0/1445557938 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f3124010b20 con 0x7f312c0b9fb0 2023-10-08T11:59:55.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.144+0000 7f31297fa640 1 -- 172.21.15.62:0/1445557938 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f312401bca0 con 0x7f312c0b9fb0 2023-10-08T11:59:55.148 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='smithi062') 2023-10-08T11:59:55.148 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='smithi062') 2023-10-08T11:59:55.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.144+0000 7f3133043640 1 -- 172.21.15.62:0/1445557938 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3110005260 con 0x7f312c0b9fb0 2023-10-08T11:59:55.149 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.144+0000 7f27effff640 1 -- 172.21.15.62:0/2671005999 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f27fc0b6070 con 0x7f28080b88b0 2023-10-08T11:59:55.149 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.144+0000 7f0eab7fe640 1 -- 172.21.15.62:0/1558634083 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f0eb80c0060 con 0x7f0ec40b57b0 2023-10-08T11:59:55.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.148+0000 7fb369c54640 1 -- 172.21.15.62:0/3881361003 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb36406be40 msgr2=0x7fb3640b8ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:55.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.148+0000 7fb369c54640 1 --2- 172.21.15.62:0/3881361003 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb36406be40 0x7fb3640b8ca0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb3640b59e0 tx=0x7fb35401d990 comp rx=0 tx=0).stop 2023-10-08T11:59:55.153 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.148+0000 7fb369c54640 1 -- 172.21.15.62:0/3881361003 shutdown_connections 2023-10-08T11:59:55.153 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.148+0000 7fb369c54640 1 --2- 172.21.15.62:0/3881361003 >> v2:172.21.15.130:3300/0 conn(0x7fb36406c220 0x7fb3640b91e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.153 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.148+0000 7fb369c54640 1 --2- 172.21.15.62:0/3881361003 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb36406be40 0x7fb3640b8ca0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.153 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.148+0000 7fb369c54640 1 -- 172.21.15.62:0/3881361003 >> 172.21.15.62:0/3881361003 conn(0x7fb36409c600 msgr2=0x7fb36409ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T11:59:55.153 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.148+0000 7fb369c54640 1 -- 172.21.15.62:0/3881361003 shutdown_connections 2023-10-08T11:59:55.153 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.148+0000 7fb369c54640 1 -- 172.21.15.62:0/3881361003 wait complete. 2023-10-08T11:59:55.154 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.152+0000 7f3acf866640 1 -- 172.21.15.62:0/2093183669 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3ac80b9a70 msgr2=0x7f3ac8099da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:55.154 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.152+0000 7f3acf866640 1 --2- 172.21.15.62:0/2093183669 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3ac80b9a70 0x7f3ac8099da0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3ac0009bf0 tx=0x7f3ac001cbe0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.154 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.152+0000 7f3acf866640 1 -- 172.21.15.62:0/2093183669 shutdown_connections 2023-10-08T11:59:55.154 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.152+0000 7f3acf866640 1 --2- 172.21.15.62:0/2093183669 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3ac80b9a70 0x7f3ac8099da0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.154 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.152+0000 7f3acf866640 1 -- 172.21.15.62:0/2093183669 >> 172.21.15.62:0/2093183669 conn(0x7f3ac809c600 msgr2=0x7f3ac809ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T11:59:55.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.152+0000 7f31297fa640 1 -- 172.21.15.62:0/1445557938 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f3124020060 con 0x7f312c0b9fb0 2023-10-08T11:59:55.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.152+0000 7fb369c54640 1 Processor -- start 2023-10-08T11:59:55.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.152+0000 7f3acf866640 1 -- 172.21.15.62:0/2093183669 shutdown_connections 2023-10-08T11:59:55.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.152+0000 7fb369c54640 1 -- start start 2023-10-08T11:59:55.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.152+0000 7fb369c54640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb36406be40 0x7fb36415e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T11:59:55.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.152+0000 7fb369c54640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb36406c220 0x7fb3641f7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T11:59:55.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.152+0000 7fb369c54640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb364071300 0x7fb3641f7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T11:59:55.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.152+0000 7fb369c54640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3640b0980 con 0x7fb36406c220 2023-10-08T11:59:55.157 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.152+0000 7fb369c54640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb36415e6f0 con 0x7fb36406be40 2023-10-08T11:59:55.157 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.152+0000 7fb369c54640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3640afd90 con 0x7fb364071300 2023-10-08T11:59:55.157 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.152+0000 7f3acf866640 1 -- 172.21.15.62:0/2093183669 wait complete. 2023-10-08T11:59:55.157 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.152+0000 7f3acf866640 1 Processor -- start 2023-10-08T11:59:55.158 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.152+0000 7fb369453640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb364071300 0x7fb3641f7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T11:59:55.159 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.152+0000 7fb368c52640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb36406be40 0x7fb36415e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T11:59:55.159 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.152+0000 7fb369453640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb364071300 0x7fb3641f7e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.62:33032/0 (socket says 172.21.15.62:33032) 2023-10-08T11:59:55.159 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.152+0000 7fb369453640 1 -- 172.21.15.62:0/3943998253 learned_addr learned my addr 172.21.15.62:0/3943998253 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T11:59:55.159 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.152+0000 7fb363fff640 1 --2- 172.21.15.62:0/3943998253 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb36406c220 0x7fb3641f7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T11:59:55.159 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.152+0000 7fb369453640 1 -- 172.21.15.62:0/3943998253 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb36406be40 msgr2=0x7fb36415e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:55.159 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.152+0000 7fb369453640 1 --2- 172.21.15.62:0/3943998253 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb36406be40 0x7fb36415e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.159 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.152+0000 7fb369453640 1 -- 172.21.15.62:0/3943998253 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb36406c220 msgr2=0x7fb3641f7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:55.159 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.152+0000 7fb369453640 1 --2- 172.21.15.62:0/3943998253 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb36406c220 0x7fb3641f7920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.152+0000 7fb369453640 1 -- 172.21.15.62:0/3943998253 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb354009560 con 0x7fb364071300 2023-10-08T11:59:55.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.152+0000 7fb368c52640 1 --2- 172.21.15.62:0/3943998253 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb36406be40 0x7fb36415e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T11:59:55.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.152+0000 7fb363fff640 1 --2- 172.21.15.62:0/3943998253 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb36406c220 0x7fb3641f7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T11:59:55.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.156+0000 7fb369453640 1 --2- 172.21.15.62:0/3943998253 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb364071300 0x7fb3641f7e60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb35c00b990 tx=0x7fb35c00be50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T11:59:55.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.156+0000 7fb3617fa640 1 -- 172.21.15.62:0/3943998253 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb35c00cba0 con 0x7fb364071300 2023-10-08T11:59:55.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.156+0000 7fb369c54640 1 -- 172.21.15.62:0/3943998253 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3641f7440 con 0x7fb364071300 2023-10-08T11:59:55.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.156+0000 7fb369c54640 1 -- 172.21.15.62:0/3943998253 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb364087f70 con 0x7fb364071300 2023-10-08T11:59:55.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.152+0000 7f3acf866640 1 -- start start 2023-10-08T11:59:55.161 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.156+0000 7f3acf866640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3ac80b6d40 0x7f3ac8148610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T11:59:55.161 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.156+0000 7f3acf866640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ac80b88b0 0x7f3ac81e9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T11:59:55.161 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.156+0000 7f3acf866640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3ac80b9a70 0x7f3ac809b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T11:59:55.161 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.156+0000 7f3acf866640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac809be90 con 0x7f3ac80b88b0 2023-10-08T11:59:55.161 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.156+0000 7f3acf866640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac8147bc0 con 0x7f3ac80b6d40 2023-10-08T11:59:55.161 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.156+0000 7f3acf866640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac8148180 con 0x7f3ac80b9a70 2023-10-08T11:59:55.161 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.156+0000 7fb3617fa640 1 -- 172.21.15.62:0/3943998253 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb35c00cdf0 con 0x7fb364071300 2023-10-08T11:59:55.162 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.156+0000 7fb3617fa640 1 -- 172.21.15.62:0/3943998253 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb35c0146a0 con 0x7fb364071300 2023-10-08T11:59:55.162 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.156+0000 7f3acce01640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ac80b88b0 0x7f3ac81e9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T11:59:55.162 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.156+0000 7f3acce01640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ac80b88b0 0x7f3ac81e9ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60552/0 (socket says 172.21.15.62:60552) 2023-10-08T11:59:55.162 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.156+0000 7f3acce01640 1 -- 172.21.15.62:0/2923392722 learned_addr learned my addr 172.21.15.62:0/2923392722 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T11:59:55.163 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.156+0000 7f3acd602640 1 --2- 172.21.15.62:0/2923392722 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3ac80b6d40 0x7f3ac8148610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T11:59:55.163 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.156+0000 7fb3617fa640 1 -- 172.21.15.62:0/3943998253 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb35c014bc0 con 0x7fb364071300 2023-10-08T11:59:55.163 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.156+0000 7fb3617fa640 1 -- 172.21.15.62:0/3943998253 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fb35c01d6f0 con 0x7fb364071300 2023-10-08T11:59:55.164 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.156+0000 7f3acde03640 1 --2- 172.21.15.62:0/2923392722 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3ac80b9a70 0x7f3ac809b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T11:59:55.164 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.156+0000 7f3acce01640 1 -- 172.21.15.62:0/2923392722 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3ac80b9a70 msgr2=0x7f3ac809b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:55.165 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.156+0000 7f3acce01640 1 --2- 172.21.15.62:0/2923392722 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3ac80b9a70 0x7f3ac809b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.165 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.156+0000 7f3acce01640 1 -- 172.21.15.62:0/2923392722 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3ac80b6d40 msgr2=0x7f3ac8148610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:55.165 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.156+0000 7f3acce01640 1 --2- 172.21.15.62:0/2923392722 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3ac80b6d40 0x7f3ac8148610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.165 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.156+0000 7f3acce01640 1 -- 172.21.15.62:0/2923392722 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ac0009820 con 0x7f3ac80b88b0 2023-10-08T11:59:55.165 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.156+0000 7f3acce01640 1 --2- 172.21.15.62:0/2923392722 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ac80b88b0 0x7f3ac81e9ba0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3ab800c400 tx=0x7f3ab800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T11:59:55.165 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.156+0000 7f3abdffb640 1 -- 172.21.15.62:0/2923392722 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab80052d0 con 0x7f3ac80b88b0 2023-10-08T11:59:55.166 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.156+0000 7fac8ab28640 1 -- 172.21.15.62:0/2959065032 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fac84097a70 msgr2=0x7fac8406a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:55.166 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.156+0000 7fac8ab28640 1 --2- 172.21.15.62:0/2959065032 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fac84097a70 0x7fac8406a930 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fac7c009bc0 tx=0x7fac7c01cb40 comp rx=0 tx=0).stop 2023-10-08T11:59:55.166 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.156+0000 7fac8ab28640 1 -- 172.21.15.62:0/2959065032 shutdown_connections 2023-10-08T11:59:55.166 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.156+0000 7fac8ab28640 1 --2- 172.21.15.62:0/2959065032 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fac84097a70 0x7fac8406a930 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.166 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.156+0000 7fac8ab28640 1 --2- 172.21.15.62:0/2959065032 >> v2:172.21.15.62:3300/0 conn(0x7fac840b7460 0x7fac840b5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.166 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.156+0000 7fac8ab28640 1 -- 172.21.15.62:0/2959065032 >> 172.21.15.62:0/2959065032 conn(0x7fac840ba770 msgr2=0x7fac840bab80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T11:59:55.166 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.156+0000 7fac8ab28640 1 -- 172.21.15.62:0/2959065032 shutdown_connections 2023-10-08T11:59:55.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.156+0000 7fac8ab28640 1 -- 172.21.15.62:0/2959065032 wait complete. 2023-10-08T11:59:55.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.156+0000 7f3acf866640 1 -- 172.21.15.62:0/2923392722 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ac8155600 con 0x7f3ac80b88b0 2023-10-08T11:59:55.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.156+0000 7f3acf866640 1 -- 172.21.15.62:0/2923392722 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ac8147e10 con 0x7f3ac80b88b0 2023-10-08T11:59:55.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.156+0000 7f3abdffb640 1 -- 172.21.15.62:0/2923392722 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3ab8003600 con 0x7f3ac80b88b0 2023-10-08T11:59:55.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.156+0000 7f3abdffb640 1 -- 172.21.15.62:0/2923392722 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab8003a10 con 0x7f3ac80b88b0 2023-10-08T11:59:55.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.160+0000 7fb369c54640 1 -- 172.21.15.62:0/3943998253 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb344005260 con 0x7fb364071300 2023-10-08T11:59:55.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.156+0000 7f3abdffb640 1 -- 172.21.15.62:0/2923392722 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f3ab8011590 con 0x7f3ac80b88b0 2023-10-08T11:59:55.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.156+0000 7f3abdffb640 1 -- 172.21.15.62:0/2923392722 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f3ab801c7c0 con 0x7f3ac80b88b0 2023-10-08T11:59:55.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.156+0000 7f3acf866640 1 -- 172.21.15.62:0/2923392722 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3aa8005260 con 0x7f3ac80b88b0 2023-10-08T11:59:55.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.160+0000 7f3abdffb640 1 -- 172.21.15.62:0/2923392722 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f3ab8017070 con 0x7f3ac80b88b0 2023-10-08T11:59:55.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.160+0000 7fac8ab28640 1 Processor -- start 2023-10-08T11:59:55.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.160+0000 7fac8ab28640 1 -- start start 2023-10-08T11:59:55.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.160+0000 7fac8ab28640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fac84097a70 0x7fac8409f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T11:59:55.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.160+0000 7fac8ab28640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac840b6c60 0x7fac8409de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T11:59:55.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.160+0000 7fac8ab28640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac840b7460 0x7fac8409e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T11:59:55.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.160+0000 7fac888c4640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fac84097a70 0x7fac8409f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T11:59:55.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.160+0000 7fac888c4640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fac84097a70 0x7fac8409f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.62:33048/0 (socket says 172.21.15.62:33048) 2023-10-08T11:59:55.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.160+0000 7fac83fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac840b6c60 0x7fac8409de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T11:59:55.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.160+0000 7fac888c4640 1 -- 172.21.15.62:0/1279830780 learned_addr learned my addr 172.21.15.62:0/1279830780 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T11:59:55.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.160+0000 7fac8ab28640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac8409fea0 con 0x7fac840b6c60 2023-10-08T11:59:55.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.160+0000 7fac8ab28640 1 -- 172.21.15.62:0/1279830780 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac8406f030 con 0x7fac840b7460 2023-10-08T11:59:55.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.160+0000 7fac8ab28640 1 -- 172.21.15.62:0/1279830780 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac840a0170 con 0x7fac84097a70 2023-10-08T11:59:55.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.160+0000 7fac890c5640 1 --2- 172.21.15.62:0/1279830780 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac840b7460 0x7fac8409e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T11:59:55.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.160+0000 7fac83fff640 1 -- 172.21.15.62:0/1279830780 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fac84097a70 msgr2=0x7fac8409f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:55.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.160+0000 7fac83fff640 1 --2- 172.21.15.62:0/1279830780 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fac84097a70 0x7fac8409f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.160+0000 7fac83fff640 1 -- 172.21.15.62:0/1279830780 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac840b7460 msgr2=0x7fac8409e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:55.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.160+0000 7fac83fff640 1 --2- 172.21.15.62:0/1279830780 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac840b7460 0x7fac8409e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.160+0000 7fac83fff640 1 -- 172.21.15.62:0/1279830780 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac7c009820 con 0x7fac840b6c60 2023-10-08T11:59:55.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.164+0000 7fac83fff640 1 --2- 172.21.15.62:0/1279830780 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac840b6c60 0x7fac8409de50 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fac7c0ac000 tx=0x7fac7c0a5af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T11:59:55.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.164+0000 7fac817fa640 1 -- 172.21.15.62:0/1279830780 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac7c003b80 con 0x7fac840b6c60 2023-10-08T11:59:55.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.164+0000 7fac8ab28640 1 -- 172.21.15.62:0/1279830780 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac841e23a0 con 0x7fac840b6c60 2023-10-08T11:59:55.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.164+0000 7fac8ab28640 1 -- 172.21.15.62:0/1279830780 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac841e2960 con 0x7fac840b6c60 2023-10-08T11:59:55.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.164+0000 7fac817fa640 1 -- 172.21.15.62:0/1279830780 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fac7c003dd0 con 0x7fac840b6c60 2023-10-08T11:59:55.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.164+0000 7fac817fa640 1 -- 172.21.15.62:0/1279830780 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac7c004290 con 0x7fac840b6c60 2023-10-08T11:59:55.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.164+0000 7fac817fa640 1 -- 172.21.15.62:0/1279830780 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fac7c0b4040 con 0x7fac840b6c60 2023-10-08T11:59:55.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.164+0000 7fac817fa640 1 -- 172.21.15.62:0/1279830780 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fac7c005960 con 0x7fac840b6c60 2023-10-08T11:59:55.172 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.168+0000 7fac8ab28640 1 -- 172.21.15.62:0/1279830780 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac64005260 con 0x7fac840b6c60 2023-10-08T11:59:55.172 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.168+0000 7fb3617fa640 1 -- 172.21.15.62:0/3943998253 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fb35c019070 con 0x7fb364071300 2023-10-08T11:59:55.173 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.172+0000 7fac817fa640 1 -- 172.21.15.62:0/1279830780 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fac7c0bb020 con 0x7fac840b6c60 2023-10-08T11:59:55.176 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.172+0000 7f1ab359e640 1 -- 172.21.15.62:0/510702188 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ab40699f0 msgr2=0x7f1ab409be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:55.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.172+0000 7f1ab359e640 1 --2- 172.21.15.62:0/510702188 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ab40699f0 0x7f1ab409be80 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1aac009c80 tx=0x7f1aac01ccb0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.184+0000 7f1ab359e640 1 -- 172.21.15.62:0/510702188 shutdown_connections 2023-10-08T11:59:55.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.184+0000 7f1ab359e640 1 --2- 172.21.15.62:0/510702188 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1ab4149680 0x7f1ab4153710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.184+0000 7f1ab359e640 1 --2- 172.21.15.62:0/510702188 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ab40699f0 0x7f1ab409be80 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.184+0000 7f1ab359e640 1 -- 172.21.15.62:0/510702188 >> 172.21.15.62:0/510702188 conn(0x7f1ab40b8420 msgr2=0x7f1ab40b8830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T11:59:55.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.184+0000 7fa22edb1640 1 -- 172.21.15.62:0/2027958387 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2280b6c60 msgr2=0x7fa228148b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:55.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.184+0000 7fa22edb1640 1 --2- 172.21.15.62:0/2027958387 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2280b6c60 0x7fa228148b80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa22806cc40 tx=0x7fa22001ccf0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.202 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.200+0000 7fa22edb1640 1 -- 172.21.15.62:0/2027958387 shutdown_connections 2023-10-08T11:59:55.203 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.200+0000 7fa22edb1640 1 --2- 172.21.15.62:0/2027958387 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2280b6c60 0x7fa228148b80 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.203 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.200+0000 7fa22edb1640 1 --2- 172.21.15.62:0/2027958387 >> v2:172.21.15.130:3300/0 conn(0x7fa228097a70 0x7fa228148640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.203 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.200+0000 7fa22edb1640 1 -- 172.21.15.62:0/2027958387 >> 172.21.15.62:0/2027958387 conn(0x7fa2280ba770 msgr2=0x7fa2280bab80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T11:59:55.203 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.200+0000 7fa22edb1640 1 -- 172.21.15.62:0/2027958387 shutdown_connections 2023-10-08T11:59:55.203 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.200+0000 7fa22edb1640 1 -- 172.21.15.62:0/2027958387 wait complete. 2023-10-08T11:59:55.204 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.200+0000 7fa22edb1640 1 Processor -- start 2023-10-08T11:59:55.204 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.200+0000 7fa22edb1640 1 -- start start 2023-10-08T11:59:55.205 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.204+0000 7f1ab359e640 1 -- 172.21.15.62:0/510702188 shutdown_connections 2023-10-08T11:59:55.205 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.204+0000 7f1ab359e640 1 -- 172.21.15.62:0/510702188 wait complete. 2023-10-08T11:59:55.205 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.204+0000 7fa22edb1640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa228097a70 0x7fa2280afd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T11:59:55.205 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.204+0000 7fa22edb1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2280b6c60 0x7fa228141530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T11:59:55.206 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-10-08T11:59:55.204+0000 7fda2a3b2180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T11:59:55.206 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.204+0000 7fa22edb1640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2280b7460 0x7fa2280b0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T11:59:55.206 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.204+0000 7fa22edb1640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa228142b70 con 0x7fa2280b6c60 2023-10-08T11:59:55.207 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.204+0000 7fa22edb1640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa22814b4d0 con 0x7fa2280b7460 2023-10-08T11:59:55.207 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.204+0000 7fa22edb1640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2281e6e40 con 0x7fa228097a70 2023-10-08T11:59:55.207 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.204+0000 7fa227fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2280b6c60 0x7fa228141530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T11:59:55.207 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.204+0000 7fa227fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2280b6c60 0x7fa228141530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60574/0 (socket says 172.21.15.62:60574) 2023-10-08T11:59:55.207 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.204+0000 7fa227fff640 1 -- 172.21.15.62:0/3927275958 learned_addr learned my addr 172.21.15.62:0/3927275958 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T11:59:55.207 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.204+0000 7fa22cb4d640 1 --2- 172.21.15.62:0/3927275958 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa228097a70 0x7fa2280afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T11:59:55.207 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.204+0000 7fa22d34e640 1 --2- 172.21.15.62:0/3927275958 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2280b7460 0x7fa2280b0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T11:59:55.207 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.204+0000 7fa227fff640 1 -- 172.21.15.62:0/3927275958 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa228097a70 msgr2=0x7fa2280afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:55.207 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.204+0000 7fa227fff640 1 --2- 172.21.15.62:0/3927275958 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa228097a70 0x7fa2280afd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.207 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.204+0000 7fa227fff640 1 -- 172.21.15.62:0/3927275958 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2280b7460 msgr2=0x7fa2280b0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:55.207 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.204+0000 7fa227fff640 1 --2- 172.21.15.62:0/3927275958 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2280b7460 0x7fa2280b0650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.207 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.204+0000 7fa227fff640 1 -- 172.21.15.62:0/3927275958 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2200098e0 con 0x7fa2280b6c60 2023-10-08T11:59:55.208 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.204+0000 7fa22cb4d640 1 --2- 172.21.15.62:0/3927275958 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa228097a70 0x7fa2280afd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T11:59:55.208 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.204+0000 7fa227fff640 1 --2- 172.21.15.62:0/3927275958 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2280b6c60 0x7fa228141530 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa21c00b550 tx=0x7fa21c00ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T11:59:55.208 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.204+0000 7f1ab359e640 1 Processor -- start 2023-10-08T11:59:55.209 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.204+0000 7f1ab359e640 1 -- start start 2023-10-08T11:59:55.209 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.204+0000 7f1ab359e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ab40699f0 0x7f1ab4145db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T11:59:55.209 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.204+0000 7f1ab359e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ab4149680 0x7f1ab4144d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T11:59:55.209 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.204+0000 7f1ab359e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1ab413f7b0 0x7f1ab413fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T11:59:55.209 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.204+0000 7f1ab359e640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab4145470 con 0x7f1ab40699f0 2023-10-08T11:59:55.209 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.204+0000 7f1ab359e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab40b44d0 con 0x7f1ab4149680 2023-10-08T11:59:55.209 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.204+0000 7f1ab359e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab4145290 con 0x7f1ab413f7b0 2023-10-08T11:59:55.209 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.204+0000 7f1ab259c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ab40699f0 0x7f1ab4145db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T11:59:55.209 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.204+0000 7f1ab259c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ab40699f0 0x7f1ab4145db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60590/0 (socket says 172.21.15.62:60590) 2023-10-08T11:59:55.209 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.204+0000 7f1ab259c640 1 -- 172.21.15.62:0/1714202601 learned_addr learned my addr 172.21.15.62:0/1714202601 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T11:59:55.209 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.204+0000 7f1ab2d9d640 1 --2- 172.21.15.62:0/1714202601 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1ab413f7b0 0x7f1ab413fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T11:59:55.210 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.204+0000 7f1ab1d9b640 1 --2- 172.21.15.62:0/1714202601 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ab4149680 0x7f1ab4144d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T11:59:55.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.208+0000 7f1ab259c640 1 -- 172.21.15.62:0/1714202601 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1ab413f7b0 msgr2=0x7f1ab413fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:55.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.208+0000 7f1ab259c640 1 --2- 172.21.15.62:0/1714202601 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1ab413f7b0 0x7f1ab413fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.208+0000 7f1ab259c640 1 -- 172.21.15.62:0/1714202601 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ab4149680 msgr2=0x7f1ab4144d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:55.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.208+0000 7f1ab259c640 1 --2- 172.21.15.62:0/1714202601 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ab4149680 0x7f1ab4144d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.208+0000 7f1ab259c640 1 -- 172.21.15.62:0/1714202601 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aac0098e0 con 0x7f1ab40699f0 2023-10-08T11:59:55.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.208+0000 7f1ab1d9b640 1 --2- 172.21.15.62:0/1714202601 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ab4149680 0x7f1ab4144d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T11:59:55.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.208+0000 7f1ab259c640 1 --2- 172.21.15.62:0/1714202601 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ab40699f0 0x7f1ab4145db0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1aac009bd0 tx=0x7f1aac0093f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T11:59:55.212 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.208+0000 7f1aa2ffd640 1 -- 172.21.15.62:0/1714202601 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aac004e60 con 0x7f1ab40699f0 2023-10-08T11:59:55.212 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.208+0000 7f1aa2ffd640 1 -- 172.21.15.62:0/1714202601 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1aac004000 con 0x7f1ab40699f0 2023-10-08T11:59:55.212 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.208+0000 7f1ab359e640 1 -- 172.21.15.62:0/1714202601 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ab4146410 con 0x7f1ab40699f0 2023-10-08T11:59:55.212 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.208+0000 7f1aa2ffd640 1 -- 172.21.15.62:0/1714202601 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aac0043d0 con 0x7f1ab40699f0 2023-10-08T11:59:55.212 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.208+0000 7f1ab359e640 1 -- 172.21.15.62:0/1714202601 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ab4144060 con 0x7f1ab40699f0 2023-10-08T11:59:55.212 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.208+0000 7f1ab359e640 1 -- 172.21.15.62:0/1714202601 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ab404da80 con 0x7f1ab40699f0 2023-10-08T11:59:55.212 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.208+0000 7f1aa2ffd640 1 -- 172.21.15.62:0/1714202601 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f1aac0b4040 con 0x7f1ab40699f0 2023-10-08T11:59:55.213 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.212+0000 7f1aa2ffd640 1 -- 172.21.15.62:0/1714202601 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f1aac0ad440 con 0x7f1ab40699f0 2023-10-08T11:59:55.213 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.212+0000 7fa2257fa640 1 -- 172.21.15.62:0/3927275958 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa21c010870 con 0x7fa2280b6c60 2023-10-08T11:59:55.213 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.212+0000 7fa2257fa640 1 -- 172.21.15.62:0/3927275958 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa21c010ae0 con 0x7fa2280b6c60 2023-10-08T11:59:55.213 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.212+0000 7fa22edb1640 1 -- 172.21.15.62:0/3927275958 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2281e7120 con 0x7fa2280b6c60 2023-10-08T11:59:55.214 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.212+0000 7fa22edb1640 1 -- 172.21.15.62:0/3927275958 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2281e7640 con 0x7fa2280b6c60 2023-10-08T11:59:55.214 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.212+0000 7fa2257fa640 1 -- 172.21.15.62:0/3927275958 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa21c00f3c0 con 0x7fa2280b6c60 2023-10-08T11:59:55.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.212+0000 7fa2257fa640 1 -- 172.21.15.62:0/3927275958 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa21c00f820 con 0x7fa2280b6c60 2023-10-08T11:59:55.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.212+0000 7fa2257fa640 1 -- 172.21.15.62:0/3927275958 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fa21c019ce0 con 0x7fa2280b6c60 2023-10-08T11:59:55.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.212+0000 7f1aa2ffd640 1 -- 172.21.15.62:0/1714202601 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f1aac0b2070 con 0x7f1ab40699f0 2023-10-08T11:59:55.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.216+0000 7fa22edb1640 1 -- 172.21.15.62:0/3927275958 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa20c005260 con 0x7fa2280b6c60 2023-10-08T11:59:55.221 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.220+0000 7fa2257fa640 1 -- 172.21.15.62:0/3927275958 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fa21c038b40 con 0x7fa2280b6c60 2023-10-08T11:59:55.233 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.232+0000 7fa2bf137640 1 -- 172.21.15.62:0/1088817695 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) v1 -- 0x7fa2b804da80 con 0x7fa2b813f530 2023-10-08T11:59:55.243 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.240+0000 7fac38cb8640 1 -- 172.21.15.62:0/3124793079 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) v1 -- 0x7fac18005880 con 0x7fac34069790 2023-10-08T11:59:55.245 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.244+0000 7fa2aeffd640 1 -- 172.21.15.62:0/1088817695 <== mon.2 v2:172.21.15.130:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v13)=0 v13) v1 ==== 118+0+0 (secure 0 0 0) 0x7fa2b40bb020 con 0x7fa2b813f530 2023-10-08T11:59:55.254 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.252+0000 7fac22ffd640 1 -- 172.21.15.62:0/3124793079 <== mon.2 v2:172.21.15.130:3301/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v14)=0 v14) v1 ==== 120+0+0 (secure 0 0 0) 0x7fac240c60b0 con 0x7fac34069790 2023-10-08T11:59:55.259 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-08T11:59:55.256+0000 7fed6f59f180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T11:59:55.269 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.268+0000 7fac38cb8640 1 -- 172.21.15.62:0/3124793079 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fac34069790 msgr2=0x7fac3414bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:55.270 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.268+0000 7fa2bf137640 1 -- 172.21.15.62:0/1088817695 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa2b813f530 msgr2=0x7fa2b8138da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:55.270 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.268+0000 7fa2bf137640 1 --2- 172.21.15.62:0/1088817695 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa2b813f530 0x7fa2b8138da0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa2b40ad000 tx=0x7fa2b400c2d0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.270 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.268+0000 7fa2bf137640 1 -- 172.21.15.62:0/1088817695 shutdown_connections 2023-10-08T11:59:55.270 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.268+0000 7fa2bf137640 1 --2- 172.21.15.62:0/1088817695 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa2b813f530 0x7fa2b8138da0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.270 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.268+0000 7fa2bf137640 1 --2- 172.21.15.62:0/1088817695 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2b8138470 0x7fa2b81d1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.270 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.268+0000 7fa2bf137640 1 --2- 172.21.15.62:0/1088817695 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2b806aa90 0x7fa2b813b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.270 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.268+0000 7fa2bf137640 1 -- 172.21.15.62:0/1088817695 >> 172.21.15.62:0/1088817695 conn(0x7fa2b80b8420 msgr2=0x7fa2b80b6340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T11:59:55.271 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.268+0000 7fac38cb8640 1 --2- 172.21.15.62:0/3124793079 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fac34069790 0x7fac3414bf20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fac24009850 tx=0x7fac24005760 comp rx=0 tx=0).stop 2023-10-08T11:59:55.271 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.268+0000 7fa2bf137640 1 -- 172.21.15.62:0/1088817695 shutdown_connections 2023-10-08T11:59:55.271 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.268+0000 7fa2bf137640 1 -- 172.21.15.62:0/1088817695 wait complete. 2023-10-08T11:59:55.272 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.268+0000 7fac38cb8640 1 -- 172.21.15.62:0/3124793079 shutdown_connections 2023-10-08T11:59:55.272 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.268+0000 7fac38cb8640 1 --2- 172.21.15.62:0/3124793079 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac34149270 0x7fac341e69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.272 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.268+0000 7fac38cb8640 1 --2- 172.21.15.62:0/3124793079 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac340ba2e0 0x7fac340b52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.272 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.268+0000 7fac38cb8640 1 --2- 172.21.15.62:0/3124793079 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fac34069790 0x7fac3414bf20 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.272 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.268+0000 7fac38cb8640 1 -- 172.21.15.62:0/3124793079 >> 172.21.15.62:0/3124793079 conn(0x7fac340a0540 msgr2=0x7fac340bb010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T11:59:55.272 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.268+0000 7fac38cb8640 1 -- 172.21.15.62:0/3124793079 shutdown_connections 2023-10-08T11:59:55.272 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.268+0000 7fac38cb8640 1 -- 172.21.15.62:0/3124793079 wait complete. 2023-10-08T11:59:55.285 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.280+0000 7f3acf866640 1 -- 172.21.15.62:0/2923392722 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) v1 -- 0x7f3aa80050d0 con 0x7f3ac80b88b0 2023-10-08T11:59:55.286 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.284+0000 7f0ec94a8640 1 -- 172.21.15.62:0/1558634083 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) v1 -- 0x7f0ea4005880 con 0x7f0ec40b57b0 2023-10-08T11:59:55.292 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.288+0000 7f3abdffb640 1 -- 172.21.15.62:0/2923392722 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v15)=0 v15) v1 ==== 120+0+0 (secure 0 0 0) 0x7f3ab801c9d0 con 0x7f3ac80b88b0 2023-10-08T11:59:55.295 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.292+0000 7f3ab37fe640 1 -- 172.21.15.62:0/2923392722 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ac80b88b0 msgr2=0x7f3ac81e9ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:55.295 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.292+0000 7f3ab37fe640 1 --2- 172.21.15.62:0/2923392722 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ac80b88b0 0x7f3ac81e9ba0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3ab800c400 tx=0x7f3ab800c8c0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.292+0000 7f3ab37fe640 1 -- 172.21.15.62:0/2923392722 shutdown_connections 2023-10-08T11:59:55.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.292+0000 7f3ab37fe640 1 --2- 172.21.15.62:0/2923392722 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3ac80b9a70 0x7f3ac809b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.292+0000 7f3ab37fe640 1 --2- 172.21.15.62:0/2923392722 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ac80b88b0 0x7f3ac81e9ba0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.292+0000 7f3ab37fe640 1 --2- 172.21.15.62:0/2923392722 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3ac80b6d40 0x7f3ac8148610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.297 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.292+0000 7f3ab37fe640 1 -- 172.21.15.62:0/2923392722 >> 172.21.15.62:0/2923392722 conn(0x7f3ac809c600 msgr2=0x7f3ac80b0150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T11:59:55.297 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi062') 2023-10-08T11:59:55.297 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.292+0000 7f3ab37fe640 1 -- 172.21.15.62:0/2923392722 shutdown_connections 2023-10-08T11:59:55.298 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.292+0000 7f3ab37fe640 1 -- 172.21.15.62:0/2923392722 wait complete. 2023-10-08T11:59:55.298 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.292+0000 7fb369c54640 1 -- 172.21.15.62:0/3943998253 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) v1 -- 0x7fb3440057e0 con 0x7fb364071300 2023-10-08T11:59:55.302 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.296+0000 7f0eab7fe640 1 -- 172.21.15.62:0/1558634083 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v16)=0 v16) v1 ==== 121+0+0 (secure 0 0 0) 0x7f0eb80ac070 con 0x7f0ec40b57b0 2023-10-08T11:59:55.303 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.300+0000 7fac8ab28640 1 -- 172.21.15.62:0/1279830780 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) v1 -- 0x7fac64005880 con 0x7fac840b6c60 2023-10-08T11:59:55.305 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.300+0000 7f0ec94a8640 1 -- 172.21.15.62:0/1558634083 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ec40b57b0 msgr2=0x7f0ec40b7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:55.306 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.300+0000 7f0ec94a8640 1 --2- 172.21.15.62:0/1558634083 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ec40b57b0 0x7f0ec40b7850 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0eb8009790 tx=0x7f0eb80050c0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.306 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.300+0000 7f0ec94a8640 1 -- 172.21.15.62:0/1558634083 shutdown_connections 2023-10-08T11:59:55.306 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.304+0000 7f0ec94a8640 1 --2- 172.21.15.62:0/1558634083 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0ec40b9860 0x7f0ec409dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.306 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.304+0000 7f0ec94a8640 1 --2- 172.21.15.62:0/1558634083 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ec40b9c40 0x7f0ec41e3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.307 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.304+0000 7f0ec94a8640 1 --2- 172.21.15.62:0/1558634083 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ec40b57b0 0x7f0ec40b7850 secure :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0eb8009790 tx=0x7f0eb80050c0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.307 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.304+0000 7f0ec94a8640 1 -- 172.21.15.62:0/1558634083 >> 172.21.15.62:0/1558634083 conn(0x7f0ec409c600 msgr2=0x7f0ec414b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T11:59:55.307 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.304+0000 7f0ec94a8640 1 -- 172.21.15.62:0/1558634083 shutdown_connections 2023-10-08T11:59:55.307 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.304+0000 7f0ec94a8640 1 -- 172.21.15.62:0/1558634083 wait complete. 2023-10-08T11:59:55.315 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.312+0000 7f3133043640 1 -- 172.21.15.62:0/1445557938 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) v1 -- 0x7f3110005880 con 0x7f312c0b9fb0 2023-10-08T11:59:55.319 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.316+0000 7fac817fa640 1 -- 172.21.15.62:0/1279830780 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v17)=0 v17) v1 ==== 121+0+0 (secure 0 0 0) 0x7fac7c0b2070 con 0x7fac840b6c60 2023-10-08T11:59:55.321 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.316+0000 7fac8ab28640 1 -- 172.21.15.62:0/1279830780 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac840b6c60 msgr2=0x7fac8409de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:55.321 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.316+0000 7fac8ab28640 1 --2- 172.21.15.62:0/1279830780 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac840b6c60 0x7fac8409de50 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fac7c0ac000 tx=0x7fac7c0a5af0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.321 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.316+0000 7fac8ab28640 1 -- 172.21.15.62:0/1279830780 shutdown_connections 2023-10-08T11:59:55.321 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.316+0000 7fac8ab28640 1 --2- 172.21.15.62:0/1279830780 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac840b7460 0x7fac8409e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.321 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.316+0000 7fac8ab28640 1 --2- 172.21.15.62:0/1279830780 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac840b6c60 0x7fac8409de50 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.321 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.316+0000 7fac8ab28640 1 --2- 172.21.15.62:0/1279830780 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fac84097a70 0x7fac8409f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.321 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.316+0000 7fac8ab28640 1 -- 172.21.15.62:0/1279830780 >> 172.21.15.62:0/1279830780 conn(0x7fac840ba770 msgr2=0x7fac84150380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T11:59:55.321 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.316+0000 7fac8ab28640 1 -- 172.21.15.62:0/1279830780 shutdown_connections 2023-10-08T11:59:55.321 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.316+0000 7fac8ab28640 1 -- 172.21.15.62:0/1279830780 wait complete. 2023-10-08T11:59:55.329 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.328+0000 7fb3617fa640 1 -- 172.21.15.62:0/3943998253 <== mon.2 v2:172.21.15.130:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb35c01e440 con 0x7fb364071300 2023-10-08T11:59:55.331 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.328+0000 7fb369c54640 1 -- 172.21.15.62:0/3943998253 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb364071300 msgr2=0x7fb3641f7e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:55.331 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.328+0000 7fb369c54640 1 --2- 172.21.15.62:0/3943998253 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb364071300 0x7fb3641f7e60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb35c00b990 tx=0x7fb35c00be50 comp rx=0 tx=0).stop 2023-10-08T11:59:55.331 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.328+0000 7fb369c54640 1 -- 172.21.15.62:0/3943998253 shutdown_connections 2023-10-08T11:59:55.332 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.328+0000 7fb369c54640 1 --2- 172.21.15.62:0/3943998253 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb364071300 0x7fb3641f7e60 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.332 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.328+0000 7fb369c54640 1 --2- 172.21.15.62:0/3943998253 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb36406c220 0x7fb3641f7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.332 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.328+0000 7fb369c54640 1 --2- 172.21.15.62:0/3943998253 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb36406be40 0x7fb36415e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.332 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.328+0000 7fb369c54640 1 -- 172.21.15.62:0/3943998253 >> 172.21.15.62:0/3943998253 conn(0x7fb36409c600 msgr2=0x7fb364071770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T11:59:55.332 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.328+0000 7fb369c54640 1 -- 172.21.15.62:0/3943998253 shutdown_connections 2023-10-08T11:59:55.332 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.328+0000 7fb369c54640 1 -- 172.21.15.62:0/3943998253 wait complete. 2023-10-08T11:59:55.335 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.332+0000 7f31297fa640 1 -- 172.21.15.62:0/1445557938 <== mon.2 v2:172.21.15.130:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v19)=0 v19) v1 ==== 121+0+0 (secure 0 0 0) 0x7f3124017070 con 0x7f312c0b9fb0 2023-10-08T11:59:55.337 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.332+0000 7f3133043640 1 -- 172.21.15.62:0/1445557938 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f312c0b9fb0 msgr2=0x7f312c0b4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:55.337 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.332+0000 7f3133043640 1 --2- 172.21.15.62:0/1445557938 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f312c0b9fb0 0x7f312c0b4510 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f312400d980 tx=0x7f312400de40 comp rx=0 tx=0).stop 2023-10-08T11:59:55.337 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.332+0000 7f3133043640 1 -- 172.21.15.62:0/1445557938 shutdown_connections 2023-10-08T11:59:55.337 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.332+0000 7f3133043640 1 --2- 172.21.15.62:0/1445557938 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f312c0b9fb0 0x7f312c0b4510 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.337 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.332+0000 7f3133043640 1 --2- 172.21.15.62:0/1445557938 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f312c148910 0x7f312c1e6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.337 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.332+0000 7f3133043640 1 --2- 172.21.15.62:0/1445557938 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f312c0b00e0 0x7f312c1d9b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.337 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.332+0000 7f3133043640 1 -- 172.21.15.62:0/1445557938 >> 172.21.15.62:0/1445557938 conn(0x7f312c09c600 msgr2=0x7f312c06a930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T11:59:55.338 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.332+0000 7f3133043640 1 -- 172.21.15.62:0/1445557938 shutdown_connections 2023-10-08T11:59:55.338 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.332+0000 7f3133043640 1 -- 172.21.15.62:0/1445557938 wait complete. 2023-10-08T11:59:55.349 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.348+0000 7f1ab359e640 1 -- 172.21.15.62:0/1714202601 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) v1 -- 0x7f1a98005150 con 0x7f1ab40699f0 2023-10-08T11:59:55.352 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.348+0000 7f280db72640 1 -- 172.21.15.62:0/2671005999 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) v1 -- 0x7f27f40050d0 con 0x7f28080b88b0 2023-10-08T11:59:55.353 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.352+0000 7f1aa2ffd640 1 -- 172.21.15.62:0/1714202601 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v20)=0 v20) v1 ==== 119+0+0 (secure 0 0 0) 0x7f1aac004830 con 0x7f1ab40699f0 2023-10-08T11:59:55.355 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.352+0000 7fa22edb1640 1 -- 172.21.15.62:0/3927275958 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) v1 -- 0x7fa20c0050d0 con 0x7fa2280b6c60 2023-10-08T11:59:55.356 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.352+0000 7f1ab359e640 1 -- 172.21.15.62:0/1714202601 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ab40699f0 msgr2=0x7f1ab4145db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:55.356 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.352+0000 7f1ab359e640 1 --2- 172.21.15.62:0/1714202601 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ab40699f0 0x7f1ab4145db0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1aac009bd0 tx=0x7f1aac0093f0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.356 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.352+0000 7f1ab359e640 1 -- 172.21.15.62:0/1714202601 shutdown_connections 2023-10-08T11:59:55.356 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.352+0000 7f1ab359e640 1 --2- 172.21.15.62:0/1714202601 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1ab413f7b0 0x7f1ab413fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.356 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.352+0000 7f1ab359e640 1 --2- 172.21.15.62:0/1714202601 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ab4149680 0x7f1ab4144d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.356 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.352+0000 7f1ab359e640 1 --2- 172.21.15.62:0/1714202601 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ab40699f0 0x7f1ab4145db0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.357 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.352+0000 7f1ab359e640 1 -- 172.21.15.62:0/1714202601 >> 172.21.15.62:0/1714202601 conn(0x7f1ab40b8420 msgr2=0x7f1ab40b4c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T11:59:55.357 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.352+0000 7f1ab359e640 1 -- 172.21.15.62:0/1714202601 shutdown_connections 2023-10-08T11:59:55.357 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.352+0000 7f1ab359e640 1 -- 172.21.15.62:0/1714202601 wait complete. 2023-10-08T11:59:55.358 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.356+0000 7f27effff640 1 -- 172.21.15.62:0/2671005999 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v21)=0 v21) v1 ==== 115+0+0 (secure 0 0 0) 0x7f27fc003760 con 0x7f28080b88b0 2023-10-08T11:59:55.361 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.356+0000 7f280db72640 1 -- 172.21.15.62:0/2671005999 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28080b88b0 msgr2=0x7f28081ea330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:55.361 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.356+0000 7f280db72640 1 --2- 172.21.15.62:0/2671005999 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28080b88b0 0x7f28081ea330 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f27fc01ded0 tx=0x7f27fc0056e0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.361 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.356+0000 7f280db72640 1 -- 172.21.15.62:0/2671005999 shutdown_connections 2023-10-08T11:59:55.361 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.356+0000 7f280db72640 1 --2- 172.21.15.62:0/2671005999 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f28080b9a70 0x7f28081e7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.361 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.356+0000 7f280db72640 1 --2- 172.21.15.62:0/2671005999 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28080b88b0 0x7f28081ea330 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.361 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.356+0000 7f280db72640 1 --2- 172.21.15.62:0/2671005999 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f28080b6d40 0x7f28081eaef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.361 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.356+0000 7f280db72640 1 -- 172.21.15.62:0/2671005999 >> 172.21.15.62:0/2671005999 conn(0x7f280809c600 msgr2=0x7f2808098930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T11:59:55.361 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.356+0000 7f280db72640 1 -- 172.21.15.62:0/2671005999 shutdown_connections 2023-10-08T11:59:55.361 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.356+0000 7f280db72640 1 -- 172.21.15.62:0/2671005999 wait complete. 2023-10-08T11:59:55.364 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.360+0000 7fa2257fa640 1 -- 172.21.15.62:0/3927275958 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v22)=0 v22) v1 ==== 121+0+0 (secure 0 0 0) 0x7fa21c027030 con 0x7fa2280b6c60 2023-10-08T11:59:55.366 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.364+0000 7fa22edb1640 1 -- 172.21.15.62:0/3927275958 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2280b6c60 msgr2=0x7fa228141530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:55.366 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.364+0000 7fa22edb1640 1 --2- 172.21.15.62:0/3927275958 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2280b6c60 0x7fa228141530 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa21c00b550 tx=0x7fa21c00ba10 comp rx=0 tx=0).stop 2023-10-08T11:59:55.366 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.364+0000 7fa22edb1640 1 -- 172.21.15.62:0/3927275958 shutdown_connections 2023-10-08T11:59:55.366 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.364+0000 7fa22edb1640 1 --2- 172.21.15.62:0/3927275958 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2280b7460 0x7fa2280b0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.366 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.364+0000 7fa22edb1640 1 --2- 172.21.15.62:0/3927275958 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2280b6c60 0x7fa228141530 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.367 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.364+0000 7fa22edb1640 1 --2- 172.21.15.62:0/3927275958 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa228097a70 0x7fa2280afd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.367 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.364+0000 7fa22edb1640 1 -- 172.21.15.62:0/3927275958 >> 172.21.15.62:0/3927275958 conn(0x7fa2280ba770 msgr2=0x7fa22809c500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T11:59:55.367 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.364+0000 7fa22edb1640 1 -- 172.21.15.62:0/3927275958 shutdown_connections 2023-10-08T11:59:55.367 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.364+0000 7fa22edb1640 1 -- 172.21.15.62:0/3927275958 wait complete. 2023-10-08T11:59:55.387 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi062') 2023-10-08T11:59:55.387 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi062') 2023-10-08T11:59:55.387 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi062') 2023-10-08T11:59:55.388 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi062') 2023-10-08T11:59:55.388 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi062') 2023-10-08T11:59:55.388 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi062') 2023-10-08T11:59:55.388 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi062') 2023-10-08T11:59:55.388 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi062') 2023-10-08T11:59:55.389 INFO:tasks.ceph:Setting crush tunables to default 2023-10-08T11:59:55.389 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd crush tunables default 2023-10-08T11:59:55.437 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-08T11:59:55.432+0000 7fed6f59f180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T11:59:55.546 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.544+0000 7f429042a640 1 -- 172.21.15.62:0/3998171402 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42880b7350 msgr2=0x7f428814adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:55.547 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.544+0000 7f429042a640 1 --2- 172.21.15.62:0/3998171402 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42880b7350 0x7f428814adf0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4278009900 tx=0x7f427801f070 comp rx=0 tx=0).stop 2023-10-08T11:59:55.547 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.544+0000 7f429042a640 1 -- 172.21.15.62:0/3998171402 shutdown_connections 2023-10-08T11:59:55.547 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.544+0000 7f429042a640 1 --2- 172.21.15.62:0/3998171402 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f428814b330 0x7f42880701e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.547 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.544+0000 7f429042a640 1 --2- 172.21.15.62:0/3998171402 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42880b7350 0x7f428814adf0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.547 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.544+0000 7f429042a640 1 --2- 172.21.15.62:0/3998171402 >> v2:172.21.15.130:3300/0 conn(0x7f42880bc0c0 0x7f428806cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.547 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.544+0000 7f429042a640 1 -- 172.21.15.62:0/3998171402 >> 172.21.15.62:0/3998171402 conn(0x7f428809e700 msgr2=0x7f428809eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T11:59:55.547 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.544+0000 7f429042a640 1 -- 172.21.15.62:0/3998171402 shutdown_connections 2023-10-08T11:59:55.547 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.544+0000 7f429042a640 1 -- 172.21.15.62:0/3998171402 wait complete. 2023-10-08T11:59:55.550 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.544+0000 7f429042a640 1 Processor -- start 2023-10-08T11:59:55.550 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.544+0000 7f429042a640 1 -- start start 2023-10-08T11:59:55.550 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.544+0000 7f429042a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42880bc0c0 0x7f428809d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T11:59:55.550 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.544+0000 7f429042a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f428814b330 0x7f42880b30a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T11:59:55.550 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.544+0000 7f429042a640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f42881df2c0 0x7f42881e3160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T11:59:55.550 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.544+0000 7f429042a640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42881e2d40 con 0x7f42880bc0c0 2023-10-08T11:59:55.550 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.544+0000 7f429042a640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f428809da70 con 0x7f428814b330 2023-10-08T11:59:55.550 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.544+0000 7f429042a640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42880b6ac0 con 0x7f42881df2c0 2023-10-08T11:59:55.550 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.544+0000 7f428e1c6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42880bc0c0 0x7f428809d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T11:59:55.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.544+0000 7f428e1c6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42880bc0c0 0x7f428809d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60610/0 (socket says 172.21.15.62:60610) 2023-10-08T11:59:55.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.544+0000 7f428e1c6640 1 -- 172.21.15.62:0/712779570 learned_addr learned my addr 172.21.15.62:0/712779570 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T11:59:55.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.544+0000 7f428e9c7640 1 --2- 172.21.15.62:0/712779570 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f42881df2c0 0x7f42881e3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T11:59:55.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.544+0000 7f428d9c5640 1 --2- 172.21.15.62:0/712779570 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f428814b330 0x7f42880b30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T11:59:55.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.544+0000 7f428e1c6640 1 -- 172.21.15.62:0/712779570 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f42881df2c0 msgr2=0x7f42881e3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:55.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.544+0000 7f428e1c6640 1 --2- 172.21.15.62:0/712779570 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f42881df2c0 0x7f42881e3160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.544+0000 7f428e1c6640 1 -- 172.21.15.62:0/712779570 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f428814b330 msgr2=0x7f42880b30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:55.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.544+0000 7f428e1c6640 1 --2- 172.21.15.62:0/712779570 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f428814b330 0x7f42880b30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.544+0000 7f428e1c6640 1 -- 172.21.15.62:0/712779570 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4278009560 con 0x7f42880bc0c0 2023-10-08T11:59:55.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.544+0000 7f428d9c5640 1 --2- 172.21.15.62:0/712779570 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f428814b330 0x7f42880b30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T11:59:55.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.544+0000 7f428e1c6640 1 --2- 172.21.15.62:0/712779570 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42880bc0c0 0x7f428809d530 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f428000d770 tx=0x7f428000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T11:59:55.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.544+0000 7f427effd640 1 -- 172.21.15.62:0/712779570 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4280009c30 con 0x7f42880bc0c0 2023-10-08T11:59:55.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.544+0000 7f427effd640 1 -- 172.21.15.62:0/712779570 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4280009e80 con 0x7f42880bc0c0 2023-10-08T11:59:55.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.544+0000 7f429042a640 1 -- 172.21.15.62:0/712779570 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42880b35e0 con 0x7f42880bc0c0 2023-10-08T11:59:55.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.544+0000 7f427effd640 1 -- 172.21.15.62:0/712779570 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42800106a0 con 0x7f42880bc0c0 2023-10-08T11:59:55.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.544+0000 7f429042a640 1 -- 172.21.15.62:0/712779570 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42880b3850 con 0x7f42880bc0c0 2023-10-08T11:59:55.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.544+0000 7f427effd640 1 -- 172.21.15.62:0/712779570 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f4280010b00 con 0x7f42880bc0c0 2023-10-08T11:59:55.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.544+0000 7f427effd640 1 -- 172.21.15.62:0/712779570 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f428000f3c0 con 0x7f42880bc0c0 2023-10-08T11:59:55.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.548+0000 7f429042a640 1 -- 172.21.15.62:0/712779570 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4288066a30 con 0x7f42880bc0c0 2023-10-08T11:59:55.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.548+0000 7f427effd640 1 -- 172.21.15.62:0/712779570 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f4280021060 con 0x7f42880bc0c0 2023-10-08T11:59:55.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.608+0000 7f429042a640 1 -- 172.21.15.62:0/712779570 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f42880b3a40 con 0x7f42880bc0c0 2023-10-08T11:59:55.614 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.612+0000 7f427effd640 1 -- 172.21.15.62:0/712779570 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f428002b090 con 0x7f42880bc0c0 2023-10-08T11:59:55.614 INFO:teuthology.orchestra.run.smithi062.stderr:adjusted tunables profile to default 2023-10-08T11:59:55.614 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.612+0000 7f429042a640 1 -- 172.21.15.62:0/712779570 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42880bc0c0 msgr2=0x7f428809d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:55.615 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.612+0000 7f429042a640 1 --2- 172.21.15.62:0/712779570 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42880bc0c0 0x7f428809d530 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f428000d770 tx=0x7f428000dc30 comp rx=0 tx=0).stop 2023-10-08T11:59:55.615 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.612+0000 7f429042a640 1 -- 172.21.15.62:0/712779570 shutdown_connections 2023-10-08T11:59:55.615 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.612+0000 7f429042a640 1 --2- 172.21.15.62:0/712779570 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f42881df2c0 0x7f42881e3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.615 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.612+0000 7f429042a640 1 --2- 172.21.15.62:0/712779570 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f428814b330 0x7f42880b30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.615 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.612+0000 7f429042a640 1 --2- 172.21.15.62:0/712779570 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42880bc0c0 0x7f428809d530 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:55.615 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.612+0000 7f429042a640 1 -- 172.21.15.62:0/712779570 >> 172.21.15.62:0/712779570 conn(0x7f428809e700 msgr2=0x7f428806e110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T11:59:55.615 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.612+0000 7f429042a640 1 -- 172.21.15.62:0/712779570 shutdown_connections 2023-10-08T11:59:55.615 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:55.612+0000 7f429042a640 1 -- 172.21.15.62:0/712779570 wait complete. 2023-10-08T11:59:55.630 INFO:tasks.ceph:check_enable_crimson: False 2023-10-08T11:59:55.630 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-08T11:59:55.630 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-10-08T11:59:55.630 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-08T11:59:55.640 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-10-08T11:59:55.640 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-08T11:59:55.694 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-10-08T11:59:55.695 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-08T11:59:55.748 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-10-08T11:59:55.748 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-08T11:59:55.800 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-10-08T11:59:55.796+0000 7fda2a3b2180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T11:59:55.801 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-08T11:59:55.801 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-10-08T11:59:55.814 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-08T11:59:55.814 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-10-08T11:59:55.869 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-08T11:59:55.869 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-10-08T11:59:55.924 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-08T11:59:55.925 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-10-08T11:59:55.976 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --cluster ceph osd new 7bc3070a-7240-43d9-9ec3-397b68a37e2f 0 2023-10-08T11:59:55.991 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-10-08T11:59:55.988+0000 7fda2a3b2180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T11:59:56.000 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-08T11:59:55.996+0000 7fed6f59f180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T11:59:56.055 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-08T11:59:56.052+0000 7fed6f59f180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T11:59:56.109 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-08T11:59:56.104+0000 7fed6f59f180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T11:59:56.122 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.120+0000 7ff257953640 1 -- 172.21.15.130:0/2164101006 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff25006bd90 msgr2=0x7ff25006c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:56.123 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.120+0000 7ff257953640 1 --2- 172.21.15.130:0/2164101006 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff25006bd90 0x7ff25006c170 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff25006cb60 tx=0x7ff24c01cca0 comp rx=0 tx=0).stop 2023-10-08T11:59:56.123 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.120+0000 7ff257953640 1 -- 172.21.15.130:0/2164101006 shutdown_connections 2023-10-08T11:59:56.123 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.120+0000 7ff257953640 1 --2- 172.21.15.130:0/2164101006 >> v2:172.21.15.130:3300/0 conn(0x7ff250149bb0 0x7ff25014a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:56.123 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.120+0000 7ff257953640 1 --2- 172.21.15.130:0/2164101006 >> v2:172.21.15.62:3300/0 conn(0x7ff25006d990 0x7ff2500ba990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:56.123 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.120+0000 7ff257953640 1 --2- 172.21.15.130:0/2164101006 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff25006bd90 0x7ff25006c170 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:56.124 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.120+0000 7ff257953640 1 -- 172.21.15.130:0/2164101006 >> 172.21.15.130:0/2164101006 conn(0x7ff2500b88d0 msgr2=0x7ff2500b8ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T11:59:56.124 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.120+0000 7ff257953640 1 -- 172.21.15.130:0/2164101006 shutdown_connections 2023-10-08T11:59:56.124 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.120+0000 7ff257953640 1 -- 172.21.15.130:0/2164101006 wait complete. 2023-10-08T11:59:56.124 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.120+0000 7ff257953640 1 Processor -- start 2023-10-08T11:59:56.124 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.120+0000 7ff257953640 1 -- start start 2023-10-08T11:59:56.126 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.120+0000 7ff257953640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff25006bd90 0x7ff2501454a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T11:59:56.126 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.120+0000 7ff257953640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff25006d990 0x7ff2500a17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T11:59:56.126 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.120+0000 7ff257953640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff250149bb0 0x7ff2500b17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T11:59:56.126 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.120+0000 7ff257953640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2500b1040 con 0x7ff25006d990 2023-10-08T11:59:56.126 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.120+0000 7ff257953640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2501459e0 con 0x7ff250149bb0 2023-10-08T11:59:56.126 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.120+0000 7ff257953640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2500a0360 con 0x7ff25006bd90 2023-10-08T11:59:56.127 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.120+0000 7ff2556ef640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff25006bd90 0x7ff2501454a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T11:59:56.127 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.120+0000 7ff2556ef640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff25006bd90 0x7ff2501454a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:50300/0 (socket says 172.21.15.130:50300) 2023-10-08T11:59:56.127 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.120+0000 7ff2556ef640 1 -- 172.21.15.130:0/693102553 learned_addr learned my addr 172.21.15.130:0/693102553 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-10-08T11:59:56.127 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.120+0000 7ff255ef0640 1 --2- 172.21.15.130:0/693102553 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff250149bb0 0x7ff2500b17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T11:59:56.127 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.120+0000 7ff254eee640 1 --2- 172.21.15.130:0/693102553 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff25006d990 0x7ff2500a17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T11:59:56.127 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.120+0000 7ff2556ef640 1 -- 172.21.15.130:0/693102553 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff250149bb0 msgr2=0x7ff2500b17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:56.127 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.120+0000 7ff2556ef640 1 --2- 172.21.15.130:0/693102553 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff250149bb0 0x7ff2500b17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:56.127 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.120+0000 7ff2556ef640 1 -- 172.21.15.130:0/693102553 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff25006d990 msgr2=0x7ff2500a17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:56.127 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.120+0000 7ff2556ef640 1 --2- 172.21.15.130:0/693102553 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff25006d990 0x7ff2500a17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:56.127 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.120+0000 7ff2556ef640 1 -- 172.21.15.130:0/693102553 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff24c0098e0 con 0x7ff25006bd90 2023-10-08T11:59:56.127 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.120+0000 7ff2556ef640 1 --2- 172.21.15.130:0/693102553 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff25006bd90 0x7ff2501454a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff24c000f90 tx=0x7ff24c009340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T11:59:56.127 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.120+0000 7ff245ffb640 1 -- 172.21.15.130:0/693102553 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff24c004e60 con 0x7ff25006bd90 2023-10-08T11:59:56.128 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.120+0000 7ff257953640 1 -- 172.21.15.130:0/693102553 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2500a1cf0 con 0x7ff25006bd90 2023-10-08T11:59:56.128 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.120+0000 7ff245ffb640 1 -- 172.21.15.130:0/693102553 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff24c0a5c80 con 0x7ff25006bd90 2023-10-08T11:59:56.128 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.120+0000 7ff245ffb640 1 -- 172.21.15.130:0/693102553 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff24c004260 con 0x7ff25006bd90 2023-10-08T11:59:56.128 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.120+0000 7ff257953640 1 -- 172.21.15.130:0/693102553 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff25009d530 con 0x7ff25006bd90 2023-10-08T11:59:56.128 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.120+0000 7ff257953640 1 -- 172.21.15.130:0/693102553 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff25004da80 con 0x7ff25006bd90 2023-10-08T11:59:56.128 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.120+0000 7ff245ffb640 1 -- 172.21.15.130:0/693102553 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff24c0b4040 con 0x7ff25006bd90 2023-10-08T11:59:56.128 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.124+0000 7ff245ffb640 1 -- 172.21.15.130:0/693102553 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7ff24c005030 con 0x7ff25006bd90 2023-10-08T11:59:56.129 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.124+0000 7ff245ffb640 1 -- 172.21.15.130:0/693102553 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7ff24c0b2070 con 0x7ff25006bd90 2023-10-08T11:59:56.189 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-08T11:59:56.184+0000 7fed6f59f180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T11:59:56.196 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.192+0000 7ff257953640 1 -- 172.21.15.130:0/693102553 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "osd new", "uuid": "7bc3070a-7240-43d9-9ec3-397b68a37e2f", "id": 0} v 0) v1 -- 0x7ff2500a13d0 con 0x7ff25006bd90 2023-10-08T11:59:56.202 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.200+0000 7ff245ffb640 1 -- 172.21.15.130:0/693102553 <== mon.2 v2:172.21.15.130:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7bc3070a-7240-43d9-9ec3-397b68a37e2f", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff24c0046c0 con 0x7ff25006bd90 2023-10-08T11:59:56.202 INFO:teuthology.orchestra.run.smithi130.stdout:0 2023-10-08T11:59:56.204 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.200+0000 7ff257953640 1 -- 172.21.15.130:0/693102553 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff25006bd90 msgr2=0x7ff2501454a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:56.204 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.200+0000 7ff257953640 1 --2- 172.21.15.130:0/693102553 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff25006bd90 0x7ff2501454a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff24c000f90 tx=0x7ff24c009340 comp rx=0 tx=0).stop 2023-10-08T11:59:56.204 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.200+0000 7ff257953640 1 -- 172.21.15.130:0/693102553 shutdown_connections 2023-10-08T11:59:56.204 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.200+0000 7ff257953640 1 --2- 172.21.15.130:0/693102553 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff250149bb0 0x7ff2500b17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:56.204 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.200+0000 7ff257953640 1 --2- 172.21.15.130:0/693102553 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff25006d990 0x7ff2500a17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:56.204 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.200+0000 7ff257953640 1 --2- 172.21.15.130:0/693102553 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff25006bd90 0x7ff2501454a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:56.205 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.200+0000 7ff257953640 1 -- 172.21.15.130:0/693102553 >> 172.21.15.130:0/693102553 conn(0x7ff2500b88d0 msgr2=0x7ff25013db80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T11:59:56.205 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.200+0000 7ff257953640 1 -- 172.21.15.130:0/693102553 shutdown_connections 2023-10-08T11:59:56.205 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.200+0000 7ff257953640 1 -- 172.21.15.130:0/693102553 wait complete. 2023-10-08T11:59:56.224 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --cluster ceph osd new 5e0fa1f5-9ddc-4882-b460-5578bb571003 1 2023-10-08T11:59:56.253 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-08T11:59:56.248+0000 7fed6f59f180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T11:59:56.331 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-08T11:59:56.328+0000 7fed6f59f180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T11:59:56.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.340+0000 7f6b3aaa2640 1 -- 172.21.15.130:0/2283909882 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6b340699f0 msgr2=0x7f6b340b0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:56.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.340+0000 7f6b3aaa2640 1 --2- 172.21.15.130:0/2283909882 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6b340699f0 0x7f6b340b0a10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6b30009900 tx=0x7f6b3001c880 comp rx=0 tx=0).stop 2023-10-08T11:59:56.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.340+0000 7f6b3aaa2640 1 -- 172.21.15.130:0/2283909882 shutdown_connections 2023-10-08T11:59:56.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.340+0000 7f6b3aaa2640 1 --2- 172.21.15.130:0/2283909882 >> v2:172.21.15.130:3300/0 conn(0x7f6b340b1490 0x7f6b340b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:56.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.340+0000 7f6b3aaa2640 1 --2- 172.21.15.130:0/2283909882 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6b340699f0 0x7f6b340b0a10 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:56.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.340+0000 7f6b3aaa2640 1 -- 172.21.15.130:0/2283909882 >> 172.21.15.130:0/2283909882 conn(0x7f6b340b82f0 msgr2=0x7f6b340b8700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T11:59:56.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.340+0000 7f6b3aaa2640 1 -- 172.21.15.130:0/2283909882 shutdown_connections 2023-10-08T11:59:56.343 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.340+0000 7f6b3aaa2640 1 -- 172.21.15.130:0/2283909882 wait complete. 2023-10-08T11:59:56.345 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.340+0000 7f6b3aaa2640 1 Processor -- start 2023-10-08T11:59:56.346 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.340+0000 7f6b3aaa2640 1 -- start start 2023-10-08T11:59:56.346 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.340+0000 7f6b3aaa2640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6b340699f0 0x7f6b3409c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T11:59:56.346 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.340+0000 7f6b3aaa2640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6b340b1490 0x7f6b341e5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T11:59:56.346 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.340+0000 7f6b3aaa2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6b3414ab00 0x7f6b341e6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T11:59:56.346 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.340+0000 7f6b3aaa2640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3409f2f0 con 0x7f6b3414ab00 2023-10-08T11:59:56.346 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.340+0000 7f6b3aaa2640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3409ee50 con 0x7f6b340b1490 2023-10-08T11:59:56.346 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.340+0000 7f6b3aaa2640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3409cda0 con 0x7f6b340699f0 2023-10-08T11:59:56.346 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.340+0000 7f6b3883e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6b340699f0 0x7f6b3409c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T11:59:56.346 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.340+0000 7f6b2bfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6b340b1490 0x7f6b341e5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T11:59:56.346 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.340+0000 7f6b3883e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6b340699f0 0x7f6b3409c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:50322/0 (socket says 172.21.15.130:50322) 2023-10-08T11:59:56.346 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.340+0000 7f6b3883e640 1 -- 172.21.15.130:0/1973431151 learned_addr learned my addr 172.21.15.130:0/1973431151 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-10-08T11:59:56.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.340+0000 7f6b3903f640 1 --2- 172.21.15.130:0/1973431151 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6b3414ab00 0x7f6b341e6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T11:59:56.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.340+0000 7f6b3883e640 1 -- 172.21.15.130:0/1973431151 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6b340b1490 msgr2=0x7f6b341e5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:56.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.340+0000 7f6b3883e640 1 --2- 172.21.15.130:0/1973431151 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6b340b1490 0x7f6b341e5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:56.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.340+0000 7f6b3883e640 1 -- 172.21.15.130:0/1973431151 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6b3414ab00 msgr2=0x7f6b341e6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:56.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.340+0000 7f6b3883e640 1 --2- 172.21.15.130:0/1973431151 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6b3414ab00 0x7f6b341e6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:56.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.340+0000 7f6b3883e640 1 -- 172.21.15.130:0/1973431151 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b30009560 con 0x7f6b340699f0 2023-10-08T11:59:56.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.340+0000 7f6b2bfff640 1 --2- 172.21.15.130:0/1973431151 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6b340b1490 0x7f6b341e5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T11:59:56.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.340+0000 7f6b3883e640 1 --2- 172.21.15.130:0/1973431151 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6b340699f0 0x7f6b3409c860 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6b30009850 tx=0x7f6b300a6590 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T11:59:56.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.340+0000 7f6b297fa640 1 -- 172.21.15.130:0/1973431151 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b30004240 con 0x7f6b340699f0 2023-10-08T11:59:56.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.340+0000 7f6b3aaa2640 1 -- 172.21.15.130:0/1973431151 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b3409ff50 con 0x7f6b340699f0 2023-10-08T11:59:56.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.340+0000 7f6b297fa640 1 -- 172.21.15.130:0/1973431151 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6b300043a0 con 0x7f6b340699f0 2023-10-08T11:59:56.347 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.340+0000 7f6b297fa640 1 -- 172.21.15.130:0/1973431151 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b30005290 con 0x7f6b340699f0 2023-10-08T11:59:56.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.340+0000 7f6b3aaa2640 1 -- 172.21.15.130:0/1973431151 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b3406d6c0 con 0x7f6b340699f0 2023-10-08T11:59:56.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.340+0000 7f6b297fa640 1 -- 172.21.15.130:0/1973431151 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6b300053f0 con 0x7f6b340699f0 2023-10-08T11:59:56.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.340+0000 7f6b297fa640 1 -- 172.21.15.130:0/1973431151 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f6b300aa070 con 0x7f6b340699f0 2023-10-08T11:59:56.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.344+0000 7f6b3aaa2640 1 -- 172.21.15.130:0/1973431151 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b341e5a40 con 0x7f6b340699f0 2023-10-08T11:59:56.348 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.344+0000 7f6b297fa640 1 -- 172.21.15.130:0/1973431151 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f6b341e5a40 con 0x7f6b340699f0 2023-10-08T11:59:56.385 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-08T11:59:56.380+0000 7fed6f59f180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T11:59:56.415 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.412+0000 7f6b3aaa2640 1 -- 172.21.15.130:0/1973431151 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "osd new", "uuid": "5e0fa1f5-9ddc-4882-b460-5578bb571003", "id": 1} v 0) v1 -- 0x7f6b3404da80 con 0x7f6b340699f0 2023-10-08T11:59:56.421 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.416+0000 7f6b297fa640 1 -- 172.21.15.130:0/1973431151 <== mon.2 v2:172.21.15.130:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5e0fa1f5-9ddc-4882-b460-5578bb571003", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6b300bc020 con 0x7f6b340699f0 2023-10-08T11:59:56.421 INFO:teuthology.orchestra.run.smithi130.stdout:1 2023-10-08T11:59:56.422 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.420+0000 7f6b3aaa2640 1 -- 172.21.15.130:0/1973431151 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6b340699f0 msgr2=0x7f6b3409c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:56.422 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.420+0000 7f6b3aaa2640 1 --2- 172.21.15.130:0/1973431151 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6b340699f0 0x7f6b3409c860 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6b30009850 tx=0x7f6b300a6590 comp rx=0 tx=0).stop 2023-10-08T11:59:56.423 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.420+0000 7f6b3aaa2640 1 -- 172.21.15.130:0/1973431151 shutdown_connections 2023-10-08T11:59:56.423 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.420+0000 7f6b3aaa2640 1 --2- 172.21.15.130:0/1973431151 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6b3414ab00 0x7f6b341e6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:56.423 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.420+0000 7f6b3aaa2640 1 --2- 172.21.15.130:0/1973431151 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6b340b1490 0x7f6b341e5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:56.423 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.420+0000 7f6b3aaa2640 1 --2- 172.21.15.130:0/1973431151 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6b340699f0 0x7f6b3409c860 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:56.423 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.420+0000 7f6b3aaa2640 1 -- 172.21.15.130:0/1973431151 >> 172.21.15.130:0/1973431151 conn(0x7f6b340b82f0 msgr2=0x7f6b34146e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T11:59:56.423 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.420+0000 7f6b3aaa2640 1 -- 172.21.15.130:0/1973431151 shutdown_connections 2023-10-08T11:59:56.423 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.420+0000 7f6b3aaa2640 1 -- 172.21.15.130:0/1973431151 wait complete. 2023-10-08T11:59:56.438 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --cluster ceph osd new 262b5ee9-4243-4309-a14f-88ad4e8bf812 2 2023-10-08T11:59:56.529 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-08T11:59:56.528+0000 7fed6f59f180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T11:59:56.581 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-10-08T11:59:56.576+0000 7fda2a3b2180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T11:59:56.591 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-08T11:59:56.588+0000 7fed6f59f180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T11:59:56.600 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.596+0000 7f4610e3e640 1 -- 172.21.15.130:0/3946439715 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f460c0b1490 msgr2=0x7f460c0b1900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:56.600 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.596+0000 7f4610e3e640 1 --2- 172.21.15.130:0/3946439715 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f460c0b1490 0x7f460c0b1900 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f460c0a1b60 tx=0x7f460001c7e0 comp rx=0 tx=0).stop 2023-10-08T11:59:56.601 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.596+0000 7f4610e3e640 1 -- 172.21.15.130:0/3946439715 shutdown_connections 2023-10-08T11:59:56.601 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.596+0000 7f4610e3e640 1 --2- 172.21.15.130:0/3946439715 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f460c14ab00 0x7f460c14af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:56.601 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.596+0000 7f4610e3e640 1 --2- 172.21.15.130:0/3946439715 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f460c0b1490 0x7f460c0b1900 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:56.601 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.596+0000 7f4610e3e640 1 --2- 172.21.15.130:0/3946439715 >> v2:172.21.15.62:3300/0 conn(0x7f460c0699f0 0x7f460c0b0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:56.601 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.596+0000 7f4610e3e640 1 -- 172.21.15.130:0/3946439715 >> 172.21.15.130:0/3946439715 conn(0x7f460c0b82f0 msgr2=0x7f460c0b8700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T11:59:56.601 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.596+0000 7f4610e3e640 1 -- 172.21.15.130:0/3946439715 shutdown_connections 2023-10-08T11:59:56.601 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.596+0000 7f4610e3e640 1 -- 172.21.15.130:0/3946439715 wait complete. 2023-10-08T11:59:56.603 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.596+0000 7f4610e3e640 1 Processor -- start 2023-10-08T11:59:56.604 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.596+0000 7f4610e3e640 1 -- start start 2023-10-08T11:59:56.604 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.600+0000 7f4610e3e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f460c0699f0 0x7f460c13b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T11:59:56.604 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.600+0000 7f4610e3e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f460c0b1490 0x7f460c1e54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T11:59:56.604 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.600+0000 7f4610e3e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f460c14ab00 0x7f460c14fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T11:59:56.604 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.600+0000 7f4610e3e640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f460c13bea0 con 0x7f460c0699f0 2023-10-08T11:59:56.604 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.600+0000 7f4610e3e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f460c141540 con 0x7f460c14ab00 2023-10-08T11:59:56.604 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.600+0000 7f4610e3e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f460c1e5cd0 con 0x7f460c0b1490 2023-10-08T11:59:56.604 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.600+0000 7f460ad9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f460c14ab00 0x7f460c14fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T11:59:56.604 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.600+0000 7f4609d9b640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f460c0b1490 0x7f460c1e54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T11:59:56.604 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.600+0000 7f460ad9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f460c14ab00 0x7f460c14fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:51126/0 (socket says 172.21.15.130:51126) 2023-10-08T11:59:56.604 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.600+0000 7f460ad9d640 1 -- 172.21.15.130:0/2285333987 learned_addr learned my addr 172.21.15.130:0/2285333987 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-10-08T11:59:56.604 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.600+0000 7f4609d9b640 1 --2- 172.21.15.130:0/2285333987 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f460c0b1490 0x7f460c1e54a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:50336/0 (socket says 172.21.15.130:50336) 2023-10-08T11:59:56.605 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.600+0000 7f460a59c640 1 --2- 172.21.15.130:0/2285333987 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f460c0699f0 0x7f460c13b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T11:59:56.605 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.600+0000 7f4609d9b640 1 -- 172.21.15.130:0/2285333987 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f460c14ab00 msgr2=0x7f460c14fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:56.605 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.600+0000 7f4609d9b640 1 --2- 172.21.15.130:0/2285333987 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f460c14ab00 0x7f460c14fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:56.605 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.600+0000 7f4609d9b640 1 -- 172.21.15.130:0/2285333987 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f460c0699f0 msgr2=0x7f460c13b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:56.605 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.600+0000 7f4609d9b640 1 --2- 172.21.15.130:0/2285333987 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f460c0699f0 0x7f460c13b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:56.605 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.600+0000 7f4609d9b640 1 -- 172.21.15.130:0/2285333987 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46040098e0 con 0x7f460c0b1490 2023-10-08T11:59:56.605 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.600+0000 7f460ad9d640 1 --2- 172.21.15.130:0/2285333987 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f460c14ab00 0x7f460c14fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T11:59:56.605 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.600+0000 7f4609d9b640 1 --2- 172.21.15.130:0/2285333987 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f460c0b1490 0x7f460c1e54a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f460c0b7110 tx=0x7f46000a65d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T11:59:56.605 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.600+0000 7f45faffd640 1 -- 172.21.15.130:0/2285333987 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46000b6070 con 0x7f460c0b1490 2023-10-08T11:59:56.605 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.600+0000 7f45faffd640 1 -- 172.21.15.130:0/2285333987 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4600004030 con 0x7f460c0b1490 2023-10-08T11:59:56.605 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.600+0000 7f4610e3e640 1 -- 172.21.15.130:0/2285333987 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46000094a0 con 0x7f460c0b1490 2023-10-08T11:59:56.605 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.600+0000 7f45faffd640 1 -- 172.21.15.130:0/2285333987 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4600004420 con 0x7f460c0b1490 2023-10-08T11:59:56.606 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.600+0000 7f4610e3e640 1 -- 172.21.15.130:0/2285333987 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f460c1e59e0 con 0x7f460c0b1490 2023-10-08T11:59:56.606 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.600+0000 7f45faffd640 1 -- 172.21.15.130:0/2285333987 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f46000b9070 con 0x7f460c0b1490 2023-10-08T11:59:56.606 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.600+0000 7f45faffd640 1 -- 172.21.15.130:0/2285333987 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f4600004dc0 con 0x7f460c0b1490 2023-10-08T11:59:56.606 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.600+0000 7f4610e3e640 1 -- 172.21.15.130:0/2285333987 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f460c1416f0 con 0x7f460c0b1490 2023-10-08T11:59:56.606 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.604+0000 7f45faffd640 1 -- 172.21.15.130:0/2285333987 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f46000c0060 con 0x7f460c0b1490 2023-10-08T11:59:56.637 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-10-08T11:59:56.632+0000 7fda2a3b2180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T11:59:56.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.668+0000 7f4610e3e640 1 -- 172.21.15.130:0/2285333987 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "osd new", "uuid": "262b5ee9-4243-4309-a14f-88ad4e8bf812", "id": 2} v 0) v1 -- 0x7f460c04da80 con 0x7f460c0b1490 2023-10-08T11:59:56.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.676+0000 7f45faffd640 1 -- 172.21.15.130:0/2285333987 <== mon.2 v2:172.21.15.130:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "262b5ee9-4243-4309-a14f-88ad4e8bf812", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f46000ac070 con 0x7f460c0b1490 2023-10-08T11:59:56.679 INFO:teuthology.orchestra.run.smithi130.stdout:2 2023-10-08T11:59:56.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.676+0000 7f4610e3e640 1 -- 172.21.15.130:0/2285333987 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f460c0b1490 msgr2=0x7f460c1e54a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:56.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.676+0000 7f4610e3e640 1 --2- 172.21.15.130:0/2285333987 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f460c0b1490 0x7f460c1e54a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f460c0b7110 tx=0x7f46000a65d0 comp rx=0 tx=0).stop 2023-10-08T11:59:56.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.676+0000 7f4610e3e640 1 -- 172.21.15.130:0/2285333987 shutdown_connections 2023-10-08T11:59:56.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.676+0000 7f4610e3e640 1 --2- 172.21.15.130:0/2285333987 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f460c0b1490 0x7f460c1e54a0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:56.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.676+0000 7f4610e3e640 1 --2- 172.21.15.130:0/2285333987 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f460c14ab00 0x7f460c14fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:56.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.676+0000 7f4610e3e640 1 --2- 172.21.15.130:0/2285333987 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f460c0699f0 0x7f460c13b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:56.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.676+0000 7f4610e3e640 1 -- 172.21.15.130:0/2285333987 >> 172.21.15.130:0/2285333987 conn(0x7f460c0b82f0 msgr2=0x7f460c13ede0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T11:59:56.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.676+0000 7f4610e3e640 1 -- 172.21.15.130:0/2285333987 shutdown_connections 2023-10-08T11:59:56.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.676+0000 7f4610e3e640 1 -- 172.21.15.130:0/2285333987 wait complete. 2023-10-08T11:59:56.692 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-10-08T11:59:56.688+0000 7fda2a3b2180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T11:59:56.696 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --cluster ceph osd new 1770bdb8-c12b-43b1-aaab-1d6b6fd18f4d 3 2023-10-08T11:59:56.772 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-10-08T11:59:56.768+0000 7fda2a3b2180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T11:59:56.811 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.808+0000 7fca25483640 1 -- 172.21.15.130:0/3260540084 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fca200b6e30 msgr2=0x7fca2006b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:56.811 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.808+0000 7fca25483640 1 --2- 172.21.15.130:0/3260540084 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fca200b6e30 0x7fca2006b9b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fca14009840 tx=0x7fca1401c800 comp rx=0 tx=0).stop 2023-10-08T11:59:56.811 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.808+0000 7fca25483640 1 -- 172.21.15.130:0/3260540084 shutdown_connections 2023-10-08T11:59:56.811 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.808+0000 7fca25483640 1 --2- 172.21.15.130:0/3260540084 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fca200b6e30 0x7fca2006b9b0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:56.811 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.808+0000 7fca25483640 1 --2- 172.21.15.130:0/3260540084 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fca200b7b50 0x7fca200b68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:56.811 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.808+0000 7fca25483640 1 -- 172.21.15.130:0/3260540084 >> 172.21.15.130:0/3260540084 conn(0x7fca200b82f0 msgr2=0x7fca200b8700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T11:59:56.811 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.808+0000 7fca25483640 1 -- 172.21.15.130:0/3260540084 shutdown_connections 2023-10-08T11:59:56.811 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.808+0000 7fca25483640 1 -- 172.21.15.130:0/3260540084 wait complete. 2023-10-08T11:59:56.814 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.808+0000 7fca25483640 1 Processor -- start 2023-10-08T11:59:56.814 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.808+0000 7fca25483640 1 -- start start 2023-10-08T11:59:56.814 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.808+0000 7fca25483640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fca2006bef0 0x7fca201e6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T11:59:56.814 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.808+0000 7fca25483640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fca200b6e30 0x7fca200b0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T11:59:56.814 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.808+0000 7fca25483640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fca200b7b50 0x7fca200699f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T11:59:56.814 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.808+0000 7fca25483640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca201e6400 con 0x7fca200b6e30 2023-10-08T11:59:56.814 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.808+0000 7fca25483640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca20069f30 con 0x7fca200b7b50 2023-10-08T11:59:56.814 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.808+0000 7fca25483640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca201e5db0 con 0x7fca2006bef0 2023-10-08T11:59:56.814 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.808+0000 7fca1effd640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fca2006bef0 0x7fca201e6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T11:59:56.815 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.808+0000 7fca1effd640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fca2006bef0 0x7fca201e6820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:50348/0 (socket says 172.21.15.130:50348) 2023-10-08T11:59:56.815 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.808+0000 7fca1effd640 1 -- 172.21.15.130:0/1312017059 learned_addr learned my addr 172.21.15.130:0/1312017059 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-10-08T11:59:56.815 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.808+0000 7fca1f7fe640 1 --2- 172.21.15.130:0/1312017059 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fca200b7b50 0x7fca200699f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T11:59:56.815 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.808+0000 7fca1e7fc640 1 --2- 172.21.15.130:0/1312017059 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fca200b6e30 0x7fca200b0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T11:59:56.815 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.808+0000 7fca1effd640 1 -- 172.21.15.130:0/1312017059 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fca200b7b50 msgr2=0x7fca200699f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:56.815 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.808+0000 7fca1effd640 1 --2- 172.21.15.130:0/1312017059 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fca200b7b50 0x7fca200699f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:56.815 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.808+0000 7fca1effd640 1 -- 172.21.15.130:0/1312017059 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fca200b6e30 msgr2=0x7fca200b0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:56.815 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.808+0000 7fca1effd640 1 --2- 172.21.15.130:0/1312017059 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fca200b6e30 0x7fca200b0c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:56.815 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.808+0000 7fca1effd640 1 -- 172.21.15.130:0/1312017059 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca100094a0 con 0x7fca2006bef0 2023-10-08T11:59:56.816 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.808+0000 7fca1effd640 1 --2- 172.21.15.130:0/1312017059 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fca2006bef0 0x7fca201e6820 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fca1000e9d0 tx=0x7fca1000ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T11:59:56.816 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.808+0000 7fca077fe640 1 -- 172.21.15.130:0/1312017059 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca1000cde0 con 0x7fca2006bef0 2023-10-08T11:59:56.816 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.808+0000 7fca077fe640 1 -- 172.21.15.130:0/1312017059 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fca10004020 con 0x7fca2006bef0 2023-10-08T11:59:56.816 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.808+0000 7fca077fe640 1 -- 172.21.15.130:0/1312017059 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca10004430 con 0x7fca2006bef0 2023-10-08T11:59:56.816 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.808+0000 7fca25483640 1 -- 172.21.15.130:0/1312017059 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca140094a0 con 0x7fca2006bef0 2023-10-08T11:59:56.816 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.808+0000 7fca25483640 1 -- 172.21.15.130:0/1312017059 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca2006a660 con 0x7fca2006bef0 2023-10-08T11:59:56.816 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.808+0000 7fca077fe640 1 -- 172.21.15.130:0/1312017059 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fca10003600 con 0x7fca2006bef0 2023-10-08T11:59:56.816 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.808+0000 7fca077fe640 1 -- 172.21.15.130:0/1312017059 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fca10014070 con 0x7fca2006bef0 2023-10-08T11:59:56.816 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.812+0000 7fca25483640 1 -- 172.21.15.130:0/1312017059 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca201e6670 con 0x7fca2006bef0 2023-10-08T11:59:56.817 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.812+0000 7fca077fe640 1 -- 172.21.15.130:0/1312017059 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fca100038b0 con 0x7fca2006bef0 2023-10-08T11:59:56.826 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-10-08T11:59:56.824+0000 7fda2a3b2180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T11:59:56.883 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.880+0000 7fca25483640 1 -- 172.21.15.130:0/1312017059 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "osd new", "uuid": "1770bdb8-c12b-43b1-aaab-1d6b6fd18f4d", "id": 3} v 0) v1 -- 0x7fca200b2a30 con 0x7fca2006bef0 2023-10-08T11:59:56.895 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.892+0000 7fca077fe640 1 -- 172.21.15.130:0/1312017059 <== mon.2 v2:172.21.15.130:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1770bdb8-c12b-43b1-aaab-1d6b6fd18f4d", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fca10003c20 con 0x7fca2006bef0 2023-10-08T11:59:56.896 INFO:teuthology.orchestra.run.smithi130.stdout:3 2023-10-08T11:59:56.897 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.892+0000 7fca25483640 1 -- 172.21.15.130:0/1312017059 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fca2006bef0 msgr2=0x7fca201e6820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:56.897 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.892+0000 7fca25483640 1 --2- 172.21.15.130:0/1312017059 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fca2006bef0 0x7fca201e6820 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fca1000e9d0 tx=0x7fca1000ee90 comp rx=0 tx=0).stop 2023-10-08T11:59:56.897 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.892+0000 7fca25483640 1 -- 172.21.15.130:0/1312017059 shutdown_connections 2023-10-08T11:59:56.897 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.892+0000 7fca25483640 1 --2- 172.21.15.130:0/1312017059 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fca200b7b50 0x7fca200699f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:56.898 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.892+0000 7fca25483640 1 --2- 172.21.15.130:0/1312017059 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fca200b6e30 0x7fca200b0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:56.898 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.892+0000 7fca25483640 1 --2- 172.21.15.130:0/1312017059 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fca2006bef0 0x7fca201e6820 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:56.898 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.892+0000 7fca25483640 1 -- 172.21.15.130:0/1312017059 >> 172.21.15.130:0/1312017059 conn(0x7fca200b82f0 msgr2=0x7fca20145060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T11:59:56.898 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.892+0000 7fca25483640 1 -- 172.21.15.130:0/1312017059 shutdown_connections 2023-10-08T11:59:56.898 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:56.892+0000 7fca25483640 1 -- 172.21.15.130:0/1312017059 wait complete. 2023-10-08T11:59:56.907 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-10-08T11:59:56.904+0000 7fda2a3b2180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T11:59:56.915 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --cluster ceph osd new 74c73631-9351-494a-8246-28ee86e9f862 4 2023-10-08T11:59:56.961 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-10-08T11:59:56.956+0000 7fda2a3b2180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T11:59:57.062 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.060+0000 7f02a3597640 1 -- 172.21.15.130:0/303466149 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f029c0b6e30 msgr2=0x7f029c06b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:57.062 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.060+0000 7f02a3597640 1 --2- 172.21.15.130:0/303466149 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f029c0b6e30 0x7f029c06b9b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f029c06cde0 tx=0x7f029801cb60 comp rx=0 tx=0).stop 2023-10-08T11:59:57.063 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.060+0000 7f02a3597640 1 -- 172.21.15.130:0/303466149 shutdown_connections 2023-10-08T11:59:57.063 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.060+0000 7f02a3597640 1 --2- 172.21.15.130:0/303466149 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f029c0b6e30 0x7f029c06b9b0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:57.063 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.060+0000 7f02a3597640 1 --2- 172.21.15.130:0/303466149 >> v2:172.21.15.62:3300/0 conn(0x7f029c0b7b50 0x7f029c0b68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:57.063 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.060+0000 7f02a3597640 1 -- 172.21.15.130:0/303466149 >> 172.21.15.130:0/303466149 conn(0x7f029c0b82f0 msgr2=0x7f029c0b8700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T11:59:57.063 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.060+0000 7f02a3597640 1 -- 172.21.15.130:0/303466149 shutdown_connections 2023-10-08T11:59:57.063 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.060+0000 7f02a3597640 1 -- 172.21.15.130:0/303466149 wait complete. 2023-10-08T11:59:57.065 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.060+0000 7f02a3597640 1 Processor -- start 2023-10-08T11:59:57.065 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.060+0000 7f02a3597640 1 -- start start 2023-10-08T11:59:57.065 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.060+0000 7f02a3597640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f029c06bef0 0x7f029c09bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T11:59:57.065 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.060+0000 7f02a3597640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f029c0b6e30 0x7f029c1dff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T11:59:57.065 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.060+0000 7f02a3597640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f029c0b7b50 0x7f029c13e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T11:59:57.065 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.060+0000 7f02a3597640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f029c09ffb0 con 0x7f029c0b7b50 2023-10-08T11:59:57.066 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.060+0000 7f02a3597640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f029c09c2d0 con 0x7f029c06bef0 2023-10-08T11:59:57.066 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.060+0000 7f02a3597640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f029c0a18a0 con 0x7f029c0b6e30 2023-10-08T11:59:57.066 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.060+0000 7f02a0b32640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f029c0b6e30 0x7f029c1dff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T11:59:57.066 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.060+0000 7f02a1333640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f029c06bef0 0x7f029c09bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T11:59:57.066 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.060+0000 7f02a0b32640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f029c0b6e30 0x7f029c1dff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:50364/0 (socket says 172.21.15.130:50364) 2023-10-08T11:59:57.066 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.060+0000 7f02a0b32640 1 -- 172.21.15.130:0/1026335158 learned_addr learned my addr 172.21.15.130:0/1026335158 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-10-08T11:59:57.066 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.060+0000 7f02a1b34640 1 --2- 172.21.15.130:0/1026335158 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f029c0b7b50 0x7f029c13e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T11:59:57.066 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.060+0000 7f02a0b32640 1 -- 172.21.15.130:0/1026335158 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f029c06bef0 msgr2=0x7f029c09bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:57.066 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.060+0000 7f02a0b32640 1 --2- 172.21.15.130:0/1026335158 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f029c06bef0 0x7f029c09bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:57.066 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.060+0000 7f02a0b32640 1 -- 172.21.15.130:0/1026335158 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f029c0b7b50 msgr2=0x7f029c13e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:57.066 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.060+0000 7f02a0b32640 1 --2- 172.21.15.130:0/1026335158 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f029c0b7b50 0x7f029c13e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:57.066 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.060+0000 7f02a0b32640 1 -- 172.21.15.130:0/1026335158 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0298009820 con 0x7f029c0b6e30 2023-10-08T11:59:57.067 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.060+0000 7f02a1b34640 1 --2- 172.21.15.130:0/1026335158 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f029c0b7b50 0x7f029c13e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T11:59:57.067 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.060+0000 7f02a0b32640 1 --2- 172.21.15.130:0/1026335158 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f029c0b6e30 0x7f029c1dff50 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0298000f90 tx=0x7f02980a5a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T11:59:57.067 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.060+0000 7f0291ffb640 1 -- 172.21.15.130:0/1026335158 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0298004b10 con 0x7f029c0b6e30 2023-10-08T11:59:57.067 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.060+0000 7f0291ffb640 1 -- 172.21.15.130:0/1026335158 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0298004d60 con 0x7f029c0b6e30 2023-10-08T11:59:57.067 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.060+0000 7f02a3597640 1 -- 172.21.15.130:0/1026335158 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f029c0a1620 con 0x7f029c0b6e30 2023-10-08T11:59:57.067 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.060+0000 7f0291ffb640 1 -- 172.21.15.130:0/1026335158 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0298004200 con 0x7f029c0b6e30 2023-10-08T11:59:57.067 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.060+0000 7f02a3597640 1 -- 172.21.15.130:0/1026335158 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f029c0a0c10 con 0x7f029c0b6e30 2023-10-08T11:59:57.067 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.060+0000 7f0291ffb640 1 -- 172.21.15.130:0/1026335158 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f02980b4040 con 0x7f029c0b6e30 2023-10-08T11:59:57.067 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.060+0000 7f0291ffb640 1 -- 172.21.15.130:0/1026335158 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f02980ad440 con 0x7f029c0b6e30 2023-10-08T11:59:57.068 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.064+0000 7f02a3597640 1 -- 172.21.15.130:0/1026335158 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f029c09f770 con 0x7f029c0b6e30 2023-10-08T11:59:57.068 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.064+0000 7f0291ffb640 1 -- 172.21.15.130:0/1026335158 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f029c09f770 con 0x7f029c0b6e30 2023-10-08T11:59:57.106 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-10-08T11:59:57.104+0000 7fda2a3b2180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T11:59:57.135 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.132+0000 7f02a3597640 1 -- 172.21.15.130:0/1026335158 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "osd new", "uuid": "74c73631-9351-494a-8246-28ee86e9f862", "id": 4} v 0) v1 -- 0x7f029c04da80 con 0x7f029c0b6e30 2023-10-08T11:59:57.146 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.144+0000 7f0291ffb640 1 -- 172.21.15.130:0/1026335158 <== mon.2 v2:172.21.15.130:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "74c73631-9351-494a-8246-28ee86e9f862", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f02980bc070 con 0x7f029c0b6e30 2023-10-08T11:59:57.147 INFO:teuthology.orchestra.run.smithi130.stdout:4 2023-10-08T11:59:57.148 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.144+0000 7f02a3597640 1 -- 172.21.15.130:0/1026335158 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f029c0b6e30 msgr2=0x7f029c1dff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:57.148 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.144+0000 7f02a3597640 1 --2- 172.21.15.130:0/1026335158 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f029c0b6e30 0x7f029c1dff50 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0298000f90 tx=0x7f02980a5a20 comp rx=0 tx=0).stop 2023-10-08T11:59:57.148 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.144+0000 7f02a3597640 1 -- 172.21.15.130:0/1026335158 shutdown_connections 2023-10-08T11:59:57.149 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.144+0000 7f02a3597640 1 --2- 172.21.15.130:0/1026335158 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f029c0b6e30 0x7f029c1dff50 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:57.149 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.144+0000 7f02a3597640 1 --2- 172.21.15.130:0/1026335158 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f029c0b7b50 0x7f029c13e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:57.149 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.144+0000 7f02a3597640 1 --2- 172.21.15.130:0/1026335158 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f029c06bef0 0x7f029c09bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:57.149 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.144+0000 7f02a3597640 1 -- 172.21.15.130:0/1026335158 >> 172.21.15.130:0/1026335158 conn(0x7f029c0b82f0 msgr2=0x7f029c06a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T11:59:57.149 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.144+0000 7f02a3597640 1 -- 172.21.15.130:0/1026335158 shutdown_connections 2023-10-08T11:59:57.149 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.144+0000 7f02a3597640 1 -- 172.21.15.130:0/1026335158 wait complete. 2023-10-08T11:59:57.164 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --cluster ceph osd new 1040f389-272c-41d6-ae76-70c04d09afa1 5 2023-10-08T11:59:57.169 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-10-08T11:59:57.164+0000 7fda2a3b2180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T11:59:57.224 INFO:tasks.ceph.mgr.x.smithi130.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-10-08T11:59:57.224 INFO:tasks.ceph.mgr.x.smithi130.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-10-08T11:59:57.224 INFO:tasks.ceph.mgr.x.smithi130.stderr: from numpy import show_config as show_numpy_config 2023-10-08T11:59:57.268 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-08T11:59:57.264+0000 7fed6f59f180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T11:59:57.285 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.280+0000 7fb31c51b640 1 -- 172.21.15.130:0/3071679407 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb314065540 msgr2=0x7fb314146d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:57.285 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.280+0000 7fb31c51b640 1 --2- 172.21.15.130:0/3071679407 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb314065540 0x7fb314146d70 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb31406adf0 tx=0x7fb30401c830 comp rx=0 tx=0).stop 2023-10-08T11:59:57.285 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.280+0000 7fb31c51b640 1 -- 172.21.15.130:0/3071679407 shutdown_connections 2023-10-08T11:59:57.286 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.280+0000 7fb31c51b640 1 --2- 172.21.15.130:0/3071679407 >> v2:172.21.15.62:3300/0 conn(0x7fb3141472b0 0x7fb3141516d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:57.286 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.280+0000 7fb31c51b640 1 --2- 172.21.15.130:0/3071679407 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb314065540 0x7fb314146d70 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:57.286 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.280+0000 7fb31c51b640 1 -- 172.21.15.130:0/3071679407 >> 172.21.15.130:0/3071679407 conn(0x7fb3140b7b10 msgr2=0x7fb3140b7f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T11:59:57.286 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.280+0000 7fb31c51b640 1 -- 172.21.15.130:0/3071679407 shutdown_connections 2023-10-08T11:59:57.286 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.280+0000 7fb31c51b640 1 -- 172.21.15.130:0/3071679407 wait complete. 2023-10-08T11:59:57.288 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.284+0000 7fb31c51b640 1 Processor -- start 2023-10-08T11:59:57.288 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.284+0000 7fb31c51b640 1 -- start start 2023-10-08T11:59:57.289 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.284+0000 7fb31c51b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb314065540 0x7fb3141e3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T11:59:57.289 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.284+0000 7fb31c51b640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb314141260 0x7fb314070e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T11:59:57.289 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.284+0000 7fb31c51b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb3141472b0 0x7fb314141640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T11:59:57.289 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.284+0000 7fb31c51b640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3141e4520 con 0x7fb3141472b0 2023-10-08T11:59:57.289 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.284+0000 7fb31c51b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb314071370 con 0x7fb314065540 2023-10-08T11:59:57.289 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.284+0000 7fb31c51b640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb31406e860 con 0x7fb314141260 2023-10-08T11:59:57.289 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.284+0000 7fb31a2b7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb314065540 0x7fb3141e3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T11:59:57.289 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.284+0000 7fb31a2b7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb314065540 0x7fb3141e3fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:51162/0 (socket says 172.21.15.130:51162) 2023-10-08T11:59:57.290 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.284+0000 7fb319ab6640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb314141260 0x7fb314070e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T11:59:57.290 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.284+0000 7fb31a2b7640 1 -- 172.21.15.130:0/1062731589 learned_addr learned my addr 172.21.15.130:0/1062731589 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-10-08T11:59:57.290 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.284+0000 7fb31aab8640 1 --2- 172.21.15.130:0/1062731589 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb3141472b0 0x7fb314141640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T11:59:57.290 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.284+0000 7fb31a2b7640 1 -- 172.21.15.130:0/1062731589 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb314141260 msgr2=0x7fb314070e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:57.290 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.284+0000 7fb31a2b7640 1 --2- 172.21.15.130:0/1062731589 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb314141260 0x7fb314070e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:57.290 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.284+0000 7fb31a2b7640 1 -- 172.21.15.130:0/1062731589 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb3141472b0 msgr2=0x7fb314141640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:57.290 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.284+0000 7fb31a2b7640 1 --2- 172.21.15.130:0/1062731589 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb3141472b0 0x7fb314141640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:57.290 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.284+0000 7fb31a2b7640 1 -- 172.21.15.130:0/1062731589 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb304009560 con 0x7fb314065540 2023-10-08T11:59:57.290 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.284+0000 7fb319ab6640 1 --2- 172.21.15.130:0/1062731589 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb314141260 0x7fb314070e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T11:59:57.290 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.284+0000 7fb31a2b7640 1 --2- 172.21.15.130:0/1062731589 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb314065540 0x7fb3141e3fe0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb31000c4b0 tx=0x7fb31000c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T11:59:57.290 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.284+0000 7fb30affd640 1 -- 172.21.15.130:0/1062731589 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb310012830 con 0x7fb314065540 2023-10-08T11:59:57.291 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.284+0000 7fb30affd640 1 -- 172.21.15.130:0/1062731589 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb310012aa0 con 0x7fb314065540 2023-10-08T11:59:57.291 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.284+0000 7fb31c51b640 1 -- 172.21.15.130:0/1062731589 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3141e47a0 con 0x7fb314065540 2023-10-08T11:59:57.291 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.284+0000 7fb30affd640 1 -- 172.21.15.130:0/1062731589 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb310011380 con 0x7fb314065540 2023-10-08T11:59:57.291 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.284+0000 7fb31c51b640 1 -- 172.21.15.130:0/1062731589 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb314143410 con 0x7fb314065540 2023-10-08T11:59:57.291 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.284+0000 7fb30affd640 1 -- 172.21.15.130:0/1062731589 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb3100117e0 con 0x7fb314065540 2023-10-08T11:59:57.291 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.284+0000 7fb30affd640 1 -- 172.21.15.130:0/1062731589 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fb31001c460 con 0x7fb314065540 2023-10-08T11:59:57.291 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.284+0000 7fb31c51b640 1 -- 172.21.15.130:0/1062731589 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3140739e0 con 0x7fb314065540 2023-10-08T11:59:57.291 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.288+0000 7fb30affd640 1 -- 172.21.15.130:0/1062731589 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fb310011a90 con 0x7fb314065540 2023-10-08T11:59:57.358 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.356+0000 7fb31c51b640 1 -- 172.21.15.130:0/1062731589 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1040f389-272c-41d6-ae76-70c04d09afa1", "id": 5} v 0) v1 -- 0x7fb314144080 con 0x7fb314065540 2023-10-08T11:59:57.368 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.364+0000 7fb30affd640 1 -- 172.21.15.130:0/1062731589 <== mon.1 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1040f389-272c-41d6-ae76-70c04d09afa1", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb310011c30 con 0x7fb314065540 2023-10-08T11:59:57.368 INFO:teuthology.orchestra.run.smithi130.stdout:5 2023-10-08T11:59:57.370 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.368+0000 7fb31c51b640 1 -- 172.21.15.130:0/1062731589 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb314065540 msgr2=0x7fb3141e3fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:57.370 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.368+0000 7fb31c51b640 1 --2- 172.21.15.130:0/1062731589 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb314065540 0x7fb3141e3fe0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb31000c4b0 tx=0x7fb31000c970 comp rx=0 tx=0).stop 2023-10-08T11:59:57.370 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.368+0000 7fb31c51b640 1 -- 172.21.15.130:0/1062731589 shutdown_connections 2023-10-08T11:59:57.370 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.368+0000 7fb31c51b640 1 --2- 172.21.15.130:0/1062731589 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb314141260 0x7fb314070e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:57.370 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.368+0000 7fb31c51b640 1 --2- 172.21.15.130:0/1062731589 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb3141472b0 0x7fb314141640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:57.370 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.368+0000 7fb31c51b640 1 --2- 172.21.15.130:0/1062731589 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb314065540 0x7fb3141e3fe0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:57.370 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.368+0000 7fb31c51b640 1 -- 172.21.15.130:0/1062731589 >> 172.21.15.130:0/1062731589 conn(0x7fb3140b7b10 msgr2=0x7fb3141408e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T11:59:57.370 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.368+0000 7fb31c51b640 1 -- 172.21.15.130:0/1062731589 shutdown_connections 2023-10-08T11:59:57.371 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.368+0000 7fb31c51b640 1 -- 172.21.15.130:0/1062731589 wait complete. 2023-10-08T11:59:57.385 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --cluster ceph osd new 178553eb-03e1-4ab8-9826-4f5997e6da0b 6 2023-10-08T11:59:57.401 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-08T11:59:57.396+0000 7fed6f59f180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T11:59:57.505 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.500+0000 7f4d85bbd640 1 -- 172.21.15.130:0/1019721304 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4d8014b330 msgr2=0x7f4d800701e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:57.505 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.500+0000 7f4d85bbd640 1 --2- 172.21.15.130:0/1019721304 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4d8014b330 0x7f4d800701e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f4d78009c80 tx=0x7f4d7801f560 comp rx=0 tx=0).stop 2023-10-08T11:59:57.505 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.500+0000 7f4d85bbd640 1 -- 172.21.15.130:0/1019721304 shutdown_connections 2023-10-08T11:59:57.505 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.500+0000 7f4d85bbd640 1 --2- 172.21.15.130:0/1019721304 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4d8014b330 0x7f4d800701e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:57.505 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.500+0000 7f4d85bbd640 1 --2- 172.21.15.130:0/1019721304 >> v2:172.21.15.62:3300/0 conn(0x7f4d800b7350 0x7f4d8014adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:57.505 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.500+0000 7f4d85bbd640 1 --2- 172.21.15.130:0/1019721304 >> v2:172.21.15.130:3300/0 conn(0x7f4d800bc0c0 0x7f4d8006cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:57.506 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.500+0000 7f4d85bbd640 1 -- 172.21.15.130:0/1019721304 >> 172.21.15.130:0/1019721304 conn(0x7f4d8009e700 msgr2=0x7f4d8009eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T11:59:57.506 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.500+0000 7f4d85bbd640 1 -- 172.21.15.130:0/1019721304 shutdown_connections 2023-10-08T11:59:57.506 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.500+0000 7f4d85bbd640 1 -- 172.21.15.130:0/1019721304 wait complete. 2023-10-08T11:59:57.508 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.504+0000 7f4d85bbd640 1 Processor -- start 2023-10-08T11:59:57.508 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.504+0000 7f4d85bbd640 1 -- start start 2023-10-08T11:59:57.508 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.504+0000 7f4d85bbd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4d800bc0c0 0x7f4d8006d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T11:59:57.509 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.504+0000 7f4d85bbd640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4d8014b330 0x7f4d801e26d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T11:59:57.509 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.504+0000 7f4d85bbd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4d800b3770 0x7f4d801e2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T11:59:57.509 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.504+0000 7f4d85bbd640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8006da70 con 0x7f4d800bc0c0 2023-10-08T11:59:57.509 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.504+0000 7f4d85bbd640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d800b2220 con 0x7f4d800b3770 2023-10-08T11:59:57.509 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.504+0000 7f4d85bbd640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8009d6d0 con 0x7f4d8014b330 2023-10-08T11:59:57.509 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.504+0000 7f4d7effd640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4d8014b330 0x7f4d801e26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T11:59:57.509 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.504+0000 7f4d7ffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4d800b3770 0x7f4d801e2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T11:59:57.509 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.504+0000 7f4d7effd640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4d8014b330 0x7f4d801e26d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:50390/0 (socket says 172.21.15.130:50390) 2023-10-08T11:59:57.509 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.504+0000 7f4d7effd640 1 -- 172.21.15.130:0/4084527233 learned_addr learned my addr 172.21.15.130:0/4084527233 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-10-08T11:59:57.509 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.504+0000 7f4d7f7fe640 1 --2- 172.21.15.130:0/4084527233 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4d800bc0c0 0x7f4d8006d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T11:59:57.510 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.504+0000 7f4d7ffff640 1 -- 172.21.15.130:0/4084527233 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4d8014b330 msgr2=0x7f4d801e26d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:57.510 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.504+0000 7f4d7ffff640 1 --2- 172.21.15.130:0/4084527233 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4d8014b330 0x7f4d801e26d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:57.510 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.504+0000 7f4d7ffff640 1 -- 172.21.15.130:0/4084527233 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4d800bc0c0 msgr2=0x7f4d8006d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:57.510 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.504+0000 7f4d7ffff640 1 --2- 172.21.15.130:0/4084527233 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4d800bc0c0 0x7f4d8006d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:57.510 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.504+0000 7f4d7ffff640 1 -- 172.21.15.130:0/4084527233 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d780098e0 con 0x7f4d800b3770 2023-10-08T11:59:57.510 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.504+0000 7f4d7effd640 1 --2- 172.21.15.130:0/4084527233 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4d8014b330 0x7f4d801e26d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T11:59:57.510 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.504+0000 7f4d7ffff640 1 --2- 172.21.15.130:0/4084527233 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4d800b3770 0x7f4d801e2c10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f4d780af000 tx=0x7f4d78005af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T11:59:57.510 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.504+0000 7f4d77fff640 1 -- 172.21.15.130:0/4084527233 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d780afa50 con 0x7f4d800b3770 2023-10-08T11:59:57.510 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.504+0000 7f4d77fff640 1 -- 172.21.15.130:0/4084527233 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4d780afca0 con 0x7f4d800b3770 2023-10-08T11:59:57.511 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.504+0000 7f4d85bbd640 1 -- 172.21.15.130:0/4084527233 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d801e21f0 con 0x7f4d800b3770 2023-10-08T11:59:57.511 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.504+0000 7f4d77fff640 1 -- 172.21.15.130:0/4084527233 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d78004240 con 0x7f4d800b3770 2023-10-08T11:59:57.511 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.504+0000 7f4d85bbd640 1 -- 172.21.15.130:0/4084527233 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d800b2780 con 0x7f4d800b3770 2023-10-08T11:59:57.511 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.504+0000 7f4d77fff640 1 -- 172.21.15.130:0/4084527233 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f4d780b6070 con 0x7f4d800b3770 2023-10-08T11:59:57.511 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.504+0000 7f4d77fff640 1 -- 172.21.15.130:0/4084527233 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f4d780c2b30 con 0x7f4d800b3770 2023-10-08T11:59:57.511 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.504+0000 7f4d85bbd640 1 -- 172.21.15.130:0/4084527233 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d801e23f0 con 0x7f4d800b3770 2023-10-08T11:59:57.511 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.508+0000 7f4d77fff640 1 -- 172.21.15.130:0/4084527233 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f4d801e23f0 con 0x7f4d800b3770 2023-10-08T11:59:57.576 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.572+0000 7f4d85bbd640 1 -- 172.21.15.130:0/4084527233 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd new", "uuid": "178553eb-03e1-4ab8-9826-4f5997e6da0b", "id": 6} v 0) v1 -- 0x7f4d80066a30 con 0x7f4d800b3770 2023-10-08T11:59:57.583 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-08T11:59:57.580+0000 7fed6f59f180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T11:59:57.587 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.584+0000 7f4d77fff640 1 -- 172.21.15.130:0/4084527233 <== mon.1 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "178553eb-03e1-4ab8-9826-4f5997e6da0b", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4d780c7060 con 0x7f4d800b3770 2023-10-08T11:59:57.587 INFO:teuthology.orchestra.run.smithi130.stdout:6 2023-10-08T11:59:57.588 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.584+0000 7f4d85bbd640 1 -- 172.21.15.130:0/4084527233 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4d800b3770 msgr2=0x7f4d801e2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:57.588 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.584+0000 7f4d85bbd640 1 --2- 172.21.15.130:0/4084527233 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4d800b3770 0x7f4d801e2c10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f4d780af000 tx=0x7f4d78005af0 comp rx=0 tx=0).stop 2023-10-08T11:59:57.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.584+0000 7f4d85bbd640 1 -- 172.21.15.130:0/4084527233 shutdown_connections 2023-10-08T11:59:57.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.584+0000 7f4d85bbd640 1 --2- 172.21.15.130:0/4084527233 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4d8014b330 0x7f4d801e26d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:57.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.584+0000 7f4d85bbd640 1 --2- 172.21.15.130:0/4084527233 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4d800b3770 0x7f4d801e2c10 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:57.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.584+0000 7f4d85bbd640 1 --2- 172.21.15.130:0/4084527233 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4d800bc0c0 0x7f4d8006d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:57.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.584+0000 7f4d85bbd640 1 -- 172.21.15.130:0/4084527233 >> 172.21.15.130:0/4084527233 conn(0x7f4d8009e700 msgr2=0x7f4d80070840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T11:59:57.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.584+0000 7f4d85bbd640 1 -- 172.21.15.130:0/4084527233 shutdown_connections 2023-10-08T11:59:57.589 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.584+0000 7f4d85bbd640 1 -- 172.21.15.130:0/4084527233 wait complete. 2023-10-08T11:59:57.603 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --cluster ceph osd new b6581c8f-30b1-4dfd-b7b6-94b579128835 7 2023-10-08T11:59:57.649 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-08T11:59:57.644+0000 7fed6f59f180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T11:59:57.773 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.768+0000 7f7048d2a640 1 -- 172.21.15.130:0/1161414044 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70440a0c90 msgr2=0x7f7044145fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:57.773 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.768+0000 7f7048d2a640 1 --2- 172.21.15.130:0/1161414044 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70440a0c90 0x7f7044145fc0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7038009870 tx=0x7f703801c6e0 comp rx=0 tx=0).stop 2023-10-08T11:59:57.773 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.768+0000 7f7048d2a640 1 -- 172.21.15.130:0/1161414044 shutdown_connections 2023-10-08T11:59:57.773 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.768+0000 7f7048d2a640 1 --2- 172.21.15.130:0/1161414044 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70440a0c90 0x7f7044145fc0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:57.773 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.768+0000 7f7048d2a640 1 -- 172.21.15.130:0/1161414044 >> 172.21.15.130:0/1161414044 conn(0x7f70440b7b10 msgr2=0x7f70440b7f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T11:59:57.773 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.768+0000 7f7048d2a640 1 -- 172.21.15.130:0/1161414044 shutdown_connections 2023-10-08T11:59:57.774 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.768+0000 7f7048d2a640 1 -- 172.21.15.130:0/1161414044 wait complete. 2023-10-08T11:59:57.774 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.768+0000 7f7048d2a640 1 Processor -- start 2023-10-08T11:59:57.774 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.768+0000 7f7048d2a640 1 -- start start 2023-10-08T11:59:57.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.772+0000 7f7048d2a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7044065920 0x7f70440b5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T11:59:57.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.772+0000 7f7048d2a640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70440a08b0 0x7f70441e2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T11:59:57.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.772+0000 7f7048d2a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f70440a0c90 0x7f70441e3150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T11:59:57.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.772+0000 7f7048d2a640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70440b61b0 con 0x7f70440a0c90 2023-10-08T11:59:57.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.772+0000 7f7048d2a640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70441e2780 con 0x7f7044065920 2023-10-08T11:59:57.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.772+0000 7f7048d2a640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f704413a1b0 con 0x7f70440a08b0 2023-10-08T11:59:57.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.772+0000 7f7041d9b640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70440a08b0 0x7f70441e2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T11:59:57.776 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.772+0000 7f704259c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7044065920 0x7f70440b5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T11:59:57.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.772+0000 7f7041d9b640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70440a08b0 0x7f70441e2c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:50412/0 (socket says 172.21.15.130:50412) 2023-10-08T11:59:57.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.772+0000 7f7041d9b640 1 -- 172.21.15.130:0/3402422993 learned_addr learned my addr 172.21.15.130:0/3402422993 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-10-08T11:59:57.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.772+0000 7f7042d9d640 1 --2- 172.21.15.130:0/3402422993 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f70440a0c90 0x7f70441e3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T11:59:57.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.772+0000 7f7041d9b640 1 -- 172.21.15.130:0/3402422993 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7044065920 msgr2=0x7f70440b5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:57.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.772+0000 7f7041d9b640 1 --2- 172.21.15.130:0/3402422993 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7044065920 0x7f70440b5c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:57.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.772+0000 7f7041d9b640 1 -- 172.21.15.130:0/3402422993 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f70440a0c90 msgr2=0x7f70441e3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:57.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.772+0000 7f7041d9b640 1 --2- 172.21.15.130:0/3402422993 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f70440a0c90 0x7f70441e3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:57.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.772+0000 7f7041d9b640 1 -- 172.21.15.130:0/3402422993 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70380094a0 con 0x7f70440a08b0 2023-10-08T11:59:57.777 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.772+0000 7f7042d9d640 1 --2- 172.21.15.130:0/3402422993 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f70440a0c90 0x7f70441e3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T11:59:57.778 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.772+0000 7f7041d9b640 1 --2- 172.21.15.130:0/3402422993 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70440a08b0 0x7f70441e2c10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f703801a310 tx=0x7f70380a66b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T11:59:57.778 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.772+0000 7f7032ffd640 1 -- 172.21.15.130:0/3402422993 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70380b6070 con 0x7f70440a08b0 2023-10-08T11:59:57.778 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.772+0000 7f7032ffd640 1 -- 172.21.15.130:0/3402422993 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7038005140 con 0x7f70440a08b0 2023-10-08T11:59:57.778 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.772+0000 7f7048d2a640 1 -- 172.21.15.130:0/3402422993 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7044139bf0 con 0x7f70440a08b0 2023-10-08T11:59:57.778 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.772+0000 7f7032ffd640 1 -- 172.21.15.130:0/3402422993 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7038005530 con 0x7f70440a08b0 2023-10-08T11:59:57.778 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.772+0000 7f7048d2a640 1 -- 172.21.15.130:0/3402422993 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70440b6770 con 0x7f70440a08b0 2023-10-08T11:59:57.778 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.772+0000 7f7032ffd640 1 -- 172.21.15.130:0/3402422993 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f70380046d0 con 0x7f70440a08b0 2023-10-08T11:59:57.778 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.772+0000 7f7048d2a640 1 -- 172.21.15.130:0/3402422993 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70440739e0 con 0x7f70440a08b0 2023-10-08T11:59:57.778 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.772+0000 7f7032ffd640 1 -- 172.21.15.130:0/3402422993 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f70380a7ac0 con 0x7f70440a08b0 2023-10-08T11:59:57.779 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-08T11:59:57.772+0000 7fed6f59f180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T11:59:57.779 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.776+0000 7f7032ffd640 1 -- 172.21.15.130:0/3402422993 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f70380ac070 con 0x7f70440a08b0 2023-10-08T11:59:57.845 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.840+0000 7f7048d2a640 1 -- 172.21.15.130:0/3402422993 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b6581c8f-30b1-4dfd-b7b6-94b579128835", "id": 7} v 0) v1 -- 0x7f704404da80 con 0x7f70440a08b0 2023-10-08T11:59:57.852 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.848+0000 7f7032ffd640 1 -- 172.21.15.130:0/3402422993 <== mon.2 v2:172.21.15.130:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b6581c8f-30b1-4dfd-b7b6-94b579128835", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f70380a7cf0 con 0x7f70440a08b0 2023-10-08T11:59:57.852 INFO:teuthology.orchestra.run.smithi130.stdout:7 2023-10-08T11:59:57.853 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.848+0000 7f7048d2a640 1 -- 172.21.15.130:0/3402422993 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70440a08b0 msgr2=0x7f70441e2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:57.853 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.848+0000 7f7048d2a640 1 --2- 172.21.15.130:0/3402422993 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70440a08b0 0x7f70441e2c10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f703801a310 tx=0x7f70380a66b0 comp rx=0 tx=0).stop 2023-10-08T11:59:57.853 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.848+0000 7f7048d2a640 1 -- 172.21.15.130:0/3402422993 shutdown_connections 2023-10-08T11:59:57.854 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.848+0000 7f7048d2a640 1 --2- 172.21.15.130:0/3402422993 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70440a08b0 0x7f70441e2c10 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:57.854 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.848+0000 7f7048d2a640 1 --2- 172.21.15.130:0/3402422993 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f70440a0c90 0x7f70441e3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:57.854 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.848+0000 7f7048d2a640 1 --2- 172.21.15.130:0/3402422993 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7044065920 0x7f70440b5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:57.854 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.848+0000 7f7048d2a640 1 -- 172.21.15.130:0/3402422993 >> 172.21.15.130:0/3402422993 conn(0x7f70440b7b10 msgr2=0x7f70441447f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T11:59:57.854 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.848+0000 7f7048d2a640 1 -- 172.21.15.130:0/3402422993 shutdown_connections 2023-10-08T11:59:57.854 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-08T11:59:57.848+0000 7f7048d2a640 1 -- 172.21.15.130:0/3402422993 wait complete. 2023-10-08T11:59:57.856 INFO:tasks.ceph.mgr.y.smithi062.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-10-08T11:59:57.856 INFO:tasks.ceph.mgr.y.smithi062.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-10-08T11:59:57.857 INFO:tasks.ceph.mgr.y.smithi062.stderr: from numpy import show_config as show_numpy_config 2023-10-08T11:59:57.873 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-08T11:59:57.873 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-08T11:59:57.877 INFO:tasks.ceph.osd.0:Started 2023-10-08T11:59:57.878 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-08T11:59:57.878 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-08T11:59:57.883 INFO:tasks.ceph.osd.1:Started 2023-10-08T11:59:57.883 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-08T11:59:57.883 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-08T11:59:57.889 INFO:tasks.ceph.osd.2:Started 2023-10-08T11:59:57.889 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-08T11:59:57.889 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-08T11:59:57.893 INFO:tasks.ceph.osd.3:Started 2023-10-08T11:59:57.893 INFO:tasks.ceph.osd.4:Restarting daemon 2023-10-08T11:59:57.893 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-10-08T11:59:57.897 INFO:tasks.ceph.osd.4:Started 2023-10-08T11:59:57.897 INFO:tasks.ceph.osd.5:Restarting daemon 2023-10-08T11:59:57.897 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-10-08T11:59:57.901 INFO:tasks.ceph.osd.5:Started 2023-10-08T11:59:57.901 INFO:tasks.ceph.osd.6:Restarting daemon 2023-10-08T11:59:57.901 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-10-08T11:59:57.903 INFO:tasks.ceph.osd.6:Started 2023-10-08T11:59:57.903 INFO:tasks.ceph.osd.7:Restarting daemon 2023-10-08T11:59:57.904 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-10-08T11:59:57.906 INFO:tasks.ceph.osd.7:Started 2023-10-08T11:59:57.907 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T11:59:57.920 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-10-08T11:59:57.916+0000 7fda2a3b2180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T11:59:58.044 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:58.040+0000 7f91657e4640 1 -- 172.21.15.62:0/1703779429 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f916014b040 msgr2=0x7f9160151890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:58.044 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:58.040+0000 7f91657e4640 1 --2- 172.21.15.62:0/1703779429 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f916014b040 0x7f9160151890 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f91600a1b60 tx=0x7f915801cb60 comp rx=0 tx=0).stop 2023-10-08T11:59:58.044 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:58.040+0000 7f91657e4640 1 -- 172.21.15.62:0/1703779429 shutdown_connections 2023-10-08T11:59:58.044 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:58.040+0000 7f91657e4640 1 --2- 172.21.15.62:0/1703779429 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f916014b040 0x7f9160151890 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:58.044 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:58.040+0000 7f91657e4640 1 --2- 172.21.15.62:0/1703779429 >> v2:172.21.15.130:3300/0 conn(0x7f91600b0a10 0x7f916014ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:58.045 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:58.040+0000 7f91657e4640 1 -- 172.21.15.62:0/1703779429 >> 172.21.15.62:0/1703779429 conn(0x7f91600b82f0 msgr2=0x7f91600b8700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T11:59:58.045 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:58.040+0000 7f91657e4640 1 -- 172.21.15.62:0/1703779429 shutdown_connections 2023-10-08T11:59:58.045 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:58.040+0000 7f91657e4640 1 -- 172.21.15.62:0/1703779429 wait complete. 2023-10-08T11:59:58.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:58.040+0000 7f91657e4640 1 Processor -- start 2023-10-08T11:59:58.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:58.040+0000 7f91657e4640 1 -- start start 2023-10-08T11:59:58.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:58.044+0000 7f91657e4640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91600699f0 0x7f916006bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T11:59:58.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:58.044+0000 7f91657e4640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f91600b0a10 0x7f9160141720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T11:59:58.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:58.044+0000 7f91657e4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f916014b040 0x7f9160141c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T11:59:58.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:58.044+0000 7f91657e4640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f916006c250 con 0x7f91600699f0 2023-10-08T11:59:58.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:58.044+0000 7f91657e4640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f916006d720 con 0x7f916014b040 2023-10-08T11:59:58.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:58.044+0000 7f91657e4640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9160145bf0 con 0x7f91600b0a10 2023-10-08T11:59:58.048 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:58.044+0000 7f915effd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91600699f0 0x7f916006bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T11:59:58.048 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:58.044+0000 7f915effd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91600699f0 0x7f916006bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50328/0 (socket says 172.21.15.62:50328) 2023-10-08T11:59:58.048 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:58.044+0000 7f915effd640 1 -- 172.21.15.62:0/552659399 learned_addr learned my addr 172.21.15.62:0/552659399 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T11:59:58.048 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:58.044+0000 7f915f7fe640 1 --2- 172.21.15.62:0/552659399 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f916014b040 0x7f9160141c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T11:59:58.048 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:58.044+0000 7f915e7fc640 1 --2- 172.21.15.62:0/552659399 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f91600b0a10 0x7f9160141720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T11:59:58.048 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:58.044+0000 7f915effd640 1 -- 172.21.15.62:0/552659399 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f91600b0a10 msgr2=0x7f9160141720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:58.048 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:58.044+0000 7f915effd640 1 --2- 172.21.15.62:0/552659399 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f91600b0a10 0x7f9160141720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:58.048 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:58.044+0000 7f915effd640 1 -- 172.21.15.62:0/552659399 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f916014b040 msgr2=0x7f9160141c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:58.048 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:58.044+0000 7f915effd640 1 --2- 172.21.15.62:0/552659399 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f916014b040 0x7f9160141c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:58.048 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:58.044+0000 7f915effd640 1 -- 172.21.15.62:0/552659399 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9158009820 con 0x7f91600699f0 2023-10-08T11:59:58.048 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:58.044+0000 7f915effd640 1 --2- 172.21.15.62:0/552659399 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91600699f0 0x7f916006bd10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f915000c460 tx=0x7f915000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T11:59:58.048 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:58.044+0000 7f91477fe640 1 -- 172.21.15.62:0/552659399 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9150004230 con 0x7f91600699f0 2023-10-08T11:59:58.049 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:58.044+0000 7f91477fe640 1 -- 172.21.15.62:0/552659399 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f91500044a0 con 0x7f91600699f0 2023-10-08T11:59:58.049 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:58.044+0000 7f91657e4640 1 -- 172.21.15.62:0/552659399 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91600b1db0 con 0x7f91600699f0 2023-10-08T11:59:58.049 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:58.044+0000 7f91477fe640 1 -- 172.21.15.62:0/552659399 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9150012890 con 0x7f91600699f0 2023-10-08T11:59:58.049 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:58.044+0000 7f91657e4640 1 -- 172.21.15.62:0/552659399 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f916006d950 con 0x7f91600699f0 2023-10-08T11:59:58.049 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:58.044+0000 7f91477fe640 1 -- 172.21.15.62:0/552659399 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9150012cf0 con 0x7f91600699f0 2023-10-08T11:59:58.049 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:58.044+0000 7f91477fe640 1 -- 172.21.15.62:0/552659399 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f915001bb70 con 0x7f91600699f0 2023-10-08T11:59:58.049 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:58.044+0000 7f91657e4640 1 -- 172.21.15.62:0/552659399 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f916004da80 con 0x7f91600699f0 2023-10-08T11:59:58.049 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:58.048+0000 7f91477fe640 1 -- 172.21.15.62:0/552659399 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f915001be00 con 0x7f91600699f0 2023-10-08T11:59:58.072 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-10-08T11:59:58.068+0000 7fda2a3b2180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T11:59:58.104 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:58.100+0000 7f91657e4640 1 -- 172.21.15.62:0/552659399 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f91600bab70 con 0x7f91600699f0 2023-10-08T11:59:58.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:58.100+0000 7f91477fe640 1 -- 172.21.15.62:0/552659399 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f915001b5b0 con 0x7f91600699f0 2023-10-08T11:59:58.105 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T11:59:58.105 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":10,"fsid":"3e777930-c2c1-4f2b-a903-c07ee4ca2c52","created":"2023-10-08T11:59:54.510229+0000","modified":"2023-10-08T11:59:57.847944+0000","last_up_change":"0.000000","last_in_change":"2023-10-08T11:59:57.847944+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7bc3070a-7240-43d9-9ec3-397b68a37e2f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5e0fa1f5-9ddc-4882-b460-5578bb571003","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"262b5ee9-4243-4309-a14f-88ad4e8bf812","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"1770bdb8-c12b-43b1-aaab-1d6b6fd18f4d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"74c73631-9351-494a-8246-28ee86e9f862","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"1040f389-272c-41d6-ae76-70c04d09afa1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"178553eb-03e1-4ab8-9826-4f5997e6da0b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"b6581c8f-30b1-4dfd-b7b6-94b579128835","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T11:59:58.106 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:58.104+0000 7f91657e4640 1 -- 172.21.15.62:0/552659399 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91600699f0 msgr2=0x7f916006bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:58.106 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:58.104+0000 7f91657e4640 1 --2- 172.21.15.62:0/552659399 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91600699f0 0x7f916006bd10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f915000c460 tx=0x7f915000c920 comp rx=0 tx=0).stop 2023-10-08T11:59:58.106 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:58.104+0000 7f91657e4640 1 -- 172.21.15.62:0/552659399 shutdown_connections 2023-10-08T11:59:58.106 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:58.104+0000 7f91657e4640 1 --2- 172.21.15.62:0/552659399 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f91600b0a10 0x7f9160141720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:58.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:58.104+0000 7f91657e4640 1 --2- 172.21.15.62:0/552659399 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f916014b040 0x7f9160141c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:58.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:58.104+0000 7f91657e4640 1 --2- 172.21.15.62:0/552659399 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91600699f0 0x7f916006bd10 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:58.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:58.104+0000 7f91657e4640 1 -- 172.21.15.62:0/552659399 >> 172.21.15.62:0/552659399 conn(0x7f91600b82f0 msgr2=0x7f9160149ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T11:59:58.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:58.104+0000 7f91657e4640 1 -- 172.21.15.62:0/552659399 shutdown_connections 2023-10-08T11:59:58.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T11:59:58.104+0000 7f91657e4640 1 -- 172.21.15.62:0/552659399 wait complete. 2023-10-08T11:59:58.121 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-08T11:59:58.121 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-08T11:59:58.247 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-10-08T11:59:58.244+0000 7fda2a3b2180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T11:59:58.335 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-10-08T11:59:58.332+0000 7fda2a3b2180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T11:59:58.408 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-08T11:59:58.404+0000 7fed6f59f180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T11:59:58.463 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-10-08T11:59:58.460+0000 7fda2a3b2180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T11:59:58.483 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-08T11:59:58.480+0000 7fed6f59f180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T11:59:58.510 INFO:tasks.ceph.osd.1.smithi062.stderr:2023-10-08T11:59:58.508+0000 7faa52928640 -1 Falling back to public interface 2023-10-08T11:59:58.511 INFO:tasks.ceph.osd.2.smithi062.stderr:2023-10-08T11:59:58.508+0000 7fb0c74b7640 -1 Falling back to public interface 2023-10-08T11:59:58.523 INFO:tasks.ceph.osd.5.smithi130.stderr:2023-10-08T11:59:58.520+0000 7f24e5180640 -1 Falling back to public interface 2023-10-08T11:59:58.524 INFO:tasks.ceph.osd.4.smithi130.stderr:2023-10-08T11:59:58.520+0000 7f8ce958e640 -1 Falling back to public interface 2023-10-08T11:59:58.524 INFO:tasks.ceph.osd.6.smithi130.stderr:2023-10-08T11:59:58.520+0000 7f80dad2d640 -1 Falling back to public interface 2023-10-08T11:59:58.524 INFO:tasks.ceph.osd.6.smithi130.stderr:2023-10-08T11:59:58.520+0000 7f80d9cee640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6805/0: (98) Address already in use 2023-10-08T11:59:58.526 INFO:tasks.ceph.osd.3.smithi062.stderr:2023-10-08T11:59:58.524+0000 7fb7cca84640 -1 Falling back to public interface 2023-10-08T11:59:58.526 INFO:tasks.ceph.osd.0.smithi062.stderr:2023-10-08T11:59:58.524+0000 7f4faf68c640 -1 Falling back to public interface 2023-10-08T11:59:58.526 INFO:tasks.ceph.osd.0.smithi062.stderr:2023-10-08T11:59:58.524+0000 7f4fae64d640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6817/0: (98) Address already in use 2023-10-08T11:59:58.542 INFO:tasks.ceph.osd.7.smithi130.stderr:2023-10-08T11:59:58.540+0000 7fbc0383e640 -1 Falling back to public interface 2023-10-08T11:59:58.657 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-08T11:59:58.656+0000 7fed6f59f180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T11:59:58.730 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-08T11:59:58.728+0000 7fed6f59f180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T11:59:58.925 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-08T11:59:59.017 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-08T11:59:59.012+0000 7fed6f59f180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T11:59:59.045 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T11:59:59.040+0000 7f420997d640 1 -- 172.21.15.62:0/2907238232 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4204146de0 msgr2=0x7f42040b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:59.045 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T11:59:59.040+0000 7f420997d640 1 --2- 172.21.15.62:0/2907238232 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4204146de0 0x7f42040b8aa0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f41f8009840 tx=0x7f41f801c7d0 comp rx=0 tx=0).stop 2023-10-08T11:59:59.045 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T11:59:59.040+0000 7f420997d640 1 -- 172.21.15.62:0/2907238232 shutdown_connections 2023-10-08T11:59:59.045 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T11:59:59.040+0000 7f420997d640 1 --2- 172.21.15.62:0/2907238232 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4204146de0 0x7f42040b8aa0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:59.045 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T11:59:59.040+0000 7f420997d640 1 --2- 172.21.15.62:0/2907238232 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f420409c060 0x7f42040bc3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:59.046 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T11:59:59.040+0000 7f420997d640 1 -- 172.21.15.62:0/2907238232 >> 172.21.15.62:0/2907238232 conn(0x7f420409e790 msgr2=0x7f420409eba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T11:59:59.046 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T11:59:59.040+0000 7f420997d640 1 -- 172.21.15.62:0/2907238232 shutdown_connections 2023-10-08T11:59:59.046 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T11:59:59.040+0000 7f420997d640 1 -- 172.21.15.62:0/2907238232 wait complete. 2023-10-08T11:59:59.048 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T11:59:59.044+0000 7f420997d640 1 Processor -- start 2023-10-08T11:59:59.048 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T11:59:59.044+0000 7f420997d640 1 -- start start 2023-10-08T11:59:59.048 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T11:59:59.044+0000 7f420997d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f420409c060 0x7f420413fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T11:59:59.048 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T11:59:59.044+0000 7f420997d640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f42040b8fe0 0x7f42041e5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T11:59:59.049 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T11:59:59.044+0000 7f420997d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4204146de0 0x7f42041e6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T11:59:59.049 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T11:59:59.044+0000 7f420997d640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f420406beb0 con 0x7f420409c060 2023-10-08T11:59:59.049 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T11:59:59.044+0000 7f420997d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42041425c0 con 0x7f4204146de0 2023-10-08T11:59:59.049 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T11:59:59.044+0000 7f420997d640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4204142830 con 0x7f42040b8fe0 2023-10-08T11:59:59.049 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T11:59:59.044+0000 7f4202ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f420409c060 0x7f420413fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T11:59:59.049 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T11:59:59.044+0000 7f4202ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f420409c060 0x7f420413fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50342/0 (socket says 172.21.15.62:50342) 2023-10-08T11:59:59.049 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T11:59:59.044+0000 7f4202ffd640 1 -- 172.21.15.62:0/3551935661 learned_addr learned my addr 172.21.15.62:0/3551935661 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T11:59:59.049 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T11:59:59.044+0000 7f42037fe640 1 --2- 172.21.15.62:0/3551935661 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4204146de0 0x7f42041e6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T11:59:59.049 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T11:59:59.044+0000 7f42027fc640 1 --2- 172.21.15.62:0/3551935661 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f42040b8fe0 0x7f42041e5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T11:59:59.050 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T11:59:59.044+0000 7f4202ffd640 1 -- 172.21.15.62:0/3551935661 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f42040b8fe0 msgr2=0x7f42041e5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:59.050 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T11:59:59.044+0000 7f4202ffd640 1 --2- 172.21.15.62:0/3551935661 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f42040b8fe0 0x7f42041e5ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:59.050 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T11:59:59.044+0000 7f4202ffd640 1 -- 172.21.15.62:0/3551935661 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4204146de0 msgr2=0x7f42041e6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:59.050 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T11:59:59.044+0000 7f4202ffd640 1 --2- 172.21.15.62:0/3551935661 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4204146de0 0x7f42041e6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:59.050 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T11:59:59.044+0000 7f4202ffd640 1 -- 172.21.15.62:0/3551935661 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41f80094a0 con 0x7f420409c060 2023-10-08T11:59:59.050 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T11:59:59.044+0000 7f42037fe640 1 --2- 172.21.15.62:0/3551935661 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4204146de0 0x7f42041e6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T11:59:59.050 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T11:59:59.044+0000 7f4202ffd640 1 --2- 172.21.15.62:0/3551935661 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f420409c060 0x7f420413fdb0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f41f400eb30 tx=0x7f41f400c270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T11:59:59.050 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T11:59:59.044+0000 7f41ebfff640 1 -- 172.21.15.62:0/3551935661 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f400ceb0 con 0x7f420409c060 2023-10-08T11:59:59.050 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T11:59:59.044+0000 7f41ebfff640 1 -- 172.21.15.62:0/3551935661 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f41f4011470 con 0x7f420409c060 2023-10-08T11:59:59.050 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T11:59:59.044+0000 7f420997d640 1 -- 172.21.15.62:0/3551935661 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f420406c090 con 0x7f420409c060 2023-10-08T11:59:59.050 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T11:59:59.044+0000 7f41ebfff640 1 -- 172.21.15.62:0/3551935661 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f4011860 con 0x7f420409c060 2023-10-08T11:59:59.050 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T11:59:59.044+0000 7f420997d640 1 -- 172.21.15.62:0/3551935661 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f420406c650 con 0x7f420409c060 2023-10-08T11:59:59.051 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T11:59:59.044+0000 7f41ebfff640 1 -- 172.21.15.62:0/3551935661 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f41f4011cc0 con 0x7f420409c060 2023-10-08T11:59:59.051 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T11:59:59.044+0000 7f41ebfff640 1 -- 172.21.15.62:0/3551935661 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f41f40233f0 con 0x7f420409c060 2023-10-08T11:59:59.051 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T11:59:59.044+0000 7f420997d640 1 -- 172.21.15.62:0/3551935661 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42041e5780 con 0x7f420409c060 2023-10-08T11:59:59.051 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T11:59:59.048+0000 7f41ebfff640 1 -- 172.21.15.62:0/3551935661 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f41f401a400 con 0x7f420409c060 2023-10-08T11:59:59.076 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-08T11:59:59.072+0000 7fed6f59f180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T11:59:59.093 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-10-08T11:59:59.092+0000 7fda2a3b2180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T11:59:59.102 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T11:59:59.100+0000 7f41ebfff640 1 -- 172.21.15.62:0/3551935661 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mgrmap(e 2) v1 ==== 42893+0+0 (secure 0 0 0) 0x7f41f401a5a0 con 0x7f420409c060 2023-10-08T11:59:59.109 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T11:59:59.108+0000 7f420997d640 1 -- 172.21.15.62:0/3551935661 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f420409f610 con 0x7f420409c060 2023-10-08T11:59:59.110 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T11:59:59.108+0000 7f41ebfff640 1 -- 172.21.15.62:0/3551935661 <== mon.0 v2:172.21.15.62:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f41f4019360 con 0x7f420409c060 2023-10-08T11:59:59.110 INFO:teuthology.misc.health.smithi062.stdout: 2023-10-08T11:59:59.110 INFO:teuthology.misc.health.smithi062.stdout:{"epoch":10,"fsid":"3e777930-c2c1-4f2b-a903-c07ee4ca2c52","created":"2023-10-08T11:59:54.510229+0000","modified":"2023-10-08T11:59:57.847944+0000","last_up_change":"0.000000","last_in_change":"2023-10-08T11:59:57.847944+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7bc3070a-7240-43d9-9ec3-397b68a37e2f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5e0fa1f5-9ddc-4882-b460-5578bb571003","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"262b5ee9-4243-4309-a14f-88ad4e8bf812","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"1770bdb8-c12b-43b1-aaab-1d6b6fd18f4d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"74c73631-9351-494a-8246-28ee86e9f862","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"1040f389-272c-41d6-ae76-70c04d09afa1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"178553eb-03e1-4ab8-9826-4f5997e6da0b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"b6581c8f-30b1-4dfd-b7b6-94b579128835","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T11:59:59.111 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T11:59:59.108+0000 7f420997d640 1 -- 172.21.15.62:0/3551935661 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f420409c060 msgr2=0x7f420413fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T11:59:59.111 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T11:59:59.108+0000 7f420997d640 1 --2- 172.21.15.62:0/3551935661 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f420409c060 0x7f420413fdb0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f41f400eb30 tx=0x7f41f400c270 comp rx=0 tx=0).stop 2023-10-08T11:59:59.112 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T11:59:59.108+0000 7f420997d640 1 -- 172.21.15.62:0/3551935661 shutdown_connections 2023-10-08T11:59:59.112 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T11:59:59.108+0000 7f420997d640 1 --2- 172.21.15.62:0/3551935661 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f42040b8fe0 0x7f42041e5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:59.112 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T11:59:59.108+0000 7f420997d640 1 --2- 172.21.15.62:0/3551935661 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4204146de0 0x7f42041e6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:59.112 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T11:59:59.108+0000 7f420997d640 1 --2- 172.21.15.62:0/3551935661 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f420409c060 0x7f420413fdb0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T11:59:59.112 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T11:59:59.108+0000 7f420997d640 1 -- 172.21.15.62:0/3551935661 >> 172.21.15.62:0/3551935661 conn(0x7f420409e790 msgr2=0x7f42041456d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T11:59:59.112 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T11:59:59.108+0000 7f420997d640 1 -- 172.21.15.62:0/3551935661 shutdown_connections 2023-10-08T11:59:59.112 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T11:59:59.108+0000 7f420997d640 1 -- 172.21.15.62:0/3551935661 wait complete. 2023-10-08T11:59:59.126 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-08T11:59:59.178 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-10-08T11:59:59.176+0000 7fda2a3b2180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T11:59:59.356 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-10-08T11:59:59.352+0000 7fda2a3b2180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T11:59:59.432 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-10-08T11:59:59.428+0000 7fda2a3b2180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T11:59:59.735 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-10-08T11:59:59.732+0000 7fda2a3b2180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T11:59:59.797 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-10-08T11:59:59.792+0000 7fda2a3b2180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T12:00:00.121 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-08T12:00:00.116+0000 7fed16d12640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-08T12:00:00.122 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-08T12:00:00.120+0000 7fed16d12640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-08T12:00:02.242 INFO:tasks.ceph.osd.4.smithi130.stderr:2023-10-08T12:00:02.240+0000 7f8ce958e640 -1 osd.4 0 log_to_monitors true 2023-10-08T12:00:02.341 INFO:tasks.ceph.osd.1.smithi062.stderr:2023-10-08T12:00:02.340+0000 7faa52928640 -1 osd.1 0 log_to_monitors true 2023-10-08T12:00:02.369 INFO:tasks.ceph.osd.6.smithi130.stderr:2023-10-08T12:00:02.364+0000 7f80dad2d640 -1 osd.6 0 log_to_monitors true 2023-10-08T12:00:02.374 INFO:tasks.ceph.osd.5.smithi130.stderr:2023-10-08T12:00:02.372+0000 7f24e5180640 -1 osd.5 0 log_to_monitors true 2023-10-08T12:00:02.421 INFO:tasks.ceph.osd.7.smithi130.stderr:2023-10-08T12:00:02.416+0000 7fbc0383e640 -1 osd.7 0 log_to_monitors true 2023-10-08T12:00:02.430 INFO:tasks.ceph.osd.2.smithi062.stderr:2023-10-08T12:00:02.428+0000 7fb0c74b7640 -1 osd.2 0 log_to_monitors true 2023-10-08T12:00:02.473 INFO:tasks.ceph.osd.0.smithi062.stderr:2023-10-08T12:00:02.468+0000 7f4faf68c640 -1 osd.0 0 log_to_monitors true 2023-10-08T12:00:02.497 INFO:tasks.ceph.osd.3.smithi062.stderr:2023-10-08T12:00:02.496+0000 7fb7cca84640 -1 osd.3 0 log_to_monitors true 2023-10-08T12:00:05.780 INFO:tasks.ceph.osd.7.smithi130.stderr:2023-10-08T12:00:05.776+0000 7fbbfefc3640 -1 osd.7 0 waiting for initial osdmap 2023-10-08T12:00:05.810 INFO:tasks.ceph.osd.7.smithi130.stderr:2023-10-08T12:00:05.808+0000 7fbbf760a640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T12:00:05.819 INFO:tasks.ceph.osd.4.smithi130.stderr:2023-10-08T12:00:05.816+0000 7f8ce4d13640 -1 osd.4 0 waiting for initial osdmap 2023-10-08T12:00:05.858 INFO:tasks.ceph.osd.6.smithi130.stderr:2023-10-08T12:00:05.856+0000 7f80d64b2640 -1 osd.6 0 waiting for initial osdmap 2023-10-08T12:00:05.866 INFO:tasks.ceph.osd.4.smithi130.stderr:2023-10-08T12:00:05.864+0000 7f8cdd35a640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T12:00:05.876 INFO:tasks.ceph.osd.1.smithi062.stderr:2023-10-08T12:00:05.872+0000 7faa4e0ad640 -1 osd.1 0 waiting for initial osdmap 2023-10-08T12:00:05.880 INFO:tasks.ceph.osd.5.smithi130.stderr:2023-10-08T12:00:05.876+0000 7f24e0905640 -1 osd.5 0 waiting for initial osdmap 2023-10-08T12:00:05.894 INFO:tasks.ceph.osd.3.smithi062.stderr:2023-10-08T12:00:05.892+0000 7fb7c8209640 -1 osd.3 0 waiting for initial osdmap 2023-10-08T12:00:05.897 INFO:tasks.ceph.osd.6.smithi130.stderr:2023-10-08T12:00:05.896+0000 7f80ceaf9640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T12:00:05.906 INFO:tasks.ceph.osd.5.smithi130.stderr:2023-10-08T12:00:05.904+0000 7f24d8f4c640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T12:00:05.913 INFO:tasks.ceph.osd.0.smithi062.stderr:2023-10-08T12:00:05.912+0000 7f4faae11640 -1 osd.0 0 waiting for initial osdmap 2023-10-08T12:00:05.917 INFO:tasks.ceph.osd.1.smithi062.stderr:2023-10-08T12:00:05.916+0000 7faa466f4640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T12:00:05.929 INFO:tasks.ceph.osd.3.smithi062.stderr:2023-10-08T12:00:05.928+0000 7fb7c0850640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T12:00:05.932 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-08T12:00:05.945 INFO:tasks.ceph.osd.0.smithi062.stderr:2023-10-08T12:00:05.944+0000 7f4fa3458640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T12:00:05.975 INFO:tasks.ceph.osd.2.smithi062.stderr:2023-10-08T12:00:05.972+0000 7fb0c2c3c640 -1 osd.2 0 waiting for initial osdmap 2023-10-08T12:00:06.013 INFO:tasks.ceph.osd.2.smithi062.stderr:2023-10-08T12:00:06.012+0000 7fb0bb283640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T12:00:06.040 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:06.036+0000 7f29d7ef6640 1 -- 172.21.15.62:0/511296769 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f29bc005040 msgr2=0x7f29bc0058e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:06.040 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:06.036+0000 7f29d7ef6640 1 --2- 172.21.15.62:0/511296769 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f29bc005040 0x7f29bc0058e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f29c0009b60 tx=0x7f29c001d250 comp rx=0 tx=0).stop 2023-10-08T12:00:06.040 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:06.036+0000 7f29d6493640 1 -- 172.21.15.62:0/511296769 reap_dead start 2023-10-08T12:00:06.040 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:06.036+0000 7f29d7ef6640 1 -- 172.21.15.62:0/511296769 shutdown_connections 2023-10-08T12:00:06.040 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:06.036+0000 7f29d7ef6640 1 -- 172.21.15.62:0/511296769 >> 172.21.15.62:0/511296769 conn(0x7f29d00b77c0 msgr2=0x7f29d00b7bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:06.040 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:06.036+0000 7f29d7ef6640 1 -- 172.21.15.62:0/511296769 shutdown_connections 2023-10-08T12:00:06.040 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:06.036+0000 7f29d7ef6640 1 -- 172.21.15.62:0/511296769 wait complete. 2023-10-08T12:00:06.042 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:06.036+0000 7f29d7ef6640 1 Processor -- start 2023-10-08T12:00:06.042 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:06.036+0000 7f29d7ef6640 1 -- start start 2023-10-08T12:00:06.042 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:06.040+0000 7f29d7ef6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f29bc005040 0x7f29d00afb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:06.042 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:06.040+0000 7f29d7ef6640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f29d00b0ab0 0x7f29d0097a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:06.043 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:06.040+0000 7f29d7ef6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f29d01419b0 0x7f29d0141e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:06.043 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:06.040+0000 7f29d7ef6640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29d01468f0 con 0x7f29d01419b0 2023-10-08T12:00:06.043 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:06.040+0000 7f29d7ef6640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29d00b0080 con 0x7f29bc005040 2023-10-08T12:00:06.043 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:06.040+0000 7f29d7ef6640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29d01466e0 con 0x7f29d00b0ab0 2023-10-08T12:00:06.043 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:06.040+0000 7f29d6493640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f29d01419b0 0x7f29d0141e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:06.043 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:06.040+0000 7f29d6493640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f29d01419b0 0x7f29d0141e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50374/0 (socket says 172.21.15.62:50374) 2023-10-08T12:00:06.043 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:06.040+0000 7f29d6493640 1 -- 172.21.15.62:0/738503616 learned_addr learned my addr 172.21.15.62:0/738503616 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:06.043 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:06.040+0000 7f29d5c92640 1 --2- 172.21.15.62:0/738503616 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f29bc005040 0x7f29d00afb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:06.043 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:06.040+0000 7f29d5491640 1 --2- 172.21.15.62:0/738503616 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f29d00b0ab0 0x7f29d0097a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:06.043 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:06.040+0000 7f29d6493640 1 -- 172.21.15.62:0/738503616 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f29d00b0ab0 msgr2=0x7f29d0097a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:06.043 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:06.040+0000 7f29d6493640 1 --2- 172.21.15.62:0/738503616 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f29d00b0ab0 0x7f29d0097a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:06.043 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:06.040+0000 7f29d6493640 1 -- 172.21.15.62:0/738503616 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f29bc005040 msgr2=0x7f29d00afb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:06.044 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:06.040+0000 7f29d6493640 1 --2- 172.21.15.62:0/738503616 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f29bc005040 0x7f29d00afb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:06.044 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:06.040+0000 7f29d6493640 1 -- 172.21.15.62:0/738503616 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29d01dfd80 con 0x7f29d01419b0 2023-10-08T12:00:06.044 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:06.040+0000 7f29d6493640 1 --2- 172.21.15.62:0/738503616 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f29d01419b0 0x7f29d0141e10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f29d01499d0 tx=0x7f29c80019c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:06.044 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:06.040+0000 7f29c67fc640 1 -- 172.21.15.62:0/738503616 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c8011870 con 0x7f29d01419b0 2023-10-08T12:00:06.044 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:06.040+0000 7f29c67fc640 1 -- 172.21.15.62:0/738503616 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f29c8002100 con 0x7f29d01419b0 2023-10-08T12:00:06.044 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:06.040+0000 7f29d7ef6640 1 -- 172.21.15.62:0/738503616 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29d01dfa80 con 0x7f29d01419b0 2023-10-08T12:00:06.044 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:06.040+0000 7f29c67fc640 1 -- 172.21.15.62:0/738503616 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c8011d40 con 0x7f29d01419b0 2023-10-08T12:00:06.044 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:06.040+0000 7f29d7ef6640 1 -- 172.21.15.62:0/738503616 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29d0142350 con 0x7f29d01419b0 2023-10-08T12:00:06.045 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:06.040+0000 7f29d7ef6640 1 -- 172.21.15.62:0/738503616 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29d0066a70 con 0x7f29d01419b0 2023-10-08T12:00:06.045 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:06.040+0000 7f29c67fc640 1 -- 172.21.15.62:0/738503616 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 85794+0+0 (secure 0 0 0) 0x7f29c80103c0 con 0x7f29d01419b0 2023-10-08T12:00:06.045 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:06.040+0000 7f29c67fc640 1 --2- 172.21.15.62:0/738503616 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f29b40663e0 0x7f29b40688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:06.045 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:06.040+0000 7f29c67fc640 1 -- 172.21.15.62:0/738503616 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f29c8083890 con 0x7f29d01419b0 2023-10-08T12:00:06.045 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:06.040+0000 7f29d5c92640 1 --2- 172.21.15.62:0/738503616 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f29b40663e0 0x7f29b40688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:06.045 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:06.040+0000 7f29d5c92640 1 --2- 172.21.15.62:0/738503616 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f29b40663e0 0x7f29b40688a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f29cc0017b0 tx=0x7f29cc001630 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:06.048 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:06.044+0000 7f29c67fc640 1 -- 172.21.15.62:0/738503616 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f29c8051c10 con 0x7f29d01419b0 2023-10-08T12:00:06.197 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:06.192+0000 7f29d7ef6640 1 -- 172.21.15.62:0/738503616 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f29d004db20 con 0x7f29d01419b0 2023-10-08T12:00:06.198 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:06.196+0000 7f29c67fc640 1 -- 172.21.15.62:0/738503616 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f29c8015030 con 0x7f29d01419b0 2023-10-08T12:00:06.198 INFO:teuthology.misc.health.smithi062.stdout: 2023-10-08T12:00:06.198 INFO:teuthology.misc.health.smithi062.stdout:{"epoch":12,"fsid":"3e777930-c2c1-4f2b-a903-c07ee4ca2c52","created":"2023-10-08T11:59:54.510229+0000","modified":"2023-10-08T12:00:03.558144+0000","last_up_change":"0.000000","last_in_change":"2023-10-08T11:59:57.847944+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7bc3070a-7240-43d9-9ec3-397b68a37e2f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5e0fa1f5-9ddc-4882-b460-5578bb571003","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"262b5ee9-4243-4309-a14f-88ad4e8bf812","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"1770bdb8-c12b-43b1-aaab-1d6b6fd18f4d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"74c73631-9351-494a-8246-28ee86e9f862","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"1040f389-272c-41d6-ae76-70c04d09afa1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"178553eb-03e1-4ab8-9826-4f5997e6da0b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"b6581c8f-30b1-4dfd-b7b6-94b579128835","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:00:06.200 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:06.196+0000 7f29d7ef6640 1 -- 172.21.15.62:0/738503616 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f29b40663e0 msgr2=0x7f29b40688a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:06.200 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:06.196+0000 7f29d7ef6640 1 --2- 172.21.15.62:0/738503616 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f29b40663e0 0x7f29b40688a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f29cc0017b0 tx=0x7f29cc001630 comp rx=0 tx=0).stop 2023-10-08T12:00:06.200 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:06.196+0000 7f29d7ef6640 1 -- 172.21.15.62:0/738503616 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f29d01419b0 msgr2=0x7f29d0141e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:06.200 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:06.196+0000 7f29d7ef6640 1 --2- 172.21.15.62:0/738503616 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f29d01419b0 0x7f29d0141e10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f29d01499d0 tx=0x7f29c80019c0 comp rx=0 tx=0).stop 2023-10-08T12:00:06.200 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:06.196+0000 7f29d7ef6640 1 -- 172.21.15.62:0/738503616 shutdown_connections 2023-10-08T12:00:06.200 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:06.196+0000 7f29d7ef6640 1 --2- 172.21.15.62:0/738503616 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f29b40663e0 0x7f29b40688a0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:06.201 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:06.196+0000 7f29d7ef6640 1 --2- 172.21.15.62:0/738503616 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f29d00b0ab0 0x7f29d0097a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:06.201 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:06.196+0000 7f29d7ef6640 1 --2- 172.21.15.62:0/738503616 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f29d01419b0 0x7f29d0141e10 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:06.201 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:06.196+0000 7f29d7ef6640 1 --2- 172.21.15.62:0/738503616 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f29bc005040 0x7f29d00afb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:06.201 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:06.196+0000 7f29d7ef6640 1 -- 172.21.15.62:0/738503616 >> 172.21.15.62:0/738503616 conn(0x7f29d00b77c0 msgr2=0x7f29d009da70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:06.201 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:06.196+0000 7f29d7ef6640 1 -- 172.21.15.62:0/738503616 shutdown_connections 2023-10-08T12:00:06.201 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:06.196+0000 7f29d7ef6640 1 -- 172.21.15.62:0/738503616 wait complete. 2023-10-08T12:00:06.214 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-08T12:00:13.021 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-08T12:00:13.151 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:13.148+0000 7fc270a34640 1 -- 172.21.15.62:0/3803486134 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc26c0bae50 msgr2=0x7fc26c099f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:13.151 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:13.148+0000 7fc270a34640 1 --2- 172.21.15.62:0/3803486134 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc26c0bae50 0x7fc26c099f40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc25c009900 tx=0x7fc25c01f070 comp rx=0 tx=0).stop 2023-10-08T12:00:13.151 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:13.148+0000 7fc270a34640 1 -- 172.21.15.62:0/3803486134 shutdown_connections 2023-10-08T12:00:13.151 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:13.148+0000 7fc270a34640 1 --2- 172.21.15.62:0/3803486134 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc26c0bae50 0x7fc26c099f40 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:13.151 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:13.148+0000 7fc270a34640 1 -- 172.21.15.62:0/3803486134 >> 172.21.15.62:0/3803486134 conn(0x7fc26c0b77c0 msgr2=0x7fc26c0b7bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:13.152 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:13.148+0000 7fc270a34640 1 -- 172.21.15.62:0/3803486134 shutdown_connections 2023-10-08T12:00:13.152 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:13.148+0000 7fc270a34640 1 -- 172.21.15.62:0/3803486134 wait complete. 2023-10-08T12:00:13.154 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:13.148+0000 7fc270a34640 1 Processor -- start 2023-10-08T12:00:13.154 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:13.148+0000 7fc270a34640 1 -- start start 2023-10-08T12:00:13.154 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:13.148+0000 7fc270a34640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc26c0bae50 0x7fc26c1dfa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:13.154 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:13.148+0000 7fc270a34640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc26c0bb230 0x7fc26c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:13.154 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:13.148+0000 7fc270a34640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc26c14abf0 0x7fc26c09f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:13.154 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:13.148+0000 7fc270a34640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc26c0b0b90 con 0x7fc26c0bb230 2023-10-08T12:00:13.155 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:13.148+0000 7fc270a34640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc26c0b0a30 con 0x7fc26c0bae50 2023-10-08T12:00:13.155 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:13.148+0000 7fc270a34640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc26c13f4a0 con 0x7fc26c14abf0 2023-10-08T12:00:13.155 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:13.148+0000 7fc263fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc26c0bb230 0x7fc26c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:13.155 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:13.148+0000 7fc263fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc26c0bb230 0x7fc26c09ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58846/0 (socket says 172.21.15.62:58846) 2023-10-08T12:00:13.155 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:13.148+0000 7fc263fff640 1 -- 172.21.15.62:0/502942129 learned_addr learned my addr 172.21.15.62:0/502942129 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:13.155 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:13.148+0000 7fc26a59c640 1 --2- 172.21.15.62:0/502942129 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc26c0bae50 0x7fc26c1dfa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:13.155 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:13.148+0000 7fc26ad9d640 1 --2- 172.21.15.62:0/502942129 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc26c14abf0 0x7fc26c09f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:13.155 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:13.148+0000 7fc263fff640 1 -- 172.21.15.62:0/502942129 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc26c14abf0 msgr2=0x7fc26c09f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:13.155 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:13.148+0000 7fc263fff640 1 --2- 172.21.15.62:0/502942129 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc26c14abf0 0x7fc26c09f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:13.155 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:13.148+0000 7fc263fff640 1 -- 172.21.15.62:0/502942129 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc26c0bae50 msgr2=0x7fc26c1dfa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:13.155 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:13.148+0000 7fc263fff640 1 --2- 172.21.15.62:0/502942129 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc26c0bae50 0x7fc26c1dfa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:13.155 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:13.148+0000 7fc263fff640 1 -- 172.21.15.62:0/502942129 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc25c009560 con 0x7fc26c0bb230 2023-10-08T12:00:13.156 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:13.148+0000 7fc26ad9d640 1 --2- 172.21.15.62:0/502942129 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc26c14abf0 0x7fc26c09f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:00:13.156 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:13.148+0000 7fc26a59c640 1 --2- 172.21.15.62:0/502942129 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc26c0bae50 0x7fc26c1dfa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:00:13.156 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:13.148+0000 7fc263fff640 1 --2- 172.21.15.62:0/502942129 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc26c0bb230 0x7fc26c09ec40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc25400c780 tx=0x7fc25400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:13.156 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:13.152+0000 7fc262ffd640 1 -- 172.21.15.62:0/502942129 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc254005270 con 0x7fc26c0bb230 2023-10-08T12:00:13.156 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:13.152+0000 7fc262ffd640 1 -- 172.21.15.62:0/502942129 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc2540053f0 con 0x7fc26c0bb230 2023-10-08T12:00:13.156 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:13.152+0000 7fc270a34640 1 -- 172.21.15.62:0/502942129 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc26c0afcc0 con 0x7fc26c0bb230 2023-10-08T12:00:13.156 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:13.152+0000 7fc262ffd640 1 -- 172.21.15.62:0/502942129 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc25400a8a0 con 0x7fc26c0bb230 2023-10-08T12:00:13.156 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:13.152+0000 7fc270a34640 1 -- 172.21.15.62:0/502942129 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc26c150010 con 0x7fc26c0bb230 2023-10-08T12:00:13.156 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:13.152+0000 7fc270a34640 1 -- 172.21.15.62:0/502942129 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc26c066a70 con 0x7fc26c0bb230 2023-10-08T12:00:13.157 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:13.152+0000 7fc262ffd640 1 -- 172.21.15.62:0/502942129 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc25400aa00 con 0x7fc26c0bb230 2023-10-08T12:00:13.157 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:13.152+0000 7fc262ffd640 1 --2- 172.21.15.62:0/502942129 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fc24c066470 0x7fc24c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:13.157 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:13.152+0000 7fc262ffd640 1 -- 172.21.15.62:0/502942129 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc254083260 con 0x7fc26c0bb230 2023-10-08T12:00:13.157 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:13.152+0000 7fc26a59c640 1 --2- 172.21.15.62:0/502942129 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fc24c066470 0x7fc24c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:13.157 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:13.152+0000 7fc26a59c640 1 --2- 172.21.15.62:0/502942129 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fc24c066470 0x7fc24c068930 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc25c0b2000 tx=0x7fc25c01d8b0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:13.160 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:13.156+0000 7fc262ffd640 1 -- 172.21.15.62:0/502942129 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc2540509b0 con 0x7fc26c0bb230 2023-10-08T12:00:13.316 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:13.311+0000 7fc270a34640 1 -- 172.21.15.62:0/502942129 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc26c06abf0 con 0x7fc26c0bb230 2023-10-08T12:00:13.317 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:13.315+0000 7fc262ffd640 1 -- 172.21.15.62:0/502942129 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12826 (secure 0 0 0) 0x7fc26c06abf0 con 0x7fc26c0bb230 2023-10-08T12:00:13.318 INFO:teuthology.misc.health.smithi062.stdout: 2023-10-08T12:00:13.318 INFO:teuthology.misc.health.smithi062.stdout:{"epoch":16,"fsid":"3e777930-c2c1-4f2b-a903-c07ee4ca2c52","created":"2023-10-08T11:59:54.510229+0000","modified":"2023-10-08T12:00:09.838310+0000","last_up_change":"2023-10-08T12:00:06.783998+0000","last_in_change":"2023-10-08T11:59:57.847944+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:00:07.189433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7bc3070a-7240-43d9-9ec3-397b68a37e2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6820","nonce":2227876905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6824","nonce":2227876905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6831","nonce":2227876905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6828","nonce":2227876905}]},"public_addr":"172.21.15.62:6820/2227876905","cluster_addr":"172.21.15.62:6824/2227876905","heartbeat_back_addr":"172.21.15.62:6831/2227876905","heartbeat_front_addr":"172.21.15.62:6828/2227876905","state":["exists","up"]},{"osd":1,"uuid":"5e0fa1f5-9ddc-4882-b460-5578bb571003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6801","nonce":315660906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6803","nonce":315660906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6808","nonce":315660906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6805","nonce":315660906}]},"public_addr":"172.21.15.62:6801/315660906","cluster_addr":"172.21.15.62:6803/315660906","heartbeat_back_addr":"172.21.15.62:6808/315660906","heartbeat_front_addr":"172.21.15.62:6805/315660906","state":["exists","up"]},{"osd":2,"uuid":"262b5ee9-4243-4309-a14f-88ad4e8bf812","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6807","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6809","nonce":3784842938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6811","nonce":3784842938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6815","nonce":3784842938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6813","nonce":3784842938}]},"public_addr":"172.21.15.62:6809/3784842938","cluster_addr":"172.21.15.62:6811/3784842938","heartbeat_back_addr":"172.21.15.62:6815/3784842938","heartbeat_front_addr":"172.21.15.62:6813/3784842938","state":["exists","up"]},{"osd":3,"uuid":"1770bdb8-c12b-43b1-aaab-1d6b6fd18f4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6817","nonce":3385303160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6821","nonce":3385303160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6827","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6829","nonce":3385303160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6823","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6825","nonce":3385303160}]},"public_addr":"172.21.15.62:6817/3385303160","cluster_addr":"172.21.15.62:6821/3385303160","heartbeat_back_addr":"172.21.15.62:6829/3385303160","heartbeat_front_addr":"172.21.15.62:6825/3385303160","state":["exists","up"]},{"osd":4,"uuid":"74c73631-9351-494a-8246-28ee86e9f862","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6807","nonce":1174056987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6809","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6811","nonce":1174056987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6820","nonce":1174056987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6813","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6816","nonce":1174056987}]},"public_addr":"172.21.15.130:6807/1174056987","cluster_addr":"172.21.15.130:6811/1174056987","heartbeat_back_addr":"172.21.15.130:6820/1174056987","heartbeat_front_addr":"172.21.15.130:6816/1174056987","state":["exists","up"]},{"osd":5,"uuid":"1040f389-272c-41d6-ae76-70c04d09afa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6801","nonce":561928414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6803","nonce":561928414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6815","nonce":561928414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6808","nonce":561928414}]},"public_addr":"172.21.15.130:6801/561928414","cluster_addr":"172.21.15.130:6803/561928414","heartbeat_back_addr":"172.21.15.130:6815/561928414","heartbeat_front_addr":"172.21.15.130:6808/561928414","state":["exists","up"]},{"osd":6,"uuid":"178553eb-03e1-4ab8-9826-4f5997e6da0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6810","nonce":2877303015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6817","nonce":2877303015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6823","nonce":2877303015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6819","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6821","nonce":2877303015}]},"public_addr":"172.21.15.130:6810/2877303015","cluster_addr":"172.21.15.130:6817/2877303015","heartbeat_back_addr":"172.21.15.130:6823/2877303015","heartbeat_front_addr":"172.21.15.130:6821/2877303015","state":["exists","up"]},{"osd":7,"uuid":"b6581c8f-30b1-4dfd-b7b6-94b579128835","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6825","nonce":680009774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6827","nonce":680009774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6831","nonce":680009774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6829","nonce":680009774}]},"public_addr":"172.21.15.130:6825/680009774","cluster_addr":"172.21.15.130:6827/680009774","heartbeat_back_addr":"172.21.15.130:6831/680009774","heartbeat_front_addr":"172.21.15.130:6829/680009774","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.505543+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.394383+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.456652+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.529168+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.235414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.392158+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.347556+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.432039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:00:13.319 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:13.315+0000 7fc270a34640 1 -- 172.21.15.62:0/502942129 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fc24c066470 msgr2=0x7fc24c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:13.320 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:13.315+0000 7fc270a34640 1 --2- 172.21.15.62:0/502942129 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fc24c066470 0x7fc24c068930 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc25c0b2000 tx=0x7fc25c01d8b0 comp rx=0 tx=0).stop 2023-10-08T12:00:13.320 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:13.315+0000 7fc270a34640 1 -- 172.21.15.62:0/502942129 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc26c0bb230 msgr2=0x7fc26c09ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:13.320 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:13.315+0000 7fc270a34640 1 --2- 172.21.15.62:0/502942129 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc26c0bb230 0x7fc26c09ec40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc25400c780 tx=0x7fc25400cc40 comp rx=0 tx=0).stop 2023-10-08T12:00:13.320 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:13.315+0000 7fc270a34640 1 -- 172.21.15.62:0/502942129 shutdown_connections 2023-10-08T12:00:13.320 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:13.315+0000 7fc270a34640 1 --2- 172.21.15.62:0/502942129 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fc24c066470 0x7fc24c068930 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:13.320 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:13.315+0000 7fc270a34640 1 --2- 172.21.15.62:0/502942129 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc26c14abf0 0x7fc26c09f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:13.320 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:13.315+0000 7fc270a34640 1 --2- 172.21.15.62:0/502942129 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc26c0bb230 0x7fc26c09ec40 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:13.320 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:13.315+0000 7fc270a34640 1 --2- 172.21.15.62:0/502942129 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc26c0bae50 0x7fc26c1dfa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:13.320 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:13.315+0000 7fc270a34640 1 -- 172.21.15.62:0/502942129 >> 172.21.15.62:0/502942129 conn(0x7fc26c0b77c0 msgr2=0x7fc26c0b7ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:13.320 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:13.315+0000 7fc270a34640 1 -- 172.21.15.62:0/502942129 shutdown_connections 2023-10-08T12:00:13.321 INFO:teuthology.misc.health.smithi062.stderr:2023-10-08T12:00:13.315+0000 7fc270a34640 1 -- 172.21.15.62:0/502942129 wait complete. 2023-10-08T12:00:13.334 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-10-08T12:00:13.335 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-08T12:00:13.335 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-08T12:00:13.335 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-08T12:00:13.337 INFO:tasks.ceph.mds.a:Started 2023-10-08T12:00:13.338 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-08T12:00:13.338 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-08T12:00:13.340 INFO:tasks.ceph.mds.c:Started 2023-10-08T12:00:13.340 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-08T12:00:13.340 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-08T12:00:13.343 INFO:tasks.ceph.mds.b:Started 2023-10-08T12:00:13.343 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-08T12:00:13.343 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:00:13.432 INFO:tasks.ceph.mds.b.smithi130.stdout:starting mds.b at 2023-10-08T12:00:13.453 INFO:tasks.ceph.mds.a.smithi062.stdout:starting mds.a at 2023-10-08T12:00:13.454 INFO:tasks.ceph.mds.c.smithi062.stdout:starting mds.c at 2023-10-08T12:00:13.466 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.463+0000 7f7a20e1f640 1 -- 172.21.15.62:0/1161278156 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a1c06bef0 msgr2=0x7f7a1c150570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:13.466 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.463+0000 7f7a20e1f640 1 --2- 172.21.15.62:0/1161278156 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a1c06bef0 0x7f7a1c150570 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c06cde0 tx=0x7f7a1401cd60 comp rx=0 tx=0).stop 2023-10-08T12:00:13.466 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.463+0000 7f7a20e1f640 1 -- 172.21.15.62:0/1161278156 shutdown_connections 2023-10-08T12:00:13.466 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.463+0000 7f7a20e1f640 1 --2- 172.21.15.62:0/1161278156 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a1c06bef0 0x7f7a1c150570 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:13.467 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.463+0000 7f7a20e1f640 1 --2- 172.21.15.62:0/1161278156 >> v2:172.21.15.130:3300/0 conn(0x7f7a1c0b7000 0x7f7a1c06b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:13.467 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.463+0000 7f7a20e1f640 1 -- 172.21.15.62:0/1161278156 >> 172.21.15.62:0/1161278156 conn(0x7f7a1c0b82f0 msgr2=0x7f7a1c0b8700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:13.467 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.463+0000 7f7a20e1f640 1 -- 172.21.15.62:0/1161278156 shutdown_connections 2023-10-08T12:00:13.467 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.463+0000 7f7a20e1f640 1 -- 172.21.15.62:0/1161278156 wait complete. 2023-10-08T12:00:13.467 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.463+0000 7f7a20e1f640 1 Processor -- start 2023-10-08T12:00:13.467 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.463+0000 7f7a20e1f640 1 -- start start 2023-10-08T12:00:13.470 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.463+0000 7f7a20e1f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a1c06bef0 0x7f7a1c142b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:13.470 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.463+0000 7f7a20e1f640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7a1c0b7000 0x7f7a1c0b1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:13.470 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.463+0000 7f7a20e1f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a1c0b7b50 0x7f7a1c141a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:13.470 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.463+0000 7f7a20e1f640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1c143080 con 0x7f7a1c0b7b50 2023-10-08T12:00:13.470 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.463+0000 7f7a20e1f640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1c13bed0 con 0x7f7a1c06bef0 2023-10-08T12:00:13.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.463+0000 7f7a20e1f640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1c13c1b0 con 0x7f7a1c0b7000 2023-10-08T12:00:13.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.463+0000 7f7a1ad9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a1c0b7b50 0x7f7a1c141a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:13.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.463+0000 7f7a1ad9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a1c0b7b50 0x7f7a1c141a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58878/0 (socket says 172.21.15.62:58878) 2023-10-08T12:00:13.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.463+0000 7f7a1ad9d640 1 -- 172.21.15.62:0/1382892613 learned_addr learned my addr 172.21.15.62:0/1382892613 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:13.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.463+0000 7f7a19d9b640 1 --2- 172.21.15.62:0/1382892613 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7a1c0b7000 0x7f7a1c0b1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:13.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.463+0000 7f7a1a59c640 1 --2- 172.21.15.62:0/1382892613 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a1c06bef0 0x7f7a1c142b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:13.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.463+0000 7f7a1ad9d640 1 -- 172.21.15.62:0/1382892613 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7a1c0b7000 msgr2=0x7f7a1c0b1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:13.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.463+0000 7f7a1ad9d640 1 --2- 172.21.15.62:0/1382892613 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7a1c0b7000 0x7f7a1c0b1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:13.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.463+0000 7f7a1ad9d640 1 -- 172.21.15.62:0/1382892613 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a1c06bef0 msgr2=0x7f7a1c142b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:13.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.463+0000 7f7a1ad9d640 1 --2- 172.21.15.62:0/1382892613 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a1c06bef0 0x7f7a1c142b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:13.472 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.463+0000 7f7a1ad9d640 1 -- 172.21.15.62:0/1382892613 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a140098e0 con 0x7f7a1c0b7b50 2023-10-08T12:00:13.472 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.467+0000 7f7a1ad9d640 1 --2- 172.21.15.62:0/1382892613 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a1c0b7b50 0x7f7a1c141a10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7a14019970 tx=0x7f7a140a5b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:13.472 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.467+0000 7f7a0affd640 1 -- 172.21.15.62:0/1382892613 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a14003d90 con 0x7f7a1c0b7b50 2023-10-08T12:00:13.472 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.467+0000 7f7a0affd640 1 -- 172.21.15.62:0/1382892613 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7a140a5d10 con 0x7f7a1c0b7b50 2023-10-08T12:00:13.472 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.467+0000 7f7a20e1f640 1 -- 172.21.15.62:0/1382892613 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a1c0b1680 con 0x7f7a1c0b7b50 2023-10-08T12:00:13.472 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.467+0000 7f7a0affd640 1 -- 172.21.15.62:0/1382892613 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a14004270 con 0x7f7a1c0b7b50 2023-10-08T12:00:13.472 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.467+0000 7f7a20e1f640 1 -- 172.21.15.62:0/1382892613 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a1c0b08a0 con 0x7f7a1c0b7b50 2023-10-08T12:00:13.473 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.467+0000 7f7a20e1f640 1 -- 172.21.15.62:0/1382892613 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a1c13c010 con 0x7f7a1c0b7b50 2023-10-08T12:00:13.473 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.467+0000 7f7a0affd640 1 -- 172.21.15.62:0/1382892613 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7a1400a040 con 0x7f7a1c0b7b50 2023-10-08T12:00:13.473 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.467+0000 7f7a0affd640 1 --2- 172.21.15.62:0/1382892613 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f79fc066470 0x7f79fc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:13.473 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.467+0000 7f7a0affd640 1 -- 172.21.15.62:0/1382892613 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7a1411e600 con 0x7f7a1c0b7b50 2023-10-08T12:00:13.474 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.467+0000 7f7a1a59c640 1 --2- 172.21.15.62:0/1382892613 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f79fc066470 0x7f79fc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:13.474 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.467+0000 7f7a1a59c640 1 --2- 172.21.15.62:0/1382892613 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f79fc066470 0x7f79fc068930 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c001770 tx=0x7f7a0c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:13.475 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.471+0000 7f7a0affd640 1 -- 172.21.15.62:0/1382892613 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7a1c13c010 con 0x7f7a1c0b7b50 2023-10-08T12:00:13.633 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.627+0000 7f7a20e1f640 1 -- 172.21.15.62:0/1382892613 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7a1c13c010 con 0x7f7a1c0b7b50 2023-10-08T12:00:13.634 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.631+0000 7f7a0affd640 1 -- 172.21.15.62:0/1382892613 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12826 (secure 0 0 0) 0x7f7a1c13c010 con 0x7f7a1c0b7b50 2023-10-08T12:00:13.634 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T12:00:13.634 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":16,"fsid":"3e777930-c2c1-4f2b-a903-c07ee4ca2c52","created":"2023-10-08T11:59:54.510229+0000","modified":"2023-10-08T12:00:09.838310+0000","last_up_change":"2023-10-08T12:00:06.783998+0000","last_in_change":"2023-10-08T11:59:57.847944+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:00:07.189433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7bc3070a-7240-43d9-9ec3-397b68a37e2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6820","nonce":2227876905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6824","nonce":2227876905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6831","nonce":2227876905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6828","nonce":2227876905}]},"public_addr":"172.21.15.62:6820/2227876905","cluster_addr":"172.21.15.62:6824/2227876905","heartbeat_back_addr":"172.21.15.62:6831/2227876905","heartbeat_front_addr":"172.21.15.62:6828/2227876905","state":["exists","up"]},{"osd":1,"uuid":"5e0fa1f5-9ddc-4882-b460-5578bb571003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6801","nonce":315660906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6803","nonce":315660906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6808","nonce":315660906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6805","nonce":315660906}]},"public_addr":"172.21.15.62:6801/315660906","cluster_addr":"172.21.15.62:6803/315660906","heartbeat_back_addr":"172.21.15.62:6808/315660906","heartbeat_front_addr":"172.21.15.62:6805/315660906","state":["exists","up"]},{"osd":2,"uuid":"262b5ee9-4243-4309-a14f-88ad4e8bf812","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6807","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6809","nonce":3784842938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6811","nonce":3784842938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6815","nonce":3784842938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6813","nonce":3784842938}]},"public_addr":"172.21.15.62:6809/3784842938","cluster_addr":"172.21.15.62:6811/3784842938","heartbeat_back_addr":"172.21.15.62:6815/3784842938","heartbeat_front_addr":"172.21.15.62:6813/3784842938","state":["exists","up"]},{"osd":3,"uuid":"1770bdb8-c12b-43b1-aaab-1d6b6fd18f4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6817","nonce":3385303160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6821","nonce":3385303160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6827","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6829","nonce":3385303160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6823","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6825","nonce":3385303160}]},"public_addr":"172.21.15.62:6817/3385303160","cluster_addr":"172.21.15.62:6821/3385303160","heartbeat_back_addr":"172.21.15.62:6829/3385303160","heartbeat_front_addr":"172.21.15.62:6825/3385303160","state":["exists","up"]},{"osd":4,"uuid":"74c73631-9351-494a-8246-28ee86e9f862","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6807","nonce":1174056987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6809","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6811","nonce":1174056987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6820","nonce":1174056987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6813","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6816","nonce":1174056987}]},"public_addr":"172.21.15.130:6807/1174056987","cluster_addr":"172.21.15.130:6811/1174056987","heartbeat_back_addr":"172.21.15.130:6820/1174056987","heartbeat_front_addr":"172.21.15.130:6816/1174056987","state":["exists","up"]},{"osd":5,"uuid":"1040f389-272c-41d6-ae76-70c04d09afa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6801","nonce":561928414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6803","nonce":561928414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6815","nonce":561928414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6808","nonce":561928414}]},"public_addr":"172.21.15.130:6801/561928414","cluster_addr":"172.21.15.130:6803/561928414","heartbeat_back_addr":"172.21.15.130:6815/561928414","heartbeat_front_addr":"172.21.15.130:6808/561928414","state":["exists","up"]},{"osd":6,"uuid":"178553eb-03e1-4ab8-9826-4f5997e6da0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6810","nonce":2877303015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6817","nonce":2877303015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6823","nonce":2877303015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6819","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6821","nonce":2877303015}]},"public_addr":"172.21.15.130:6810/2877303015","cluster_addr":"172.21.15.130:6817/2877303015","heartbeat_back_addr":"172.21.15.130:6823/2877303015","heartbeat_front_addr":"172.21.15.130:6821/2877303015","state":["exists","up"]},{"osd":7,"uuid":"b6581c8f-30b1-4dfd-b7b6-94b579128835","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6825","nonce":680009774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6827","nonce":680009774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6831","nonce":680009774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6829","nonce":680009774}]},"public_addr":"172.21.15.130:6825/680009774","cluster_addr":"172.21.15.130:6827/680009774","heartbeat_back_addr":"172.21.15.130:6831/680009774","heartbeat_front_addr":"172.21.15.130:6829/680009774","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.505543+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.394383+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.456652+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.529168+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.235414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.392158+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.347556+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.432039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:00:13.636 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.631+0000 7f7a20e1f640 1 -- 172.21.15.62:0/1382892613 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f79fc066470 msgr2=0x7f79fc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:13.636 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.631+0000 7f7a20e1f640 1 --2- 172.21.15.62:0/1382892613 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f79fc066470 0x7f79fc068930 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c001770 tx=0x7f7a0c009040 comp rx=0 tx=0).stop 2023-10-08T12:00:13.637 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.631+0000 7f7a20e1f640 1 -- 172.21.15.62:0/1382892613 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a1c0b7b50 msgr2=0x7f7a1c141a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:13.637 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.631+0000 7f7a20e1f640 1 --2- 172.21.15.62:0/1382892613 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a1c0b7b50 0x7f7a1c141a10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7a14019970 tx=0x7f7a140a5b20 comp rx=0 tx=0).stop 2023-10-08T12:00:13.637 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.631+0000 7f7a20e1f640 1 -- 172.21.15.62:0/1382892613 shutdown_connections 2023-10-08T12:00:13.637 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.631+0000 7f7a20e1f640 1 --2- 172.21.15.62:0/1382892613 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f79fc066470 0x7f79fc068930 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:13.637 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.631+0000 7f7a20e1f640 1 --2- 172.21.15.62:0/1382892613 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7a1c0b7000 0x7f7a1c0b1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:13.637 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.631+0000 7f7a20e1f640 1 --2- 172.21.15.62:0/1382892613 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a1c0b7b50 0x7f7a1c141a10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:13.637 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.631+0000 7f7a20e1f640 1 --2- 172.21.15.62:0/1382892613 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a1c06bef0 0x7f7a1c142b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:13.637 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.631+0000 7f7a20e1f640 1 -- 172.21.15.62:0/1382892613 >> 172.21.15.62:0/1382892613 conn(0x7f7a1c0b82f0 msgr2=0x7f7a1c09cda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:13.637 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.631+0000 7f7a20e1f640 1 -- 172.21.15.62:0/1382892613 shutdown_connections 2023-10-08T12:00:13.637 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.631+0000 7f7a20e1f640 1 -- 172.21.15.62:0/1382892613 wait complete. 2023-10-08T12:00:13.652 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T12:00:07.189433+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T12:00:13.653 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T12:00:13.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.775+0000 7f0611b08640 1 -- 172.21.15.62:0/263592124 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05f80047d0 msgr2=0x7f05f8004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:13.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.775+0000 7f0611b08640 1 --2- 172.21.15.62:0/263592124 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05f80047d0 0x7f05f8004c50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f05fc00c260 tx=0x7f05fc01cfa0 comp rx=0 tx=0).stop 2023-10-08T12:00:13.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.775+0000 7f0611b08640 1 -- 172.21.15.62:0/263592124 shutdown_connections 2023-10-08T12:00:13.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.775+0000 7f0611b08640 1 --2- 172.21.15.62:0/263592124 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05f80047d0 0x7f05f8004c50 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:13.779 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.775+0000 7f0611b08640 1 -- 172.21.15.62:0/263592124 >> 172.21.15.62:0/263592124 conn(0x7f060c09c520 msgr2=0x7f060c09c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:13.779 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.775+0000 7f0611b08640 1 -- 172.21.15.62:0/263592124 shutdown_connections 2023-10-08T12:00:13.779 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.775+0000 7f0611b08640 1 -- 172.21.15.62:0/263592124 wait complete. 2023-10-08T12:00:13.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.775+0000 7f0611b08640 1 Processor -- start 2023-10-08T12:00:13.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.775+0000 7f0611b08640 1 -- start start 2023-10-08T12:00:13.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.775+0000 7f0611b08640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05f80047d0 0x7f060c1465e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:13.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.775+0000 7f0611b08640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f060c1d3960 0x7f060c1e5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:13.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.775+0000 7f0611b08640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f060c1e5d60 0x7f060c13ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:13.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.775+0000 7f0611b08640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f060c146b20 con 0x7f05f80047d0 2023-10-08T12:00:13.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.775+0000 7f0611b08640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f060c0a0670 con 0x7f060c1d3960 2023-10-08T12:00:13.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.775+0000 7f0611b08640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f060c0a0880 con 0x7f060c1e5d60 2023-10-08T12:00:13.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.775+0000 7f060b7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05f80047d0 0x7f060c1465e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:13.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.775+0000 7f060b7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05f80047d0 0x7f060c1465e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58908/0 (socket says 172.21.15.62:58908) 2023-10-08T12:00:13.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.775+0000 7f060b7fe640 1 -- 172.21.15.62:0/59029675 learned_addr learned my addr 172.21.15.62:0/59029675 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:13.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.775+0000 7f060bfff640 1 --2- 172.21.15.62:0/59029675 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f060c1e5d60 0x7f060c13ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:13.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.775+0000 7f0602ffd640 1 --2- 172.21.15.62:0/59029675 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f060c1d3960 0x7f060c1e5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:13.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.775+0000 7f060b7fe640 1 -- 172.21.15.62:0/59029675 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f060c1e5d60 msgr2=0x7f060c13ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:13.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.775+0000 7f060b7fe640 1 --2- 172.21.15.62:0/59029675 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f060c1e5d60 0x7f060c13ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:13.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.775+0000 7f060b7fe640 1 -- 172.21.15.62:0/59029675 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f060c1d3960 msgr2=0x7f060c1e5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:13.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.775+0000 7f060b7fe640 1 --2- 172.21.15.62:0/59029675 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f060c1d3960 0x7f060c1e5820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:13.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.775+0000 7f060b7fe640 1 -- 172.21.15.62:0/59029675 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f060c1e61e0 con 0x7f05f80047d0 2023-10-08T12:00:13.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.775+0000 7f0602ffd640 1 --2- 172.21.15.62:0/59029675 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f060c1d3960 0x7f060c1e5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:00:13.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.775+0000 7f060bfff640 1 --2- 172.21.15.62:0/59029675 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f060c1e5d60 0x7f060c13ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:00:13.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.775+0000 7f060b7fe640 1 --2- 172.21.15.62:0/59029675 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05f80047d0 0x7f060c1465e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f05f4011a50 tx=0x7f05f4011f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:13.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.775+0000 7f0608ff9640 1 -- 172.21.15.62:0/59029675 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f400fd90 con 0x7f05f80047d0 2023-10-08T12:00:13.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.775+0000 7f0608ff9640 1 -- 172.21.15.62:0/59029675 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f05f4012450 con 0x7f05f80047d0 2023-10-08T12:00:13.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.775+0000 7f0611b08640 1 -- 172.21.15.62:0/59029675 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f060c1d2ce0 con 0x7f05f80047d0 2023-10-08T12:00:13.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.775+0000 7f0608ff9640 1 -- 172.21.15.62:0/59029675 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f4012800 con 0x7f05f80047d0 2023-10-08T12:00:13.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.775+0000 7f0611b08640 1 -- 172.21.15.62:0/59029675 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f060c0a01a0 con 0x7f05f80047d0 2023-10-08T12:00:13.784 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.779+0000 7f0611b08640 1 -- 172.21.15.62:0/59029675 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f060c04da80 con 0x7f05f80047d0 2023-10-08T12:00:13.784 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.779+0000 7f0608ff9640 1 -- 172.21.15.62:0/59029675 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f05f4012960 con 0x7f05f80047d0 2023-10-08T12:00:13.784 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.779+0000 7f0608ff9640 1 --2- 172.21.15.62:0/59029675 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f05ec0664a0 0x7f05ec068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:13.785 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.779+0000 7f0608ff9640 1 -- 172.21.15.62:0/59029675 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f05f4084900 con 0x7f05f80047d0 2023-10-08T12:00:13.785 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.779+0000 7f0602ffd640 1 --2- 172.21.15.62:0/59029675 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f05ec0664a0 0x7f05ec068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:13.785 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.779+0000 7f0602ffd640 1 --2- 172.21.15.62:0/59029675 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f05ec0664a0 0x7f05ec068960 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f05fc0ac000 tx=0x7f05fc019d40 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:13.786 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.783+0000 7f0608ff9640 1 -- 172.21.15.62:0/59029675 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f05f4052210 con 0x7f05f80047d0 2023-10-08T12:00:13.936 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.931+0000 7f0611b08640 1 -- 172.21.15.62:0/59029675 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f060c0665d0 con 0x7f05f80047d0 2023-10-08T12:00:13.936 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.931+0000 7f0608ff9640 1 -- 172.21.15.62:0/59029675 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f05f401f0a0 con 0x7f05f80047d0 2023-10-08T12:00:13.936 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2023-10-08T12:00:13.938 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.935+0000 7f0611b08640 1 -- 172.21.15.62:0/59029675 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f05ec0664a0 msgr2=0x7f05ec068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:13.939 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.935+0000 7f0611b08640 1 --2- 172.21.15.62:0/59029675 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f05ec0664a0 0x7f05ec068960 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f05fc0ac000 tx=0x7f05fc019d40 comp rx=0 tx=0).stop 2023-10-08T12:00:13.939 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.935+0000 7f0611b08640 1 -- 172.21.15.62:0/59029675 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05f80047d0 msgr2=0x7f060c1465e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:13.939 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.935+0000 7f0611b08640 1 --2- 172.21.15.62:0/59029675 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05f80047d0 0x7f060c1465e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f05f4011a50 tx=0x7f05f4011f10 comp rx=0 tx=0).stop 2023-10-08T12:00:13.939 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.935+0000 7f0611b08640 1 -- 172.21.15.62:0/59029675 shutdown_connections 2023-10-08T12:00:13.939 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.935+0000 7f0611b08640 1 --2- 172.21.15.62:0/59029675 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f05ec0664a0 0x7f05ec068960 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:13.939 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.935+0000 7f0611b08640 1 --2- 172.21.15.62:0/59029675 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f060c1e5d60 0x7f060c13ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:13.939 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.935+0000 7f0611b08640 1 --2- 172.21.15.62:0/59029675 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f060c1d3960 0x7f060c1e5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:13.939 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.935+0000 7f0611b08640 1 --2- 172.21.15.62:0/59029675 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05f80047d0 0x7f060c1465e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:13.939 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.935+0000 7f0611b08640 1 -- 172.21.15.62:0/59029675 >> 172.21.15.62:0/59029675 conn(0x7f060c09c520 msgr2=0x7f060c148cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:13.939 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.935+0000 7f0611b08640 1 -- 172.21.15.62:0/59029675 shutdown_connections 2023-10-08T12:00:13.939 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:13.935+0000 7f0611b08640 1 -- 172.21.15.62:0/59029675 wait complete. 2023-10-08T12:00:13.954 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:00:14.078 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:14.075+0000 7fe7d622a640 1 -- 172.21.15.62:0/3244817064 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe7d00b77e0 msgr2=0x7fe7d014ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:14.078 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:14.075+0000 7fe7d622a640 1 --2- 172.21.15.62:0/3244817064 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe7d00b77e0 0x7fe7d014ab90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe7c8009c80 tx=0x7fe7c801cd80 comp rx=0 tx=0).stop 2023-10-08T12:00:14.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:14.075+0000 7fe7d622a640 1 -- 172.21.15.62:0/3244817064 shutdown_connections 2023-10-08T12:00:14.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:14.075+0000 7fe7d622a640 1 --2- 172.21.15.62:0/3244817064 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe7d00b77e0 0x7fe7d014ab90 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:14.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:14.075+0000 7fe7d622a640 1 --2- 172.21.15.62:0/3244817064 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe7d00699f0 0x7fe7d00b61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:14.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:14.075+0000 7fe7d622a640 1 -- 172.21.15.62:0/3244817064 >> 172.21.15.62:0/3244817064 conn(0x7fe7d009d5a0 msgr2=0x7fe7d009d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:14.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:14.075+0000 7fe7d622a640 1 -- 172.21.15.62:0/3244817064 shutdown_connections 2023-10-08T12:00:14.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:14.075+0000 7fe7d622a640 1 -- 172.21.15.62:0/3244817064 wait complete. 2023-10-08T12:00:14.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:14.075+0000 7fe7d622a640 1 Processor -- start 2023-10-08T12:00:14.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:14.075+0000 7fe7d622a640 1 -- start start 2023-10-08T12:00:14.083 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:14.075+0000 7fe7d622a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe7d00699f0 0x7fe7d009ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:14.083 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:14.075+0000 7fe7d622a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe7d00b77e0 0x7fe7d009fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:14.083 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:14.075+0000 7fe7d622a640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe7d00badd0 0x7fe7d01e5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:14.083 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:14.075+0000 7fe7d622a640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d009f290 con 0x7fe7d00699f0 2023-10-08T12:00:14.083 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:14.075+0000 7fe7d622a640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d01514f0 con 0x7fe7d00b77e0 2023-10-08T12:00:14.084 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:14.075+0000 7fe7d622a640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d00a0170 con 0x7fe7d00badd0 2023-10-08T12:00:14.084 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:14.075+0000 7fe7cf7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe7d00699f0 0x7fe7d009ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:14.084 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:14.075+0000 7fe7cf7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe7d00699f0 0x7fe7d009ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58930/0 (socket says 172.21.15.62:58930) 2023-10-08T12:00:14.084 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:14.075+0000 7fe7cf7fe640 1 -- 172.21.15.62:0/1184570303 learned_addr learned my addr 172.21.15.62:0/1184570303 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:14.084 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:14.075+0000 7fe7cffff640 1 --2- 172.21.15.62:0/1184570303 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe7d00badd0 0x7fe7d01e5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:14.084 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:14.075+0000 7fe7ceffd640 1 --2- 172.21.15.62:0/1184570303 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe7d00b77e0 0x7fe7d009fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:14.085 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:14.075+0000 7fe7cf7fe640 1 -- 172.21.15.62:0/1184570303 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe7d00badd0 msgr2=0x7fe7d01e5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:14.085 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:14.075+0000 7fe7cf7fe640 1 --2- 172.21.15.62:0/1184570303 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe7d00badd0 0x7fe7d01e5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:14.085 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:14.075+0000 7fe7cf7fe640 1 -- 172.21.15.62:0/1184570303 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe7d00b77e0 msgr2=0x7fe7d009fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:14.085 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:14.075+0000 7fe7cf7fe640 1 --2- 172.21.15.62:0/1184570303 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe7d00b77e0 0x7fe7d009fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:14.085 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:14.075+0000 7fe7cf7fe640 1 -- 172.21.15.62:0/1184570303 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7c80098e0 con 0x7fe7d00699f0 2023-10-08T12:00:14.085 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:14.075+0000 7fe7ceffd640 1 --2- 172.21.15.62:0/1184570303 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe7d00b77e0 0x7fe7d009fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:00:14.085 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:14.075+0000 7fe7cffff640 1 --2- 172.21.15.62:0/1184570303 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe7d00badd0 0x7fe7d01e5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:00:14.085 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:14.075+0000 7fe7cf7fe640 1 --2- 172.21.15.62:0/1184570303 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe7d00699f0 0x7fe7d009ed50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe7c000c970 tx=0x7fe7c000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:14.086 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:14.075+0000 7fe7b7fff640 1 -- 172.21.15.62:0/1184570303 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c0007bb0 con 0x7fe7d00699f0 2023-10-08T12:00:14.086 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:14.075+0000 7fe7b7fff640 1 -- 172.21.15.62:0/1184570303 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe7c0007e00 con 0x7fe7d00699f0 2023-10-08T12:00:14.086 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:14.075+0000 7fe7d622a640 1 -- 172.21.15.62:0/1184570303 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7d01484f0 con 0x7fe7d00699f0 2023-10-08T12:00:14.086 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:14.075+0000 7fe7b7fff640 1 -- 172.21.15.62:0/1184570303 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c0005280 con 0x7fe7d00699f0 2023-10-08T12:00:14.086 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:14.075+0000 7fe7d622a640 1 -- 172.21.15.62:0/1184570303 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7d006c4e0 con 0x7fe7d00699f0 2023-10-08T12:00:14.086 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:14.079+0000 7fe7d622a640 1 -- 172.21.15.62:0/1184570303 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7d004da80 con 0x7fe7d00699f0 2023-10-08T12:00:14.086 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:14.079+0000 7fe7b7fff640 1 -- 172.21.15.62:0/1184570303 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe7c00053e0 con 0x7fe7d00699f0 2023-10-08T12:00:14.086 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:14.079+0000 7fe7b7fff640 1 --2- 172.21.15.62:0/1184570303 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fe7bc066470 0x7fe7bc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:14.086 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:14.079+0000 7fe7b7fff640 1 -- 172.21.15.62:0/1184570303 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe7c0084170 con 0x7fe7d00699f0 2023-10-08T12:00:14.086 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:14.079+0000 7fe7ceffd640 1 --2- 172.21.15.62:0/1184570303 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fe7bc066470 0x7fe7bc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:14.087 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:14.079+0000 7fe7ceffd640 1 --2- 172.21.15.62:0/1184570303 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fe7bc066470 0x7fe7bc068930 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe7d01e31c0 tx=0x7fe7c4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:14.087 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:14.083+0000 7fe7b7fff640 1 -- 172.21.15.62:0/1184570303 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe7c0051940 con 0x7fe7d00699f0 2023-10-08T12:00:14.278 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:14.275+0000 7fe7d622a640 1 -- 172.21.15.62:0/1184570303 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe7d00babb0 con 0x7fe7d00699f0 2023-10-08T12:00:14.279 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:14.275+0000 7fe7b7fff640 1 -- 172.21.15.62:0/1184570303 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1327 (secure 0 0 0) 0x7fe7c001d090 con 0x7fe7d00699f0 2023-10-08T12:00:14.280 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T12:00:14.280 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4334,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/2629778704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":2629778704},{"type":"v1","addr":"172.21.15.130:6835","nonce":2629778704}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-10-08T12:00:14.280 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 2 2023-10-08T12:00:14.282 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:14.279+0000 7fe7d622a640 1 -- 172.21.15.62:0/1184570303 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fe7bc066470 msgr2=0x7fe7bc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:14.282 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:14.279+0000 7fe7d622a640 1 --2- 172.21.15.62:0/1184570303 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fe7bc066470 0x7fe7bc068930 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe7d01e31c0 tx=0x7fe7c4009040 comp rx=0 tx=0).stop 2023-10-08T12:00:14.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:14.279+0000 7fe7d622a640 1 -- 172.21.15.62:0/1184570303 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe7d00699f0 msgr2=0x7fe7d009ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:14.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:14.279+0000 7fe7d622a640 1 --2- 172.21.15.62:0/1184570303 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe7d00699f0 0x7fe7d009ed50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe7c000c970 tx=0x7fe7c000ce30 comp rx=0 tx=0).stop 2023-10-08T12:00:14.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:14.279+0000 7fe7d622a640 1 -- 172.21.15.62:0/1184570303 shutdown_connections 2023-10-08T12:00:14.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:14.279+0000 7fe7d622a640 1 --2- 172.21.15.62:0/1184570303 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fe7bc066470 0x7fe7bc068930 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:14.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:14.279+0000 7fe7d622a640 1 --2- 172.21.15.62:0/1184570303 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe7d00badd0 0x7fe7d01e5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:14.284 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:14.279+0000 7fe7d622a640 1 --2- 172.21.15.62:0/1184570303 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe7d00b77e0 0x7fe7d009fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:14.284 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:14.279+0000 7fe7d622a640 1 --2- 172.21.15.62:0/1184570303 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe7d00699f0 0x7fe7d009ed50 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:14.284 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:14.279+0000 7fe7d622a640 1 -- 172.21.15.62:0/1184570303 >> 172.21.15.62:0/1184570303 conn(0x7fe7d009d5a0 msgr2=0x7fe7d0148a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:14.284 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:14.279+0000 7fe7d622a640 1 -- 172.21.15.62:0/1184570303 shutdown_connections 2023-10-08T12:00:14.285 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:14.279+0000 7fe7d622a640 1 -- 172.21.15.62:0/1184570303 wait complete. 2023-10-08T12:00:16.299 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:00:16.437 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.431+0000 7fefd5d50640 1 -- 172.21.15.62:0/585858007 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fefd014ae40 msgr2=0x7fefd014b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:16.438 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.431+0000 7fefd5d50640 1 --2- 172.21.15.62:0/585858007 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fefd014ae40 0x7fefd014b280 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fefd0068d60 tx=0x7fefc401efd0 comp rx=0 tx=0).stop 2023-10-08T12:00:16.438 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.431+0000 7fefd5d50640 1 -- 172.21.15.62:0/585858007 shutdown_connections 2023-10-08T12:00:16.438 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.431+0000 7fefd5d50640 1 --2- 172.21.15.62:0/585858007 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fefd014ae40 0x7fefd014b280 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:16.438 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.431+0000 7fefd5d50640 1 --2- 172.21.15.62:0/585858007 >> v2:172.21.15.130:3300/0 conn(0x7fefd00b8d70 0x7fefd00701e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:16.438 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.431+0000 7fefd5d50640 1 -- 172.21.15.62:0/585858007 >> 172.21.15.62:0/585858007 conn(0x7fefd009e700 msgr2=0x7fefd009eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:16.438 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.435+0000 7fefd5d50640 1 -- 172.21.15.62:0/585858007 shutdown_connections 2023-10-08T12:00:16.438 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.435+0000 7fefd5d50640 1 -- 172.21.15.62:0/585858007 wait complete. 2023-10-08T12:00:16.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.435+0000 7fefd5d50640 1 Processor -- start 2023-10-08T12:00:16.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.435+0000 7fefd5d50640 1 -- start start 2023-10-08T12:00:16.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.435+0000 7fefd5d50640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fefd00b8d70 0x7fefd009fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:16.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.435+0000 7fefd5d50640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fefd014ae40 0x7fefd006d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:16.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.435+0000 7fefd5d50640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fefd014b7c0 0x7fefd01df990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:16.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.435+0000 7fefd5d50640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefd006db20 con 0x7fefd014ae40 2023-10-08T12:00:16.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.435+0000 7fefd5d50640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefd01df500 con 0x7fefd00b8d70 2023-10-08T12:00:16.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.435+0000 7fefd5d50640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefd00a0450 con 0x7fefd014b7c0 2023-10-08T12:00:16.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.435+0000 7fefceffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fefd014ae40 0x7fefd006d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:16.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.435+0000 7fefcf7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fefd00b8d70 0x7fefd009fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:16.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.435+0000 7fefceffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fefd014ae40 0x7fefd006d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:44920/0 (socket says 172.21.15.62:44920) 2023-10-08T12:00:16.442 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.435+0000 7fefceffd640 1 -- 172.21.15.62:0/3877700918 learned_addr learned my addr 172.21.15.62:0/3877700918 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:16.442 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.435+0000 7fefcffff640 1 --2- 172.21.15.62:0/3877700918 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fefd014b7c0 0x7fefd01df990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:16.442 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.435+0000 7fefceffd640 1 -- 172.21.15.62:0/3877700918 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fefd014b7c0 msgr2=0x7fefd01df990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:16.442 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.435+0000 7fefceffd640 1 --2- 172.21.15.62:0/3877700918 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fefd014b7c0 0x7fefd01df990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:16.442 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.435+0000 7fefceffd640 1 -- 172.21.15.62:0/3877700918 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fefd00b8d70 msgr2=0x7fefd009fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:16.442 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.435+0000 7fefceffd640 1 --2- 172.21.15.62:0/3877700918 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fefd00b8d70 0x7fefd009fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:16.442 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.435+0000 7fefceffd640 1 -- 172.21.15.62:0/3877700918 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefc40094a0 con 0x7fefd014ae40 2023-10-08T12:00:16.442 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.435+0000 7fefceffd640 1 --2- 172.21.15.62:0/3877700918 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fefd014ae40 0x7fefd006d5e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fefc4000c10 tx=0x7fefc4004310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:16.442 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.435+0000 7fefb7fff640 1 -- 172.21.15.62:0/3877700918 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc40b08a0 con 0x7fefd014ae40 2023-10-08T12:00:16.443 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.435+0000 7fefb7fff640 1 -- 172.21.15.62:0/3877700918 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fefc40b0af0 con 0x7fefd014ae40 2023-10-08T12:00:16.443 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.435+0000 7fefd5d50640 1 -- 172.21.15.62:0/3877700918 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefd00a0730 con 0x7fefd014ae40 2023-10-08T12:00:16.443 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.435+0000 7fefb7fff640 1 -- 172.21.15.62:0/3877700918 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc40b0ea0 con 0x7fefd014ae40 2023-10-08T12:00:16.443 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.435+0000 7fefd5d50640 1 -- 172.21.15.62:0/3877700918 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefd00b1c00 con 0x7fefd014ae40 2023-10-08T12:00:16.443 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.435+0000 7fefd5d50640 1 -- 172.21.15.62:0/3877700918 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefd00739e0 con 0x7fefd014ae40 2023-10-08T12:00:16.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.439+0000 7fefb7fff640 1 -- 172.21.15.62:0/3877700918 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fefc40b7040 con 0x7fefd014ae40 2023-10-08T12:00:16.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.439+0000 7fefb7fff640 1 --2- 172.21.15.62:0/3877700918 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fefbc066470 0x7fefbc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:16.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.439+0000 7fefb7fff640 1 -- 172.21.15.62:0/3877700918 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fefc4121830 con 0x7fefd014ae40 2023-10-08T12:00:16.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.439+0000 7fefcf7fe640 1 --2- 172.21.15.62:0/3877700918 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fefbc066470 0x7fefbc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:16.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.439+0000 7fefcf7fe640 1 --2- 172.21.15.62:0/3877700918 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fefbc066470 0x7fefbc068930 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fefc000bc00 tx=0x7fefc000b390 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:16.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.443+0000 7fefb7fff640 1 -- 172.21.15.62:0/3877700918 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fefc40ef140 con 0x7fefd014ae40 2023-10-08T12:00:16.630 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.627+0000 7fefd5d50640 1 -- 172.21.15.62:0/3877700918 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fefd01df670 con 0x7fefd014ae40 2023-10-08T12:00:16.631 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.627+0000 7fefb7fff640 1 -- 172.21.15.62:0/3877700918 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2907 (secure 0 0 0) 0x7fefc40b5020 con 0x7fefd014ae40 2023-10-08T12:00:16.632 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T12:00:16.632 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4334,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/2629778704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":2629778704},{"type":"v1","addr":"172.21.15.130:6835","nonce":2629778704}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4359,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/2134446062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":2134446062},{"type":"v1","addr":"172.21.15.62:6835","nonce":2134446062}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4362,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6834/2629384568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":2629384568},{"type":"v1","addr":"172.21.15.62:6834","nonce":2629384568}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-10-08T12:00:16.632 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 3 2023-10-08T12:00:16.634 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.631+0000 7fefd5d50640 1 -- 172.21.15.62:0/3877700918 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fefbc066470 msgr2=0x7fefbc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:16.634 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.631+0000 7fefd5d50640 1 --2- 172.21.15.62:0/3877700918 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fefbc066470 0x7fefbc068930 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fefc000bc00 tx=0x7fefc000b390 comp rx=0 tx=0).stop 2023-10-08T12:00:16.634 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.631+0000 7fefd5d50640 1 -- 172.21.15.62:0/3877700918 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fefd014ae40 msgr2=0x7fefd006d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:16.635 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.631+0000 7fefd5d50640 1 --2- 172.21.15.62:0/3877700918 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fefd014ae40 0x7fefd006d5e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fefc4000c10 tx=0x7fefc4004310 comp rx=0 tx=0).stop 2023-10-08T12:00:16.635 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.631+0000 7fefd5d50640 1 -- 172.21.15.62:0/3877700918 shutdown_connections 2023-10-08T12:00:16.635 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.631+0000 7fefd5d50640 1 --2- 172.21.15.62:0/3877700918 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fefbc066470 0x7fefbc068930 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:16.635 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.631+0000 7fefd5d50640 1 --2- 172.21.15.62:0/3877700918 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fefd014b7c0 0x7fefd01df990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:16.635 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.631+0000 7fefd5d50640 1 --2- 172.21.15.62:0/3877700918 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fefd014ae40 0x7fefd006d5e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:16.635 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.631+0000 7fefd5d50640 1 --2- 172.21.15.62:0/3877700918 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fefd00b8d70 0x7fefd009fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:16.635 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.631+0000 7fefd5d50640 1 -- 172.21.15.62:0/3877700918 >> 172.21.15.62:0/3877700918 conn(0x7fefd009e700 msgr2=0x7fefd01478d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:16.635 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.631+0000 7fefd5d50640 1 -- 172.21.15.62:0/3877700918 shutdown_connections 2023-10-08T12:00:16.635 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.631+0000 7fefd5d50640 1 -- 172.21.15.62:0/3877700918 wait complete. 2023-10-08T12:00:16.650 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:00:16.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.763+0000 7f3074278640 1 -- 172.21.15.62:0/1121020093 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f306c0bc670 msgr2=0x7f306c069790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:16.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.763+0000 7f3074278640 1 --2- 172.21.15.62:0/1121020093 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f306c0bc670 0x7f306c069790 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3068009900 tx=0x7f306801c7a0 comp rx=0 tx=0).stop 2023-10-08T12:00:16.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.763+0000 7f3074278640 1 -- 172.21.15.62:0/1121020093 shutdown_connections 2023-10-08T12:00:16.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.763+0000 7f3074278640 1 --2- 172.21.15.62:0/1121020093 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f306c0bc670 0x7f306c069790 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:16.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.763+0000 7f3074278640 1 --2- 172.21.15.62:0/1121020093 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f306c06a520 0x7f306c149be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:16.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.763+0000 7f3074278640 1 -- 172.21.15.62:0/1121020093 >> 172.21.15.62:0/1121020093 conn(0x7f306c0a0540 msgr2=0x7f306c0a0950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:16.770 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.763+0000 7f3074278640 1 -- 172.21.15.62:0/1121020093 shutdown_connections 2023-10-08T12:00:16.770 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.763+0000 7f3074278640 1 -- 172.21.15.62:0/1121020093 wait complete. 2023-10-08T12:00:16.772 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.767+0000 7f3074278640 1 Processor -- start 2023-10-08T12:00:16.772 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.767+0000 7f3074278640 1 -- start start 2023-10-08T12:00:16.772 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.767+0000 7f3074278640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f306c06a520 0x7f306c0b84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:16.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.767+0000 7f3074278640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f306c0bc670 0x7f306c1e5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:16.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.767+0000 7f3074278640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f306c0bdba0 0x7f306c0b72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:16.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.767+0000 7f3074278640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f306c0b6660 con 0x7f306c0bdba0 2023-10-08T12:00:16.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.767+0000 7f3074278640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f306c0b8a00 con 0x7f306c06a520 2023-10-08T12:00:16.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.767+0000 7f3074278640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f306c1420c0 con 0x7f306c0bc670 2023-10-08T12:00:16.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.767+0000 7f3072815640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f306c0bdba0 0x7f306c0b72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:16.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.767+0000 7f3072815640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f306c0bdba0 0x7f306c0b72c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:44930/0 (socket says 172.21.15.62:44930) 2023-10-08T12:00:16.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.767+0000 7f3072815640 1 -- 172.21.15.62:0/2104311943 learned_addr learned my addr 172.21.15.62:0/2104311943 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:16.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.767+0000 7f3072014640 1 --2- 172.21.15.62:0/2104311943 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f306c06a520 0x7f306c0b84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:16.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.767+0000 7f3071813640 1 --2- 172.21.15.62:0/2104311943 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f306c0bc670 0x7f306c1e5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:16.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.767+0000 7f3072815640 1 -- 172.21.15.62:0/2104311943 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f306c0bc670 msgr2=0x7f306c1e5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:16.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.767+0000 7f3072815640 1 --2- 172.21.15.62:0/2104311943 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f306c0bc670 0x7f306c1e5ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:16.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.767+0000 7f3072815640 1 -- 172.21.15.62:0/2104311943 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f306c06a520 msgr2=0x7f306c0b84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:16.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.767+0000 7f3072815640 1 --2- 172.21.15.62:0/2104311943 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f306c06a520 0x7f306c0b84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:16.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.767+0000 7f3072815640 1 -- 172.21.15.62:0/2104311943 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3068009560 con 0x7f306c0bdba0 2023-10-08T12:00:16.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.767+0000 7f3072014640 1 --2- 172.21.15.62:0/2104311943 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f306c06a520 0x7f306c0b84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:00:16.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.767+0000 7f3071813640 1 --2- 172.21.15.62:0/2104311943 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f306c0bc670 0x7f306c1e5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:00:16.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.767+0000 7f3072815640 1 --2- 172.21.15.62:0/2104311943 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f306c0bdba0 0x7f306c0b72c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f306400c770 tx=0x7f306400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:16.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.767+0000 7f305effd640 1 -- 172.21.15.62:0/2104311943 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3064003b80 con 0x7f306c0bdba0 2023-10-08T12:00:16.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.767+0000 7f305effd640 1 -- 172.21.15.62:0/2104311943 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3064003ce0 con 0x7f306c0bdba0 2023-10-08T12:00:16.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.767+0000 7f3074278640 1 -- 172.21.15.62:0/2104311943 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f306c0bafc0 con 0x7f306c0bdba0 2023-10-08T12:00:16.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.767+0000 7f305effd640 1 -- 172.21.15.62:0/2104311943 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306400aab0 con 0x7f306c0bdba0 2023-10-08T12:00:16.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.767+0000 7f3074278640 1 -- 172.21.15.62:0/2104311943 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f306c1471f0 con 0x7f306c0bdba0 2023-10-08T12:00:16.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.767+0000 7f3074278640 1 -- 172.21.15.62:0/2104311943 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f306c0b67a0 con 0x7f306c0bdba0 2023-10-08T12:00:16.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.767+0000 7f305effd640 1 -- 172.21.15.62:0/2104311943 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f306400ac10 con 0x7f306c0bdba0 2023-10-08T12:00:16.776 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.767+0000 7f305effd640 1 --2- 172.21.15.62:0/2104311943 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f3050066470 0x7f3050068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:16.776 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.771+0000 7f305effd640 1 -- 172.21.15.62:0/2104311943 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3064083b20 con 0x7f306c0bdba0 2023-10-08T12:00:16.776 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.771+0000 7f3072014640 1 --2- 172.21.15.62:0/2104311943 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f3050066470 0x7f3050068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:16.776 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.771+0000 7f3072014640 1 --2- 172.21.15.62:0/2104311943 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f3050066470 0x7f3050068930 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f30600058d0 tx=0x7f3060005ca0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:16.777 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.771+0000 7f305effd640 1 -- 172.21.15.62:0/2104311943 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f306c0b67a0 con 0x7f306c0bdba0 2023-10-08T12:00:16.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.923+0000 7f3074278640 1 -- 172.21.15.62:0/2104311943 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f306c0b67a0 con 0x7f306c0bdba0 2023-10-08T12:00:16.927 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.923+0000 7f305effd640 1 -- 172.21.15.62:0/2104311943 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12826 (secure 0 0 0) 0x7f306c0b67a0 con 0x7f306c0bdba0 2023-10-08T12:00:16.928 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T12:00:16.928 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":16,"fsid":"3e777930-c2c1-4f2b-a903-c07ee4ca2c52","created":"2023-10-08T11:59:54.510229+0000","modified":"2023-10-08T12:00:09.838310+0000","last_up_change":"2023-10-08T12:00:06.783998+0000","last_in_change":"2023-10-08T11:59:57.847944+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:00:07.189433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7bc3070a-7240-43d9-9ec3-397b68a37e2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6820","nonce":2227876905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6824","nonce":2227876905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6831","nonce":2227876905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6828","nonce":2227876905}]},"public_addr":"172.21.15.62:6820/2227876905","cluster_addr":"172.21.15.62:6824/2227876905","heartbeat_back_addr":"172.21.15.62:6831/2227876905","heartbeat_front_addr":"172.21.15.62:6828/2227876905","state":["exists","up"]},{"osd":1,"uuid":"5e0fa1f5-9ddc-4882-b460-5578bb571003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6801","nonce":315660906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6803","nonce":315660906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6808","nonce":315660906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6805","nonce":315660906}]},"public_addr":"172.21.15.62:6801/315660906","cluster_addr":"172.21.15.62:6803/315660906","heartbeat_back_addr":"172.21.15.62:6808/315660906","heartbeat_front_addr":"172.21.15.62:6805/315660906","state":["exists","up"]},{"osd":2,"uuid":"262b5ee9-4243-4309-a14f-88ad4e8bf812","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6807","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6809","nonce":3784842938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6811","nonce":3784842938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6815","nonce":3784842938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6813","nonce":3784842938}]},"public_addr":"172.21.15.62:6809/3784842938","cluster_addr":"172.21.15.62:6811/3784842938","heartbeat_back_addr":"172.21.15.62:6815/3784842938","heartbeat_front_addr":"172.21.15.62:6813/3784842938","state":["exists","up"]},{"osd":3,"uuid":"1770bdb8-c12b-43b1-aaab-1d6b6fd18f4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6817","nonce":3385303160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6821","nonce":3385303160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6827","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6829","nonce":3385303160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6823","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6825","nonce":3385303160}]},"public_addr":"172.21.15.62:6817/3385303160","cluster_addr":"172.21.15.62:6821/3385303160","heartbeat_back_addr":"172.21.15.62:6829/3385303160","heartbeat_front_addr":"172.21.15.62:6825/3385303160","state":["exists","up"]},{"osd":4,"uuid":"74c73631-9351-494a-8246-28ee86e9f862","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6807","nonce":1174056987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6809","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6811","nonce":1174056987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6820","nonce":1174056987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6813","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6816","nonce":1174056987}]},"public_addr":"172.21.15.130:6807/1174056987","cluster_addr":"172.21.15.130:6811/1174056987","heartbeat_back_addr":"172.21.15.130:6820/1174056987","heartbeat_front_addr":"172.21.15.130:6816/1174056987","state":["exists","up"]},{"osd":5,"uuid":"1040f389-272c-41d6-ae76-70c04d09afa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6801","nonce":561928414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6803","nonce":561928414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6815","nonce":561928414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6808","nonce":561928414}]},"public_addr":"172.21.15.130:6801/561928414","cluster_addr":"172.21.15.130:6803/561928414","heartbeat_back_addr":"172.21.15.130:6815/561928414","heartbeat_front_addr":"172.21.15.130:6808/561928414","state":["exists","up"]},{"osd":6,"uuid":"178553eb-03e1-4ab8-9826-4f5997e6da0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6810","nonce":2877303015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6817","nonce":2877303015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6823","nonce":2877303015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6819","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6821","nonce":2877303015}]},"public_addr":"172.21.15.130:6810/2877303015","cluster_addr":"172.21.15.130:6817/2877303015","heartbeat_back_addr":"172.21.15.130:6823/2877303015","heartbeat_front_addr":"172.21.15.130:6821/2877303015","state":["exists","up"]},{"osd":7,"uuid":"b6581c8f-30b1-4dfd-b7b6-94b579128835","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6825","nonce":680009774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6827","nonce":680009774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6831","nonce":680009774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6829","nonce":680009774}]},"public_addr":"172.21.15.130:6825/680009774","cluster_addr":"172.21.15.130:6827/680009774","heartbeat_back_addr":"172.21.15.130:6831/680009774","heartbeat_front_addr":"172.21.15.130:6829/680009774","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.505543+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.394383+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.456652+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.529168+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.235414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.392158+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.347556+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.432039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:00:16.930 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.927+0000 7f3074278640 1 -- 172.21.15.62:0/2104311943 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f3050066470 msgr2=0x7f3050068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:16.930 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.927+0000 7f3074278640 1 --2- 172.21.15.62:0/2104311943 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f3050066470 0x7f3050068930 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f30600058d0 tx=0x7f3060005ca0 comp rx=0 tx=0).stop 2023-10-08T12:00:16.930 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.927+0000 7f3074278640 1 -- 172.21.15.62:0/2104311943 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f306c0bdba0 msgr2=0x7f306c0b72c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:16.930 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.927+0000 7f3074278640 1 --2- 172.21.15.62:0/2104311943 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f306c0bdba0 0x7f306c0b72c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f306400c770 tx=0x7f306400cc30 comp rx=0 tx=0).stop 2023-10-08T12:00:16.930 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.927+0000 7f3074278640 1 -- 172.21.15.62:0/2104311943 shutdown_connections 2023-10-08T12:00:16.930 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.927+0000 7f3074278640 1 --2- 172.21.15.62:0/2104311943 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f3050066470 0x7f3050068930 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:16.930 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.927+0000 7f3074278640 1 --2- 172.21.15.62:0/2104311943 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f306c0bc670 0x7f306c1e5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:16.930 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.927+0000 7f3074278640 1 --2- 172.21.15.62:0/2104311943 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f306c0bdba0 0x7f306c0b72c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:16.930 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.927+0000 7f3074278640 1 --2- 172.21.15.62:0/2104311943 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f306c06a520 0x7f306c0b84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:16.930 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.927+0000 7f3074278640 1 -- 172.21.15.62:0/2104311943 >> 172.21.15.62:0/2104311943 conn(0x7f306c0a0540 msgr2=0x7f306c142cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:16.931 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.927+0000 7f3074278640 1 -- 172.21.15.62:0/2104311943 shutdown_connections 2023-10-08T12:00:16.931 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:16.927+0000 7f3074278640 1 -- 172.21.15.62:0/2104311943 wait complete. 2023-10-08T12:00:16.945 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T12:00:07.189433+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T12:00:16.946 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T12:00:17.065 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.059+0000 7f3c86c72640 1 -- 172.21.15.62:0/2328559851 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c800bb770 msgr2=0x7f3c800bace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:17.065 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.059+0000 7f3c86c72640 1 --2- 172.21.15.62:0/2328559851 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c800bb770 0x7f3c800bace0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3c78009bc0 tx=0x7f3c7801cac0 comp rx=0 tx=0).stop 2023-10-08T12:00:17.066 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.059+0000 7f3c86c72640 1 -- 172.21.15.62:0/2328559851 shutdown_connections 2023-10-08T12:00:17.066 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.059+0000 7f3c86c72640 1 --2- 172.21.15.62:0/2328559851 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c800bb770 0x7f3c800bace0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:17.066 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.059+0000 7f3c86c72640 1 --2- 172.21.15.62:0/2328559851 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3c800bb310 0x7f3c800ba7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:17.066 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.059+0000 7f3c86c72640 1 -- 172.21.15.62:0/2328559851 >> 172.21.15.62:0/2328559851 conn(0x7f3c800a0540 msgr2=0x7f3c800a0950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:17.066 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.059+0000 7f3c86c72640 1 -- 172.21.15.62:0/2328559851 shutdown_connections 2023-10-08T12:00:17.066 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.059+0000 7f3c86c72640 1 -- 172.21.15.62:0/2328559851 wait complete. 2023-10-08T12:00:17.068 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.063+0000 7f3c86c72640 1 Processor -- start 2023-10-08T12:00:17.068 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.063+0000 7f3c86c72640 1 -- start start 2023-10-08T12:00:17.068 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.063+0000 7f3c86c72640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3c800bb310 0x7f3c8013dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:17.068 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.063+0000 7f3c86c72640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c800bb770 0x7f3c801e60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:17.068 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.063+0000 7f3c86c72640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c80143550 0x7f3c801e2880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:17.068 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.063+0000 7f3c86c72640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8013e720 con 0x7f3c80143550 2023-10-08T12:00:17.068 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.063+0000 7f3c86c72640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c801e5c80 con 0x7f3c800bb770 2023-10-08T12:00:17.069 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.063+0000 7f3c86c72640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8013e200 con 0x7f3c800bb310 2023-10-08T12:00:17.069 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.063+0000 7f3c8520f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c80143550 0x7f3c801e2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:17.069 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.063+0000 7f3c8520f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c80143550 0x7f3c801e2880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:44950/0 (socket says 172.21.15.62:44950) 2023-10-08T12:00:17.069 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.063+0000 7f3c8520f640 1 -- 172.21.15.62:0/3800098940 learned_addr learned my addr 172.21.15.62:0/3800098940 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:17.069 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.063+0000 7f3c8520f640 1 -- 172.21.15.62:0/3800098940 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3c800bb310 msgr2=0x7f3c8013dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:17.069 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.063+0000 7f3c8520f640 1 --2- 172.21.15.62:0/3800098940 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3c800bb310 0x7f3c8013dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:17.069 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.063+0000 7f3c8520f640 1 -- 172.21.15.62:0/3800098940 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c800bb770 msgr2=0x7f3c801e60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:17.069 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.063+0000 7f3c8520f640 1 --2- 172.21.15.62:0/3800098940 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c800bb770 0x7f3c801e60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:17.069 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.063+0000 7f3c8520f640 1 -- 172.21.15.62:0/3800098940 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c78009820 con 0x7f3c80143550 2023-10-08T12:00:17.069 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.063+0000 7f3c8520f640 1 --2- 172.21.15.62:0/3800098940 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c80143550 0x7f3c801e2880 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3c7801a6f0 tx=0x7f3c78003ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:17.069 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.063+0000 7f3c7d7fa640 1 -- 172.21.15.62:0/3800098940 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c780ba070 con 0x7f3c80143550 2023-10-08T12:00:17.070 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.063+0000 7f3c7d7fa640 1 -- 172.21.15.62:0/3800098940 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3c780a5b20 con 0x7f3c80143550 2023-10-08T12:00:17.070 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.063+0000 7f3c86c72640 1 -- 172.21.15.62:0/3800098940 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c8013e480 con 0x7f3c80143550 2023-10-08T12:00:17.070 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.063+0000 7f3c7d7fa640 1 -- 172.21.15.62:0/3800098940 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c78004cb0 con 0x7f3c80143550 2023-10-08T12:00:17.070 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.063+0000 7f3c86c72640 1 -- 172.21.15.62:0/3800098940 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c8013d420 con 0x7f3c80143550 2023-10-08T12:00:17.071 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.063+0000 7f3c86c72640 1 -- 172.21.15.62:0/3800098940 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c801e5dc0 con 0x7f3c80143550 2023-10-08T12:00:17.071 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.063+0000 7f3c7d7fa640 1 -- 172.21.15.62:0/3800098940 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3c780b4040 con 0x7f3c80143550 2023-10-08T12:00:17.071 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.067+0000 7f3c7d7fa640 1 --2- 172.21.15.62:0/3800098940 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f3c6c066470 0x7f3c6c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:17.071 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.067+0000 7f3c7d7fa640 1 -- 172.21.15.62:0/3800098940 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3c7811e1b0 con 0x7f3c80143550 2023-10-08T12:00:17.071 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.067+0000 7f3c84a0e640 1 --2- 172.21.15.62:0/3800098940 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f3c6c066470 0x7f3c6c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:17.071 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.067+0000 7f3c84a0e640 1 --2- 172.21.15.62:0/3800098940 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f3c6c066470 0x7f3c6c068930 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3c70001560 tx=0x7f3c70007930 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:17.073 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.071+0000 7f3c7d7fa640 1 -- 172.21.15.62:0/3800098940 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3c801e5dc0 con 0x7f3c80143550 2023-10-08T12:00:17.221 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.219+0000 7f3c86c72640 1 -- 172.21.15.62:0/3800098940 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3c801e5dc0 con 0x7f3c80143550 2023-10-08T12:00:17.222 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.219+0000 7f3c7d7fa640 1 -- 172.21.15.62:0/3800098940 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3c801e5dc0 con 0x7f3c80143550 2023-10-08T12:00:17.222 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2023-10-08T12:00:17.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.219+0000 7f3c86c72640 1 -- 172.21.15.62:0/3800098940 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f3c6c066470 msgr2=0x7f3c6c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:17.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.219+0000 7f3c86c72640 1 --2- 172.21.15.62:0/3800098940 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f3c6c066470 0x7f3c6c068930 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3c70001560 tx=0x7f3c70007930 comp rx=0 tx=0).stop 2023-10-08T12:00:17.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.219+0000 7f3c86c72640 1 -- 172.21.15.62:0/3800098940 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c80143550 msgr2=0x7f3c801e2880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:17.226 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.219+0000 7f3c86c72640 1 --2- 172.21.15.62:0/3800098940 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c80143550 0x7f3c801e2880 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3c7801a6f0 tx=0x7f3c78003ed0 comp rx=0 tx=0).stop 2023-10-08T12:00:17.226 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.219+0000 7f3c86c72640 1 -- 172.21.15.62:0/3800098940 shutdown_connections 2023-10-08T12:00:17.226 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.219+0000 7f3c86c72640 1 --2- 172.21.15.62:0/3800098940 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f3c6c066470 0x7f3c6c068930 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:17.226 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.219+0000 7f3c86c72640 1 --2- 172.21.15.62:0/3800098940 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c80143550 0x7f3c801e2880 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:17.226 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.219+0000 7f3c86c72640 1 --2- 172.21.15.62:0/3800098940 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c800bb770 0x7f3c801e60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:17.226 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.219+0000 7f3c86c72640 1 --2- 172.21.15.62:0/3800098940 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3c800bb310 0x7f3c8013dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:17.226 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.219+0000 7f3c86c72640 1 -- 172.21.15.62:0/3800098940 >> 172.21.15.62:0/3800098940 conn(0x7f3c800a0540 msgr2=0x7f3c8009e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:17.226 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.219+0000 7f3c86c72640 1 -- 172.21.15.62:0/3800098940 shutdown_connections 2023-10-08T12:00:17.226 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.219+0000 7f3c86c72640 1 -- 172.21.15.62:0/3800098940 wait complete. 2023-10-08T12:00:17.241 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-08T12:00:17.366 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.363+0000 7f8c26413640 1 -- 172.21.15.62:0/3271220277 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c080047d0 msgr2=0x7f8c08004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:17.367 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.363+0000 7f8c26413640 1 --2- 172.21.15.62:0/3271220277 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c080047d0 0x7f8c08004c50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8c14001680 tx=0x7f8c1401c760 comp rx=0 tx=0).stop 2023-10-08T12:00:17.367 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.363+0000 7f8c26413640 1 -- 172.21.15.62:0/3271220277 shutdown_connections 2023-10-08T12:00:17.367 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.363+0000 7f8c26413640 1 --2- 172.21.15.62:0/3271220277 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c080047d0 0x7f8c08004c50 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:17.367 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.363+0000 7f8c26413640 1 -- 172.21.15.62:0/3271220277 >> 172.21.15.62:0/3271220277 conn(0x7f8c200a0540 msgr2=0x7f8c200a0950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:17.367 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.363+0000 7f8c26413640 1 -- 172.21.15.62:0/3271220277 shutdown_connections 2023-10-08T12:00:17.367 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.363+0000 7f8c26413640 1 -- 172.21.15.62:0/3271220277 wait complete. 2023-10-08T12:00:17.369 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.363+0000 7f8c26413640 1 Processor -- start 2023-10-08T12:00:17.369 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.363+0000 7f8c26413640 1 -- start start 2023-10-08T12:00:17.369 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.363+0000 7f8c26413640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8c080047d0 0x7f8c20143a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:17.369 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.363+0000 7f8c26413640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8c200b7ce0 0x7f8c200b8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:17.369 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.363+0000 7f8c26413640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c200b67d0 0x7f8c200b6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:17.370 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.363+0000 7f8c26413640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c200a3a50 con 0x7f8c200b67d0 2023-10-08T12:00:17.370 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.363+0000 7f8c26413640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c20146a90 con 0x7f8c200b7ce0 2023-10-08T12:00:17.370 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.363+0000 7f8c26413640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c20146270 con 0x7f8c080047d0 2023-10-08T12:00:17.370 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.363+0000 7f8c249b0640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c200b67d0 0x7f8c200b6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:17.370 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.363+0000 7f8c249b0640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c200b67d0 0x7f8c200b6c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:44976/0 (socket says 172.21.15.62:44976) 2023-10-08T12:00:17.370 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.363+0000 7f8c249b0640 1 -- 172.21.15.62:0/2805144021 learned_addr learned my addr 172.21.15.62:0/2805144021 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:17.370 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.363+0000 7f8c1ffff640 1 --2- 172.21.15.62:0/2805144021 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8c080047d0 0x7f8c20143a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:17.370 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.363+0000 7f8c1f7fe640 1 --2- 172.21.15.62:0/2805144021 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8c200b7ce0 0x7f8c200b8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:17.370 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.363+0000 7f8c249b0640 1 -- 172.21.15.62:0/2805144021 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8c080047d0 msgr2=0x7f8c20143a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:17.370 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.363+0000 7f8c249b0640 1 --2- 172.21.15.62:0/2805144021 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8c080047d0 0x7f8c20143a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:17.370 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.363+0000 7f8c249b0640 1 -- 172.21.15.62:0/2805144021 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8c200b7ce0 msgr2=0x7f8c200b8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:17.371 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.363+0000 7f8c249b0640 1 --2- 172.21.15.62:0/2805144021 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8c200b7ce0 0x7f8c200b8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:17.371 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.363+0000 7f8c249b0640 1 -- 172.21.15.62:0/2805144021 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c200b7170 con 0x7f8c200b67d0 2023-10-08T12:00:17.371 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.363+0000 7f8c249b0640 1 --2- 172.21.15.62:0/2805144021 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c200b67d0 0x7f8c200b6c30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8c2009e360 tx=0x7f8c1800ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:17.371 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.363+0000 7f8c1cff9640 1 -- 172.21.15.62:0/2805144021 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1800ca20 con 0x7f8c200b67d0 2023-10-08T12:00:17.371 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.363+0000 7f8c1cff9640 1 -- 172.21.15.62:0/2805144021 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8c1800cc70 con 0x7f8c200b67d0 2023-10-08T12:00:17.371 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.363+0000 7f8c26413640 1 -- 172.21.15.62:0/2805144021 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c201467b0 con 0x7f8c200b67d0 2023-10-08T12:00:17.371 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.363+0000 7f8c1cff9640 1 -- 172.21.15.62:0/2805144021 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c18011460 con 0x7f8c200b67d0 2023-10-08T12:00:17.371 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.363+0000 7f8c26413640 1 -- 172.21.15.62:0/2805144021 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c201442a0 con 0x7f8c200b67d0 2023-10-08T12:00:17.372 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.367+0000 7f8c26413640 1 -- 172.21.15.62:0/2805144021 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c20146610 con 0x7f8c200b67d0 2023-10-08T12:00:17.372 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.367+0000 7f8c1cff9640 1 -- 172.21.15.62:0/2805144021 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8c180115c0 con 0x7f8c200b67d0 2023-10-08T12:00:17.372 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.367+0000 7f8c1cff9640 1 --2- 172.21.15.62:0/2805144021 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f8c0c066470 0x7f8c0c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:17.372 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.367+0000 7f8c1cff9640 1 -- 172.21.15.62:0/2805144021 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8c18084200 con 0x7f8c200b67d0 2023-10-08T12:00:17.372 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.367+0000 7f8c1ffff640 1 --2- 172.21.15.62:0/2805144021 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f8c0c066470 0x7f8c0c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:17.372 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.367+0000 7f8c1ffff640 1 --2- 172.21.15.62:0/2805144021 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f8c0c066470 0x7f8c0c068930 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8c20068ee0 tx=0x7f8c100091e0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:17.376 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.371+0000 7f8c1cff9640 1 -- 172.21.15.62:0/2805144021 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8c20146610 con 0x7f8c200b67d0 2023-10-08T12:00:17.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.535+0000 7f8c26413640 1 -- 172.21.15.62:0/2805144021 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f8c200b6110 con 0x7f8c200b67d0 2023-10-08T12:00:17.539 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.535+0000 7f8c1cff9640 1 -- 172.21.15.62:0/2805144021 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7f8c200b6110 con 0x7f8c200b67d0 2023-10-08T12:00:17.539 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T12:00:17.539 INFO:teuthology.orchestra.run.smithi062.stdout:[ 2023-10-08T12:00:17.539 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-10-08T12:00:17.539 INFO:teuthology.orchestra.run.smithi062.stdout: "poolnum": 1, 2023-10-08T12:00:17.539 INFO:teuthology.orchestra.run.smithi062.stdout: "poolname": ".mgr" 2023-10-08T12:00:17.539 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-10-08T12:00:17.539 INFO:teuthology.orchestra.run.smithi062.stdout:] 2023-10-08T12:00:17.541 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.535+0000 7f8c26413640 1 -- 172.21.15.62:0/2805144021 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f8c0c066470 msgr2=0x7f8c0c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:17.541 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.535+0000 7f8c26413640 1 --2- 172.21.15.62:0/2805144021 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f8c0c066470 0x7f8c0c068930 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8c20068ee0 tx=0x7f8c100091e0 comp rx=0 tx=0).stop 2023-10-08T12:00:17.541 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.535+0000 7f8c26413640 1 -- 172.21.15.62:0/2805144021 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c200b67d0 msgr2=0x7f8c200b6c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:17.542 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.535+0000 7f8c26413640 1 --2- 172.21.15.62:0/2805144021 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c200b67d0 0x7f8c200b6c30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8c2009e360 tx=0x7f8c1800ed10 comp rx=0 tx=0).stop 2023-10-08T12:00:17.542 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.535+0000 7f8c26413640 1 -- 172.21.15.62:0/2805144021 shutdown_connections 2023-10-08T12:00:17.542 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.535+0000 7f8c26413640 1 --2- 172.21.15.62:0/2805144021 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f8c0c066470 0x7f8c0c068930 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:17.542 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.535+0000 7f8c26413640 1 --2- 172.21.15.62:0/2805144021 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c200b67d0 0x7f8c200b6c30 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:17.542 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.535+0000 7f8c26413640 1 --2- 172.21.15.62:0/2805144021 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8c200b7ce0 0x7f8c200b8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:17.542 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.535+0000 7f8c26413640 1 --2- 172.21.15.62:0/2805144021 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8c080047d0 0x7f8c20143a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:17.542 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.535+0000 7f8c26413640 1 -- 172.21.15.62:0/2805144021 >> 172.21.15.62:0/2805144021 conn(0x7f8c200a0540 msgr2=0x7f8c200bace0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:17.542 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.535+0000 7f8c26413640 1 -- 172.21.15.62:0/2805144021 shutdown_connections 2023-10-08T12:00:17.542 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.535+0000 7f8c26413640 1 -- 172.21.15.62:0/2805144021 wait complete. 2023-10-08T12:00:17.558 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-08T12:00:17.558 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-08T12:00:17.691 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.687+0000 7fadd674b640 1 -- 172.21.15.62:0/3625675162 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fadd006d0d0 msgr2=0x7fadd014cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:17.691 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.687+0000 7fadd674b640 1 --2- 172.21.15.62:0/3625675162 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fadd006d0d0 0x7fadd014cc10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fadc4009900 tx=0x7fadc401f070 comp rx=0 tx=0).stop 2023-10-08T12:00:17.691 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.687+0000 7fadd674b640 1 -- 172.21.15.62:0/3625675162 shutdown_connections 2023-10-08T12:00:17.691 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.687+0000 7fadd674b640 1 --2- 172.21.15.62:0/3625675162 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fadd006d0d0 0x7fadd014cc10 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:17.691 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.687+0000 7fadd674b640 1 -- 172.21.15.62:0/3625675162 >> 172.21.15.62:0/3625675162 conn(0x7fadd00b82f0 msgr2=0x7fadd00b8700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:17.692 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.687+0000 7fadd674b640 1 -- 172.21.15.62:0/3625675162 shutdown_connections 2023-10-08T12:00:17.692 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.687+0000 7fadd674b640 1 -- 172.21.15.62:0/3625675162 wait complete. 2023-10-08T12:00:17.693 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.687+0000 7fadd674b640 1 Processor -- start 2023-10-08T12:00:17.694 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.687+0000 7fadd674b640 1 -- start start 2023-10-08T12:00:17.694 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.687+0000 7fadd674b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fadd00699f0 0x7fadd009a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:17.694 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.687+0000 7fadd674b640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fadd006d0d0 0x7fadd00a09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:17.694 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.687+0000 7fadd674b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fadd014d150 0x7fadd009edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:17.694 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.687+0000 7fadd674b640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd009a770 con 0x7fadd014d150 2023-10-08T12:00:17.694 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.687+0000 7fadd674b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd00a0f30 con 0x7fadd00699f0 2023-10-08T12:00:17.694 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.687+0000 7fadd674b640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadd01e2e10 con 0x7fadd006d0d0 2023-10-08T12:00:17.694 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.687+0000 7fadd4ce8640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fadd014d150 0x7fadd009edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:17.694 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.687+0000 7fadd4ce8640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fadd014d150 0x7fadd009edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:44990/0 (socket says 172.21.15.62:44990) 2023-10-08T12:00:17.694 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.687+0000 7fadd4ce8640 1 -- 172.21.15.62:0/1435167704 learned_addr learned my addr 172.21.15.62:0/1435167704 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:17.694 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.687+0000 7fadcf7fe640 1 --2- 172.21.15.62:0/1435167704 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fadd006d0d0 0x7fadd00a09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:17.695 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.687+0000 7fadcffff640 1 --2- 172.21.15.62:0/1435167704 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fadd00699f0 0x7fadd009a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:17.695 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.687+0000 7fadd4ce8640 1 -- 172.21.15.62:0/1435167704 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fadd006d0d0 msgr2=0x7fadd00a09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:17.695 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.687+0000 7fadd4ce8640 1 --2- 172.21.15.62:0/1435167704 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fadd006d0d0 0x7fadd00a09f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:17.695 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.687+0000 7fadd4ce8640 1 -- 172.21.15.62:0/1435167704 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fadd00699f0 msgr2=0x7fadd009a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:17.695 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.687+0000 7fadd4ce8640 1 --2- 172.21.15.62:0/1435167704 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fadd00699f0 0x7fadd009a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:17.695 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.687+0000 7fadd4ce8640 1 -- 172.21.15.62:0/1435167704 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadc4009560 con 0x7fadd014d150 2023-10-08T12:00:17.695 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.687+0000 7fadd4ce8640 1 --2- 172.21.15.62:0/1435167704 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fadd014d150 0x7fadd009edd0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fadc000b410 tx=0x7fadc000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:17.695 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.687+0000 7fadccff9640 1 -- 172.21.15.62:0/1435167704 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc0011830 con 0x7fadd014d150 2023-10-08T12:00:17.695 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.687+0000 7fadccff9640 1 -- 172.21.15.62:0/1435167704 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fadc0011a80 con 0x7fadd014d150 2023-10-08T12:00:17.695 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.687+0000 7fadd674b640 1 -- 172.21.15.62:0/1435167704 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadd01e30f0 con 0x7fadd014d150 2023-10-08T12:00:17.695 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.687+0000 7fadccff9640 1 -- 172.21.15.62:0/1435167704 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc0011e90 con 0x7fadd014d150 2023-10-08T12:00:17.695 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.691+0000 7fadd674b640 1 -- 172.21.15.62:0/1435167704 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadd01e36b0 con 0x7fadd014d150 2023-10-08T12:00:17.696 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.691+0000 7fadd674b640 1 -- 172.21.15.62:0/1435167704 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadd01e38a0 con 0x7fadd014d150 2023-10-08T12:00:17.696 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.691+0000 7fadccff9640 1 -- 172.21.15.62:0/1435167704 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fadc001a400 con 0x7fadd014d150 2023-10-08T12:00:17.697 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.691+0000 7fadccff9640 1 --2- 172.21.15.62:0/1435167704 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fadbc066470 0x7fadbc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:17.697 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.691+0000 7fadccff9640 1 -- 172.21.15.62:0/1435167704 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fadc0083e70 con 0x7fadd014d150 2023-10-08T12:00:17.697 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.691+0000 7fadcffff640 1 --2- 172.21.15.62:0/1435167704 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fadbc066470 0x7fadbc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:17.697 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.691+0000 7fadcffff640 1 --2- 172.21.15.62:0/1435167704 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fadbc066470 0x7fadbc068930 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fadc8001cc0 tx=0x7fadc8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:17.699 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.695+0000 7fadccff9640 1 -- 172.21.15.62:0/1435167704 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fadc00516d0 con 0x7fadd014d150 2023-10-08T12:00:17.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:17.851+0000 7fadd674b640 1 -- 172.21.15.62:0/1435167704 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fadd004da80 con 0x7fadd014d150 2023-10-08T12:00:18.303 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:00:18.306 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:00:18.309 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:00:18.489 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:18.483+0000 7fadccff9640 1 -- 172.21.15.62:0/1435167704 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7fadc0015020 con 0x7fadd014d150 2023-10-08T12:00:18.489 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_metadata' created 2023-10-08T12:00:18.492 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:18.487+0000 7fadd674b640 1 -- 172.21.15.62:0/1435167704 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fadbc066470 msgr2=0x7fadbc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:18.492 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:18.487+0000 7fadd674b640 1 --2- 172.21.15.62:0/1435167704 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fadbc066470 0x7fadbc068930 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fadc8001cc0 tx=0x7fadc8009040 comp rx=0 tx=0).stop 2023-10-08T12:00:18.493 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:18.487+0000 7fadd674b640 1 -- 172.21.15.62:0/1435167704 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fadd014d150 msgr2=0x7fadd009edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:18.493 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:18.487+0000 7fadd674b640 1 --2- 172.21.15.62:0/1435167704 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fadd014d150 0x7fadd009edd0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fadc000b410 tx=0x7fadc000b8d0 comp rx=0 tx=0).stop 2023-10-08T12:00:18.494 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:18.487+0000 7fadd674b640 1 -- 172.21.15.62:0/1435167704 shutdown_connections 2023-10-08T12:00:18.494 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:18.487+0000 7fadd674b640 1 --2- 172.21.15.62:0/1435167704 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fadbc066470 0x7fadbc068930 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:18.494 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:18.487+0000 7fadd674b640 1 --2- 172.21.15.62:0/1435167704 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fadd006d0d0 0x7fadd00a09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:18.494 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:18.487+0000 7fadd674b640 1 --2- 172.21.15.62:0/1435167704 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fadd014d150 0x7fadd009edd0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:18.494 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:18.487+0000 7fadd674b640 1 --2- 172.21.15.62:0/1435167704 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fadd00699f0 0x7fadd009a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:18.494 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:18.487+0000 7fadd674b640 1 -- 172.21.15.62:0/1435167704 >> 172.21.15.62:0/1435167704 conn(0x7fadd00b82f0 msgr2=0x7fadd00b95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:18.494 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:18.487+0000 7fadd674b640 1 -- 172.21.15.62:0/1435167704 shutdown_connections 2023-10-08T12:00:18.494 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:18.487+0000 7fadd674b640 1 -- 172.21.15.62:0/1435167704 wait complete. 2023-10-08T12:00:18.522 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-08T12:00:18.664 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:18.659+0000 7fd524f81640 1 -- 172.21.15.62:0/2535268258 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd5200699f0 msgr2=0x7fd5200b61f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:18.665 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:18.659+0000 7fd524f81640 1 --2- 172.21.15.62:0/2535268258 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd5200699f0 0x7fd5200b61f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd510009840 tx=0x7fd51001c670 comp rx=0 tx=0).stop 2023-10-08T12:00:18.665 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:18.659+0000 7fd524f81640 1 -- 172.21.15.62:0/2535268258 shutdown_connections 2023-10-08T12:00:18.665 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:18.659+0000 7fd524f81640 1 --2- 172.21.15.62:0/2535268258 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd5200699f0 0x7fd5200b61f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:18.665 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:18.659+0000 7fd524f81640 1 -- 172.21.15.62:0/2535268258 >> 172.21.15.62:0/2535268258 conn(0x7fd52009d5a0 msgr2=0x7fd52009d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:18.665 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:18.659+0000 7fd524f81640 1 -- 172.21.15.62:0/2535268258 shutdown_connections 2023-10-08T12:00:18.665 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:18.659+0000 7fd524f81640 1 -- 172.21.15.62:0/2535268258 wait complete. 2023-10-08T12:00:18.668 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:18.663+0000 7fd524f81640 1 Processor -- start 2023-10-08T12:00:18.668 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:18.663+0000 7fd524f81640 1 -- start start 2023-10-08T12:00:18.668 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:18.663+0000 7fd524f81640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd5200699f0 0x7fd52009f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:18.668 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:18.663+0000 7fd524f81640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd5200b1570 0x7fd52009bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:18.668 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:18.663+0000 7fd524f81640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd5200b76a0 0x7fd5201e38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:18.668 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:18.663+0000 7fd524f81640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd52009c250 con 0x7fd5200b1570 2023-10-08T12:00:18.668 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:18.663+0000 7fd524f81640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd52014a220 con 0x7fd5200b76a0 2023-10-08T12:00:18.668 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:18.663+0000 7fd524f81640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5201e3e00 con 0x7fd5200699f0 2023-10-08T12:00:18.668 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:18.663+0000 7fd51dd9b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd5200b1570 0x7fd52009bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:18.668 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:18.663+0000 7fd51dd9b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd5200b1570 0x7fd52009bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:45022/0 (socket says 172.21.15.62:45022) 2023-10-08T12:00:18.669 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:18.663+0000 7fd51dd9b640 1 -- 172.21.15.62:0/2917262296 learned_addr learned my addr 172.21.15.62:0/2917262296 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:18.669 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:18.663+0000 7fd51e59c640 1 --2- 172.21.15.62:0/2917262296 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd5200699f0 0x7fd52009f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:18.669 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:18.663+0000 7fd51dd9b640 1 -- 172.21.15.62:0/2917262296 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd5200699f0 msgr2=0x7fd52009f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:18.669 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:18.663+0000 7fd51dd9b640 1 --2- 172.21.15.62:0/2917262296 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd5200699f0 0x7fd52009f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:18.669 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:18.663+0000 7fd51dd9b640 1 -- 172.21.15.62:0/2917262296 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd5200b76a0 msgr2=0x7fd5201e38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:18.669 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:18.663+0000 7fd51ed9d640 1 --2- 172.21.15.62:0/2917262296 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd5200b76a0 0x7fd5201e38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:18.669 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:18.663+0000 7fd51dd9b640 1 --2- 172.21.15.62:0/2917262296 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd5200b76a0 0x7fd5201e38c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:18.669 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:18.663+0000 7fd51dd9b640 1 -- 172.21.15.62:0/2917262296 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5100094a0 con 0x7fd5200b1570 2023-10-08T12:00:18.669 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:18.663+0000 7fd51ed9d640 1 --2- 172.21.15.62:0/2917262296 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd5200b76a0 0x7fd5201e38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:00:18.669 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:18.663+0000 7fd51dd9b640 1 --2- 172.21.15.62:0/2917262296 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd5200b1570 0x7fd52009bd10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd51400c490 tx=0x7fd514001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:18.669 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:18.663+0000 7fd50effd640 1 -- 172.21.15.62:0/2917262296 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd514003600 con 0x7fd5200b1570 2023-10-08T12:00:18.669 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:18.663+0000 7fd50effd640 1 -- 172.21.15.62:0/2917262296 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd514003780 con 0x7fd5200b1570 2023-10-08T12:00:18.670 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:18.663+0000 7fd524f81640 1 -- 172.21.15.62:0/2917262296 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd52014a4a0 con 0x7fd5200b1570 2023-10-08T12:00:18.670 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:18.663+0000 7fd50effd640 1 -- 172.21.15.62:0/2917262296 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd514003bd0 con 0x7fd5200b1570 2023-10-08T12:00:18.670 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:18.663+0000 7fd524f81640 1 -- 172.21.15.62:0/2917262296 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5201e33a0 con 0x7fd5200b1570 2023-10-08T12:00:18.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:18.663+0000 7fd524f81640 1 -- 172.21.15.62:0/2917262296 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd52014a6e0 con 0x7fd5200b1570 2023-10-08T12:00:18.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:18.663+0000 7fd50effd640 1 -- 172.21.15.62:0/2917262296 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd514003d30 con 0x7fd5200b1570 2023-10-08T12:00:18.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:18.663+0000 7fd50effd640 1 --2- 172.21.15.62:0/2917262296 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fd500066470 0x7fd500068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:18.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:18.663+0000 7fd50effd640 1 -- 172.21.15.62:0/2917262296 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fd5140830c0 con 0x7fd5200b1570 2023-10-08T12:00:18.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:18.667+0000 7fd51e59c640 1 --2- 172.21.15.62:0/2917262296 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fd500066470 0x7fd500068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:18.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:18.667+0000 7fd51e59c640 1 --2- 172.21.15.62:0/2917262296 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fd500066470 0x7fd500068930 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd5100af000 tx=0x7fd51001aeb0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:18.673 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:18.671+0000 7fd50effd640 1 -- 172.21.15.62:0/2917262296 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd52014a6e0 con 0x7fd5200b1570 2023-10-08T12:00:18.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:18.827+0000 7fd524f81640 1 -- 172.21.15.62:0/2917262296 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fd52009f150 con 0x7fd5200b1570 2023-10-08T12:00:19.494 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:19.487+0000 7fd50effd640 1 -- 172.21.15.62:0/2917262296 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7fd52009f150 con 0x7fd5200b1570 2023-10-08T12:00:19.494 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_data' created 2023-10-08T12:00:19.496 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:19.491+0000 7fd524f81640 1 -- 172.21.15.62:0/2917262296 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fd500066470 msgr2=0x7fd500068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:19.496 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:19.491+0000 7fd524f81640 1 --2- 172.21.15.62:0/2917262296 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fd500066470 0x7fd500068930 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd5100af000 tx=0x7fd51001aeb0 comp rx=0 tx=0).stop 2023-10-08T12:00:19.497 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:19.491+0000 7fd524f81640 1 -- 172.21.15.62:0/2917262296 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd5200b1570 msgr2=0x7fd52009bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:19.497 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:19.491+0000 7fd524f81640 1 --2- 172.21.15.62:0/2917262296 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd5200b1570 0x7fd52009bd10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd51400c490 tx=0x7fd514001e80 comp rx=0 tx=0).stop 2023-10-08T12:00:19.497 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:19.491+0000 7fd524f81640 1 -- 172.21.15.62:0/2917262296 shutdown_connections 2023-10-08T12:00:19.497 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:19.491+0000 7fd524f81640 1 --2- 172.21.15.62:0/2917262296 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fd500066470 0x7fd500068930 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:19.497 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:19.491+0000 7fd524f81640 1 --2- 172.21.15.62:0/2917262296 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd5200b76a0 0x7fd5201e38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:19.497 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:19.491+0000 7fd524f81640 1 --2- 172.21.15.62:0/2917262296 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd5200b1570 0x7fd52009bd10 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:19.497 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:19.491+0000 7fd524f81640 1 --2- 172.21.15.62:0/2917262296 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd5200699f0 0x7fd52009f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:19.497 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:19.491+0000 7fd524f81640 1 -- 172.21.15.62:0/2917262296 >> 172.21.15.62:0/2917262296 conn(0x7fd52009d5a0 msgr2=0x7fd52009d980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:19.497 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:19.491+0000 7fd524f81640 1 -- 172.21.15.62:0/2917262296 shutdown_connections 2023-10-08T12:00:19.498 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:19.491+0000 7fd524f81640 1 -- 172.21.15.62:0/2917262296 wait complete. 2023-10-08T12:00:19.528 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-08T12:00:19.667 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:19.663+0000 7f38558bd640 1 -- 172.21.15.62:0/1451465487 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3838005e20 msgr2=0x7f38380062a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:19.667 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:19.663+0000 7f38558bd640 1 --2- 172.21.15.62:0/1451465487 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3838005e20 0x7f38380062a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3848001d70 tx=0x7f384801cae0 comp rx=0 tx=0).stop 2023-10-08T12:00:19.667 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:19.663+0000 7f384f7fe640 1 -- 172.21.15.62:0/1451465487 reap_dead start 2023-10-08T12:00:19.667 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:19.663+0000 7f38558bd640 1 -- 172.21.15.62:0/1451465487 shutdown_connections 2023-10-08T12:00:19.667 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:19.663+0000 7f38558bd640 1 -- 172.21.15.62:0/1451465487 >> 172.21.15.62:0/1451465487 conn(0x7f385009c520 msgr2=0x7f385009c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:19.667 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:19.663+0000 7f38558bd640 1 -- 172.21.15.62:0/1451465487 shutdown_connections 2023-10-08T12:00:19.668 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:19.663+0000 7f38558bd640 1 -- 172.21.15.62:0/1451465487 wait complete. 2023-10-08T12:00:19.670 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:19.663+0000 7f38558bd640 1 Processor -- start 2023-10-08T12:00:19.670 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:19.663+0000 7f38558bd640 1 -- start start 2023-10-08T12:00:19.670 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:19.663+0000 7f38558bd640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3838005e20 0x7f385009b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:19.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:19.663+0000 7f38558bd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f385006fbe0 0x7f3850070a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:19.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:19.663+0000 7f38558bd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3850070f50 0x7f3850140d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:19.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:19.663+0000 7f38558bd640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f385006f0a0 con 0x7f3850070f50 2023-10-08T12:00:19.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:19.663+0000 7f38558bd640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f385009bc80 con 0x7f385006fbe0 2023-10-08T12:00:19.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:19.663+0000 7f38558bd640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f385006e5b0 con 0x7f3838005e20 2023-10-08T12:00:19.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:19.663+0000 7f384f7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3850070f50 0x7f3850140d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:19.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:19.663+0000 7f384f7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3850070f50 0x7f3850140d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:45030/0 (socket says 172.21.15.62:45030) 2023-10-08T12:00:19.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:19.663+0000 7f384f7fe640 1 -- 172.21.15.62:0/3587089167 learned_addr learned my addr 172.21.15.62:0/3587089167 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:19.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:19.663+0000 7f384effd640 1 --2- 172.21.15.62:0/3587089167 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3838005e20 0x7f385009b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:19.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:19.663+0000 7f384e7fc640 1 --2- 172.21.15.62:0/3587089167 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f385006fbe0 0x7f3850070a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:19.672 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:19.663+0000 7f384f7fe640 1 -- 172.21.15.62:0/3587089167 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3838005e20 msgr2=0x7f385009b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:19.672 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:19.663+0000 7f384f7fe640 1 --2- 172.21.15.62:0/3587089167 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3838005e20 0x7f385009b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:19.672 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:19.663+0000 7f384f7fe640 1 -- 172.21.15.62:0/3587089167 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f385006fbe0 msgr2=0x7f3850070a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:19.672 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:19.663+0000 7f384f7fe640 1 --2- 172.21.15.62:0/3587089167 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f385006fbe0 0x7f3850070a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:19.672 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:19.663+0000 7f384f7fe640 1 -- 172.21.15.62:0/3587089167 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3850070530 con 0x7f3850070f50 2023-10-08T12:00:19.672 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:19.663+0000 7f384effd640 1 --2- 172.21.15.62:0/3587089167 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3838005e20 0x7f385009b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:00:19.672 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:19.663+0000 7f384f7fe640 1 --2- 172.21.15.62:0/3587089167 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3850070f50 0x7f3850140d40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3848005040 tx=0x7f38480a7eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:19.672 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:19.667+0000 7f3837fff640 1 -- 172.21.15.62:0/3587089167 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3848006c70 con 0x7f3850070f50 2023-10-08T12:00:19.673 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:19.667+0000 7f3837fff640 1 -- 172.21.15.62:0/3587089167 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3848003d30 con 0x7f3850070f50 2023-10-08T12:00:19.673 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:19.667+0000 7f38558bd640 1 -- 172.21.15.62:0/3587089167 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3850070110 con 0x7f3850070f50 2023-10-08T12:00:19.673 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:19.667+0000 7f3837fff640 1 -- 172.21.15.62:0/3587089167 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3848003ea0 con 0x7f3850070f50 2023-10-08T12:00:19.673 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:19.667+0000 7f38558bd640 1 -- 172.21.15.62:0/3587089167 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f385006eae0 con 0x7f3850070f50 2023-10-08T12:00:19.673 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:19.667+0000 7f38558bd640 1 -- 172.21.15.62:0/3587089167 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f385004da80 con 0x7f3850070f50 2023-10-08T12:00:19.674 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:19.667+0000 7f3837fff640 1 -- 172.21.15.62:0/3587089167 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f38480b5070 con 0x7f3850070f50 2023-10-08T12:00:19.674 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:19.667+0000 7f3837fff640 1 --2- 172.21.15.62:0/3587089167 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f383c0664a0 0x7f383c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:19.674 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:19.667+0000 7f3837fff640 1 -- 172.21.15.62:0/3587089167 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f38480aa070 con 0x7f3850070f50 2023-10-08T12:00:19.674 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:19.667+0000 7f384effd640 1 --2- 172.21.15.62:0/3587089167 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f383c0664a0 0x7f383c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:19.674 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:19.667+0000 7f384effd640 1 --2- 172.21.15.62:0/3587089167 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f383c0664a0 0x7f383c068960 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f38400019e0 tx=0x7f3840001000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:19.676 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:19.671+0000 7f3837fff640 1 -- 172.21.15.62:0/3587089167 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f38480ead60 con 0x7f3850070f50 2023-10-08T12:00:19.864 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:19.859+0000 7f38558bd640 1 -- 172.21.15.62:0/3587089167 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f38500706c0 con 0x7f3850070f50 2023-10-08T12:00:20.581 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:20.575+0000 7f3837fff640 1 -- 172.21.15.62:0/3587089167 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f38480ee380 con 0x7f3850070f50 2023-10-08T12:00:20.592 INFO:teuthology.orchestra.run.smithi062.stderr:new fs with metadata pool 2 and data pool 3 2023-10-08T12:00:20.599 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:20.595+0000 7f38558bd640 1 -- 172.21.15.62:0/3587089167 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f383c0664a0 msgr2=0x7f383c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:20.599 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:20.595+0000 7f38558bd640 1 --2- 172.21.15.62:0/3587089167 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f383c0664a0 0x7f383c068960 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f38400019e0 tx=0x7f3840001000 comp rx=0 tx=0).stop 2023-10-08T12:00:20.599 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:20.595+0000 7f38558bd640 1 -- 172.21.15.62:0/3587089167 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3850070f50 msgr2=0x7f3850140d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:20.599 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:20.595+0000 7f38558bd640 1 --2- 172.21.15.62:0/3587089167 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3850070f50 0x7f3850140d40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3848005040 tx=0x7f38480a7eb0 comp rx=0 tx=0).stop 2023-10-08T12:00:20.599 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:20.595+0000 7f38558bd640 1 -- 172.21.15.62:0/3587089167 shutdown_connections 2023-10-08T12:00:20.600 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:20.595+0000 7f38558bd640 1 --2- 172.21.15.62:0/3587089167 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f383c0664a0 0x7f383c068960 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:20.600 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:20.595+0000 7f38558bd640 1 --2- 172.21.15.62:0/3587089167 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3850070f50 0x7f3850140d40 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:20.600 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:20.595+0000 7f38558bd640 1 --2- 172.21.15.62:0/3587089167 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f385006fbe0 0x7f3850070a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:20.600 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:20.595+0000 7f38558bd640 1 --2- 172.21.15.62:0/3587089167 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3838005e20 0x7f385009b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:20.600 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:20.595+0000 7f38558bd640 1 -- 172.21.15.62:0/3587089167 >> 172.21.15.62:0/3587089167 conn(0x7f385009c520 msgr2=0x7f38501d2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:20.601 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:20.595+0000 7f38558bd640 1 -- 172.21.15.62:0/3587089167 shutdown_connections 2023-10-08T12:00:20.601 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:20.595+0000 7f38558bd640 1 -- 172.21.15.62:0/3587089167 wait complete. 2023-10-08T12:00:20.628 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:00:20.761 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:20.755+0000 7fec967bf640 1 -- 172.21.15.62:0/3314180528 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec7c0047d0 msgr2=0x7fec7c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:20.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:20.755+0000 7fec967bf640 1 --2- 172.21.15.62:0/3314180528 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec7c0047d0 0x7fec7c004c50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fec80001da0 tx=0x7fec8001cb00 comp rx=0 tx=0).stop 2023-10-08T12:00:20.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:20.755+0000 7fec967bf640 1 -- 172.21.15.62:0/3314180528 shutdown_connections 2023-10-08T12:00:20.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:20.755+0000 7fec967bf640 1 --2- 172.21.15.62:0/3314180528 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec7c0047d0 0x7fec7c004c50 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:20.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:20.755+0000 7fec967bf640 1 -- 172.21.15.62:0/3314180528 >> 172.21.15.62:0/3314180528 conn(0x7fec9009c520 msgr2=0x7fec9009c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:20.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:20.755+0000 7fec967bf640 1 -- 172.21.15.62:0/3314180528 shutdown_connections 2023-10-08T12:00:20.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:20.755+0000 7fec967bf640 1 -- 172.21.15.62:0/3314180528 wait complete. 2023-10-08T12:00:20.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:20.759+0000 7fec967bf640 1 Processor -- start 2023-10-08T12:00:20.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:20.759+0000 7fec967bf640 1 -- start start 2023-10-08T12:00:20.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:20.759+0000 7fec967bf640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec7c0047d0 0x7fec901d1b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:20.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:20.759+0000 7fec967bf640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec90143c50 0x7fec900af790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:20.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:20.759+0000 7fec967bf640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fec90143010 0x7fec90143490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:20.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:20.759+0000 7fec967bf640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec901d2080 con 0x7fec90143c50 2023-10-08T12:00:20.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:20.759+0000 7fec967bf640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec901d0e70 con 0x7fec7c0047d0 2023-10-08T12:00:20.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:20.759+0000 7fec967bf640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec901d0260 con 0x7fec90143010 2023-10-08T12:00:20.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:20.759+0000 7fec8f7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec90143c50 0x7fec900af790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:20.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:20.759+0000 7fec8f7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec90143c50 0x7fec900af790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:45046/0 (socket says 172.21.15.62:45046) 2023-10-08T12:00:20.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:20.759+0000 7fec8f7fe640 1 -- 172.21.15.62:0/2873044308 learned_addr learned my addr 172.21.15.62:0/2873044308 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:20.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:20.759+0000 7fec8ffff640 1 --2- 172.21.15.62:0/2873044308 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec7c0047d0 0x7fec901d1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:20.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:20.759+0000 7fec94d5c640 1 --2- 172.21.15.62:0/2873044308 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fec90143010 0x7fec90143490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:20.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:20.759+0000 7fec8f7fe640 1 -- 172.21.15.62:0/2873044308 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fec90143010 msgr2=0x7fec90143490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:20.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:20.759+0000 7fec8f7fe640 1 --2- 172.21.15.62:0/2873044308 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fec90143010 0x7fec90143490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:20.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:20.759+0000 7fec8f7fe640 1 -- 172.21.15.62:0/2873044308 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec7c0047d0 msgr2=0x7fec901d1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:20.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:20.759+0000 7fec8f7fe640 1 --2- 172.21.15.62:0/2873044308 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec7c0047d0 0x7fec901d1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:20.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:20.759+0000 7fec8f7fe640 1 -- 172.21.15.62:0/2873044308 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec901d0540 con 0x7fec90143c50 2023-10-08T12:00:20.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:20.759+0000 7fec8f7fe640 1 --2- 172.21.15.62:0/2873044308 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec90143c50 0x7fec900af790 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fec8001c930 tx=0x7fec800a7ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:20.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:20.759+0000 7fec8cff9640 1 -- 172.21.15.62:0/2873044308 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec80003d30 con 0x7fec90143c50 2023-10-08T12:00:20.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:20.759+0000 7fec8cff9640 1 -- 172.21.15.62:0/2873044308 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fec800a7070 con 0x7fec90143c50 2023-10-08T12:00:20.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:20.759+0000 7fec967bf640 1 -- 172.21.15.62:0/2873044308 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec901d0820 con 0x7fec90143c50 2023-10-08T12:00:20.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:20.759+0000 7fec8cff9640 1 -- 172.21.15.62:0/2873044308 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec800a7480 con 0x7fec90143c50 2023-10-08T12:00:20.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:20.759+0000 7fec967bf640 1 -- 172.21.15.62:0/2873044308 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec901439d0 con 0x7fec90143c50 2023-10-08T12:00:20.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:20.759+0000 7fec967bf640 1 -- 172.21.15.62:0/2873044308 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec9004da80 con 0x7fec90143c50 2023-10-08T12:00:20.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:20.763+0000 7fec8cff9640 1 -- 172.21.15.62:0/2873044308 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fec800b5070 con 0x7fec90143c50 2023-10-08T12:00:20.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:20.763+0000 7fec8cff9640 1 --2- 172.21.15.62:0/2873044308 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fec70066470 0x7fec70068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:20.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:20.763+0000 7fec8cff9640 1 -- 172.21.15.62:0/2873044308 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fec800aa070 con 0x7fec90143c50 2023-10-08T12:00:20.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:20.763+0000 7fec8ffff640 1 --2- 172.21.15.62:0/2873044308 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fec70066470 0x7fec70068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:20.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:20.763+0000 7fec8ffff640 1 --2- 172.21.15.62:0/2873044308 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fec70066470 0x7fec70068930 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fec78000c10 tx=0x7fec78000f20 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:20.770 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:20.767+0000 7fec8cff9640 1 -- 172.21.15.62:0/2873044308 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fec800eb460 con 0x7fec90143c50 2023-10-08T12:00:20.928 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:20.923+0000 7fec967bf640 1 -- 172.21.15.62:0/2873044308 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fec9009d260 con 0x7fec90143c50 2023-10-08T12:00:20.930 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:20.927+0000 7fec8cff9640 1 -- 172.21.15.62:0/2873044308 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16494 (secure 0 0 0) 0x7fec800eea80 con 0x7fec90143c50 2023-10-08T12:00:20.930 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T12:00:20.930 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":19,"fsid":"3e777930-c2c1-4f2b-a903-c07ee4ca2c52","created":"2023-10-08T11:59:54.510229+0000","modified":"2023-10-08T12:00:19.865990+0000","last_up_change":"2023-10-08T12:00:06.783998+0000","last_in_change":"2023-10-08T11:59:57.847944+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:00:07.189433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:00:17.895548+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T12:00:18.871217+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7bc3070a-7240-43d9-9ec3-397b68a37e2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6820","nonce":2227876905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6824","nonce":2227876905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6831","nonce":2227876905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6828","nonce":2227876905}]},"public_addr":"172.21.15.62:6820/2227876905","cluster_addr":"172.21.15.62:6824/2227876905","heartbeat_back_addr":"172.21.15.62:6831/2227876905","heartbeat_front_addr":"172.21.15.62:6828/2227876905","state":["exists","up"]},{"osd":1,"uuid":"5e0fa1f5-9ddc-4882-b460-5578bb571003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6801","nonce":315660906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6803","nonce":315660906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6808","nonce":315660906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6805","nonce":315660906}]},"public_addr":"172.21.15.62:6801/315660906","cluster_addr":"172.21.15.62:6803/315660906","heartbeat_back_addr":"172.21.15.62:6808/315660906","heartbeat_front_addr":"172.21.15.62:6805/315660906","state":["exists","up"]},{"osd":2,"uuid":"262b5ee9-4243-4309-a14f-88ad4e8bf812","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6807","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6809","nonce":3784842938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6811","nonce":3784842938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6815","nonce":3784842938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6813","nonce":3784842938}]},"public_addr":"172.21.15.62:6809/3784842938","cluster_addr":"172.21.15.62:6811/3784842938","heartbeat_back_addr":"172.21.15.62:6815/3784842938","heartbeat_front_addr":"172.21.15.62:6813/3784842938","state":["exists","up"]},{"osd":3,"uuid":"1770bdb8-c12b-43b1-aaab-1d6b6fd18f4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6817","nonce":3385303160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6821","nonce":3385303160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6827","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6829","nonce":3385303160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6823","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6825","nonce":3385303160}]},"public_addr":"172.21.15.62:6817/3385303160","cluster_addr":"172.21.15.62:6821/3385303160","heartbeat_back_addr":"172.21.15.62:6829/3385303160","heartbeat_front_addr":"172.21.15.62:6825/3385303160","state":["exists","up"]},{"osd":4,"uuid":"74c73631-9351-494a-8246-28ee86e9f862","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6807","nonce":1174056987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6809","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6811","nonce":1174056987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6820","nonce":1174056987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6813","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6816","nonce":1174056987}]},"public_addr":"172.21.15.130:6807/1174056987","cluster_addr":"172.21.15.130:6811/1174056987","heartbeat_back_addr":"172.21.15.130:6820/1174056987","heartbeat_front_addr":"172.21.15.130:6816/1174056987","state":["exists","up"]},{"osd":5,"uuid":"1040f389-272c-41d6-ae76-70c04d09afa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6801","nonce":561928414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6803","nonce":561928414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6815","nonce":561928414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6808","nonce":561928414}]},"public_addr":"172.21.15.130:6801/561928414","cluster_addr":"172.21.15.130:6803/561928414","heartbeat_back_addr":"172.21.15.130:6815/561928414","heartbeat_front_addr":"172.21.15.130:6808/561928414","state":["exists","up"]},{"osd":6,"uuid":"178553eb-03e1-4ab8-9826-4f5997e6da0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6810","nonce":2877303015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6817","nonce":2877303015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6823","nonce":2877303015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6819","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6821","nonce":2877303015}]},"public_addr":"172.21.15.130:6810/2877303015","cluster_addr":"172.21.15.130:6817/2877303015","heartbeat_back_addr":"172.21.15.130:6823/2877303015","heartbeat_front_addr":"172.21.15.130:6821/2877303015","state":["exists","up"]},{"osd":7,"uuid":"b6581c8f-30b1-4dfd-b7b6-94b579128835","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6825","nonce":680009774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6827","nonce":680009774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6831","nonce":680009774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6829","nonce":680009774}]},"public_addr":"172.21.15.130:6825/680009774","cluster_addr":"172.21.15.130:6827/680009774","heartbeat_back_addr":"172.21.15.130:6831/680009774","heartbeat_front_addr":"172.21.15.130:6829/680009774","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.505543+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.394383+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.456652+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.529168+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.235414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.392158+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.347556+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.432039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:00:20.933 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:20.927+0000 7fec967bf640 1 -- 172.21.15.62:0/2873044308 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fec70066470 msgr2=0x7fec70068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:20.933 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:20.927+0000 7fec967bf640 1 --2- 172.21.15.62:0/2873044308 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fec70066470 0x7fec70068930 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fec78000c10 tx=0x7fec78000f20 comp rx=0 tx=0).stop 2023-10-08T12:00:20.933 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:20.927+0000 7fec967bf640 1 -- 172.21.15.62:0/2873044308 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec90143c50 msgr2=0x7fec900af790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:20.933 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:20.927+0000 7fec967bf640 1 --2- 172.21.15.62:0/2873044308 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec90143c50 0x7fec900af790 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fec8001c930 tx=0x7fec800a7ec0 comp rx=0 tx=0).stop 2023-10-08T12:00:20.933 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:20.927+0000 7fec967bf640 1 -- 172.21.15.62:0/2873044308 shutdown_connections 2023-10-08T12:00:20.933 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:20.927+0000 7fec967bf640 1 --2- 172.21.15.62:0/2873044308 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fec70066470 0x7fec70068930 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:20.933 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:20.927+0000 7fec967bf640 1 --2- 172.21.15.62:0/2873044308 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fec90143010 0x7fec90143490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:20.933 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:20.927+0000 7fec967bf640 1 --2- 172.21.15.62:0/2873044308 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec90143c50 0x7fec900af790 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:20.933 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:20.927+0000 7fec967bf640 1 --2- 172.21.15.62:0/2873044308 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec7c0047d0 0x7fec901d1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:20.934 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:20.927+0000 7fec967bf640 1 -- 172.21.15.62:0/2873044308 >> 172.21.15.62:0/2873044308 conn(0x7fec9009c520 msgr2=0x7fec90148050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:20.934 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:20.927+0000 7fec967bf640 1 -- 172.21.15.62:0/2873044308 shutdown_connections 2023-10-08T12:00:20.934 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:20.927+0000 7fec967bf640 1 -- 172.21.15.62:0/2873044308 wait complete. 2023-10-08T12:00:20.950 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:00:21.074 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.071+0000 7f0466d26640 1 -- 172.21.15.62:0/453909991 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f04600718c0 msgr2=0x7f04600b5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:21.074 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.071+0000 7f0466d26640 1 --2- 172.21.15.62:0/453909991 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f04600718c0 0x7f04600b5170 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0450009840 tx=0x7f045001c800 comp rx=0 tx=0).stop 2023-10-08T12:00:21.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.071+0000 7f0466d26640 1 -- 172.21.15.62:0/453909991 shutdown_connections 2023-10-08T12:00:21.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.071+0000 7f0466d26640 1 --2- 172.21.15.62:0/453909991 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f04600b8570 0x7f04600b8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:21.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.071+0000 7f0466d26640 1 --2- 172.21.15.62:0/453909991 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f04600718c0 0x7f04600b5170 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:21.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.071+0000 7f0466d26640 1 -- 172.21.15.62:0/453909991 >> 172.21.15.62:0/453909991 conn(0x7f046009c520 msgr2=0x7f046009c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:21.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.071+0000 7f0466d26640 1 -- 172.21.15.62:0/453909991 shutdown_connections 2023-10-08T12:00:21.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.071+0000 7f0466d26640 1 -- 172.21.15.62:0/453909991 wait complete. 2023-10-08T12:00:21.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.071+0000 7f0466d26640 1 Processor -- start 2023-10-08T12:00:21.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.071+0000 7f0466d26640 1 -- start start 2023-10-08T12:00:21.078 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.071+0000 7f0466d26640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f04600718c0 0x7f046013c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:21.078 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.071+0000 7f0466d26640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f04600b6a60 0x7f04600702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:21.078 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.071+0000 7f0466d26640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f04600b8570 0x7f0460070830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:21.078 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.071+0000 7f0466d26640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f046006e640 con 0x7f04600b8570 2023-10-08T12:00:21.078 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.071+0000 7f0466d26640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0460070d70 con 0x7f04600718c0 2023-10-08T12:00:21.078 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.071+0000 7f0466d26640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f046013e220 con 0x7f04600b6a60 2023-10-08T12:00:21.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.071+0000 7f04652c3640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f04600b8570 0x7f0460070830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:21.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.071+0000 7f04652c3640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f04600b8570 0x7f0460070830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:45064/0 (socket says 172.21.15.62:45064) 2023-10-08T12:00:21.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.071+0000 7f04652c3640 1 -- 172.21.15.62:0/3190922307 learned_addr learned my addr 172.21.15.62:0/3190922307 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:21.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.071+0000 7f0464ac2640 1 --2- 172.21.15.62:0/3190922307 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f04600718c0 0x7f046013c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:21.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.071+0000 7f045ffff640 1 --2- 172.21.15.62:0/3190922307 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f04600b6a60 0x7f04600702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:21.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.071+0000 7f04652c3640 1 -- 172.21.15.62:0/3190922307 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f04600b6a60 msgr2=0x7f04600702f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:21.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.071+0000 7f04652c3640 1 --2- 172.21.15.62:0/3190922307 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f04600b6a60 0x7f04600702f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:21.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.071+0000 7f04652c3640 1 -- 172.21.15.62:0/3190922307 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f04600718c0 msgr2=0x7f046013c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:21.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.071+0000 7f04652c3640 1 --2- 172.21.15.62:0/3190922307 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f04600718c0 0x7f046013c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:21.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.071+0000 7f04652c3640 1 -- 172.21.15.62:0/3190922307 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04500094a0 con 0x7f04600b8570 2023-10-08T12:00:21.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.071+0000 7f04652c3640 1 --2- 172.21.15.62:0/3190922307 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f04600b8570 0x7f0460070830 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f045800d660 tx=0x7f045800db20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:21.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.075+0000 7f045d7fa640 1 -- 172.21.15.62:0/3190922307 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0458005220 con 0x7f04600b8570 2023-10-08T12:00:21.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.075+0000 7f045d7fa640 1 -- 172.21.15.62:0/3190922307 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0458005470 con 0x7f04600b8570 2023-10-08T12:00:21.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.075+0000 7f0466d26640 1 -- 172.21.15.62:0/3190922307 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04601487c0 con 0x7f04600b8570 2023-10-08T12:00:21.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.075+0000 7f045d7fa640 1 -- 172.21.15.62:0/3190922307 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0458009a20 con 0x7f04600b8570 2023-10-08T12:00:21.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.075+0000 7f0466d26640 1 -- 172.21.15.62:0/3190922307 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f046013dbd0 con 0x7f04600b8570 2023-10-08T12:00:21.083 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.075+0000 7f0466d26640 1 -- 172.21.15.62:0/3190922307 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f046004da80 con 0x7f04600b8570 2023-10-08T12:00:21.083 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.075+0000 7f045d7fa640 1 -- 172.21.15.62:0/3190922307 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f0458009b80 con 0x7f04600b8570 2023-10-08T12:00:21.083 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.075+0000 7f045d7fa640 1 --2- 172.21.15.62:0/3190922307 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f044c066470 0x7f044c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:21.083 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.075+0000 7f045d7fa640 1 -- 172.21.15.62:0/3190922307 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0458083df0 con 0x7f04600b8570 2023-10-08T12:00:21.083 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.075+0000 7f0464ac2640 1 --2- 172.21.15.62:0/3190922307 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f044c066470 0x7f044c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:21.084 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.075+0000 7f0464ac2640 1 --2- 172.21.15.62:0/3190922307 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f044c066470 0x7f044c068930 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f04500af000 tx=0x7f045001b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:21.084 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.079+0000 7f045d7fa640 1 -- 172.21.15.62:0/3190922307 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f04580513b0 con 0x7f04600b8570 2023-10-08T12:00:21.243 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.239+0000 7f0466d26640 1 -- 172.21.15.62:0/3190922307 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f046013e360 con 0x7f04600b8570 2023-10-08T12:00:21.246 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.243+0000 7f045d7fa640 1 -- 172.21.15.62:0/3190922307 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16494 (secure 0 0 0) 0x7f0458017090 con 0x7f04600b8570 2023-10-08T12:00:21.246 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T12:00:21.246 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":19,"fsid":"3e777930-c2c1-4f2b-a903-c07ee4ca2c52","created":"2023-10-08T11:59:54.510229+0000","modified":"2023-10-08T12:00:19.865990+0000","last_up_change":"2023-10-08T12:00:06.783998+0000","last_in_change":"2023-10-08T11:59:57.847944+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:00:07.189433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:00:17.895548+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T12:00:18.871217+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7bc3070a-7240-43d9-9ec3-397b68a37e2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6820","nonce":2227876905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6824","nonce":2227876905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6831","nonce":2227876905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6828","nonce":2227876905}]},"public_addr":"172.21.15.62:6820/2227876905","cluster_addr":"172.21.15.62:6824/2227876905","heartbeat_back_addr":"172.21.15.62:6831/2227876905","heartbeat_front_addr":"172.21.15.62:6828/2227876905","state":["exists","up"]},{"osd":1,"uuid":"5e0fa1f5-9ddc-4882-b460-5578bb571003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6801","nonce":315660906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6803","nonce":315660906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6808","nonce":315660906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6805","nonce":315660906}]},"public_addr":"172.21.15.62:6801/315660906","cluster_addr":"172.21.15.62:6803/315660906","heartbeat_back_addr":"172.21.15.62:6808/315660906","heartbeat_front_addr":"172.21.15.62:6805/315660906","state":["exists","up"]},{"osd":2,"uuid":"262b5ee9-4243-4309-a14f-88ad4e8bf812","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6807","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6809","nonce":3784842938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6811","nonce":3784842938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6815","nonce":3784842938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6813","nonce":3784842938}]},"public_addr":"172.21.15.62:6809/3784842938","cluster_addr":"172.21.15.62:6811/3784842938","heartbeat_back_addr":"172.21.15.62:6815/3784842938","heartbeat_front_addr":"172.21.15.62:6813/3784842938","state":["exists","up"]},{"osd":3,"uuid":"1770bdb8-c12b-43b1-aaab-1d6b6fd18f4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6817","nonce":3385303160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6821","nonce":3385303160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6827","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6829","nonce":3385303160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6823","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6825","nonce":3385303160}]},"public_addr":"172.21.15.62:6817/3385303160","cluster_addr":"172.21.15.62:6821/3385303160","heartbeat_back_addr":"172.21.15.62:6829/3385303160","heartbeat_front_addr":"172.21.15.62:6825/3385303160","state":["exists","up"]},{"osd":4,"uuid":"74c73631-9351-494a-8246-28ee86e9f862","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6807","nonce":1174056987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6809","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6811","nonce":1174056987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6820","nonce":1174056987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6813","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6816","nonce":1174056987}]},"public_addr":"172.21.15.130:6807/1174056987","cluster_addr":"172.21.15.130:6811/1174056987","heartbeat_back_addr":"172.21.15.130:6820/1174056987","heartbeat_front_addr":"172.21.15.130:6816/1174056987","state":["exists","up"]},{"osd":5,"uuid":"1040f389-272c-41d6-ae76-70c04d09afa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6801","nonce":561928414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6803","nonce":561928414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6815","nonce":561928414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6808","nonce":561928414}]},"public_addr":"172.21.15.130:6801/561928414","cluster_addr":"172.21.15.130:6803/561928414","heartbeat_back_addr":"172.21.15.130:6815/561928414","heartbeat_front_addr":"172.21.15.130:6808/561928414","state":["exists","up"]},{"osd":6,"uuid":"178553eb-03e1-4ab8-9826-4f5997e6da0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6810","nonce":2877303015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6817","nonce":2877303015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6823","nonce":2877303015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6819","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6821","nonce":2877303015}]},"public_addr":"172.21.15.130:6810/2877303015","cluster_addr":"172.21.15.130:6817/2877303015","heartbeat_back_addr":"172.21.15.130:6823/2877303015","heartbeat_front_addr":"172.21.15.130:6821/2877303015","state":["exists","up"]},{"osd":7,"uuid":"b6581c8f-30b1-4dfd-b7b6-94b579128835","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6825","nonce":680009774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6827","nonce":680009774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6831","nonce":680009774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6829","nonce":680009774}]},"public_addr":"172.21.15.130:6825/680009774","cluster_addr":"172.21.15.130:6827/680009774","heartbeat_back_addr":"172.21.15.130:6831/680009774","heartbeat_front_addr":"172.21.15.130:6829/680009774","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.505543+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.394383+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.456652+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.529168+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.235414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.392158+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.347556+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.432039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:00:21.248 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.243+0000 7f0466d26640 1 -- 172.21.15.62:0/3190922307 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f044c066470 msgr2=0x7f044c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:21.248 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.243+0000 7f0466d26640 1 --2- 172.21.15.62:0/3190922307 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f044c066470 0x7f044c068930 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f04500af000 tx=0x7f045001b040 comp rx=0 tx=0).stop 2023-10-08T12:00:21.248 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.243+0000 7f0466d26640 1 -- 172.21.15.62:0/3190922307 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f04600b8570 msgr2=0x7f0460070830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:21.248 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.243+0000 7f0466d26640 1 --2- 172.21.15.62:0/3190922307 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f04600b8570 0x7f0460070830 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f045800d660 tx=0x7f045800db20 comp rx=0 tx=0).stop 2023-10-08T12:00:21.248 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.243+0000 7f0466d26640 1 -- 172.21.15.62:0/3190922307 shutdown_connections 2023-10-08T12:00:21.248 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.243+0000 7f0466d26640 1 --2- 172.21.15.62:0/3190922307 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f044c066470 0x7f044c068930 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:21.249 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.243+0000 7f0466d26640 1 --2- 172.21.15.62:0/3190922307 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f04600b6a60 0x7f04600702f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:21.249 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.243+0000 7f0466d26640 1 --2- 172.21.15.62:0/3190922307 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f04600b8570 0x7f0460070830 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:21.249 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.243+0000 7f0466d26640 1 --2- 172.21.15.62:0/3190922307 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f04600718c0 0x7f046013c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:21.249 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.243+0000 7f0466d26640 1 -- 172.21.15.62:0/3190922307 >> 172.21.15.62:0/3190922307 conn(0x7f046009c520 msgr2=0x7f0460097a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:21.249 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.243+0000 7f0466d26640 1 -- 172.21.15.62:0/3190922307 shutdown_connections 2023-10-08T12:00:21.249 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.243+0000 7f0466d26640 1 -- 172.21.15.62:0/3190922307 wait complete. 2023-10-08T12:00:21.265 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-08T12:00:21.394 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.391+0000 7fc82d881640 1 -- 172.21.15.62:0/991482571 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc810004d10 msgr2=0x7fc810005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:21.394 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.391+0000 7fc82d881640 1 --2- 172.21.15.62:0/991482571 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc810004d10 0x7fc810005190 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc820009eb0 tx=0x7fc82001d590 comp rx=0 tx=0).stop 2023-10-08T12:00:21.394 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.391+0000 7fc8277fe640 1 -- 172.21.15.62:0/991482571 reap_dead start 2023-10-08T12:00:21.394 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.391+0000 7fc82d881640 1 -- 172.21.15.62:0/991482571 shutdown_connections 2023-10-08T12:00:21.394 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.391+0000 7fc82d881640 1 -- 172.21.15.62:0/991482571 >> 172.21.15.62:0/991482571 conn(0x7fc82809c520 msgr2=0x7fc82809c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:21.394 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.391+0000 7fc82d881640 1 -- 172.21.15.62:0/991482571 shutdown_connections 2023-10-08T12:00:21.395 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.391+0000 7fc82d881640 1 -- 172.21.15.62:0/991482571 wait complete. 2023-10-08T12:00:21.396 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.391+0000 7fc82d881640 1 Processor -- start 2023-10-08T12:00:21.396 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.391+0000 7fc82d881640 1 -- start start 2023-10-08T12:00:21.396 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.391+0000 7fc82d881640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc82806fa90 0x7fc8281e0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:21.396 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.391+0000 7fc82d881640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc82814abf0 0x7fc828140c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:21.396 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.391+0000 7fc82d881640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc828141160 0x7fc8281dcfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:21.397 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.391+0000 7fc82d881640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc82809eed0 con 0x7fc828141160 2023-10-08T12:00:21.397 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.391+0000 7fc82d881640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8281e08f0 con 0x7fc82814abf0 2023-10-08T12:00:21.397 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.391+0000 7fc82d881640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8281e05c0 con 0x7fc82806fa90 2023-10-08T12:00:21.397 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.391+0000 7fc8277fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc828141160 0x7fc8281dcfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:21.397 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.391+0000 7fc8277fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc828141160 0x7fc8281dcfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:45078/0 (socket says 172.21.15.62:45078) 2023-10-08T12:00:21.397 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.391+0000 7fc8277fe640 1 -- 172.21.15.62:0/2147492809 learned_addr learned my addr 172.21.15.62:0/2147492809 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:21.397 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.391+0000 7fc8267fc640 1 --2- 172.21.15.62:0/2147492809 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc82814abf0 0x7fc828140c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:21.397 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.391+0000 7fc826ffd640 1 --2- 172.21.15.62:0/2147492809 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc82806fa90 0x7fc8281e0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:21.397 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.391+0000 7fc8277fe640 1 -- 172.21.15.62:0/2147492809 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc82806fa90 msgr2=0x7fc8281e0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:21.397 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.391+0000 7fc8277fe640 1 --2- 172.21.15.62:0/2147492809 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc82806fa90 0x7fc8281e0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:21.397 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.391+0000 7fc8277fe640 1 -- 172.21.15.62:0/2147492809 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc82814abf0 msgr2=0x7fc828140c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:21.397 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.391+0000 7fc8277fe640 1 --2- 172.21.15.62:0/2147492809 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc82814abf0 0x7fc828140c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:21.398 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.391+0000 7fc8277fe640 1 -- 172.21.15.62:0/2147492809 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8280a07e0 con 0x7fc828141160 2023-10-08T12:00:21.398 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.391+0000 7fc8277fe640 1 --2- 172.21.15.62:0/2147492809 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc828141160 0x7fc8281dcfd0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc820009eb0 tx=0x7fc820005c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:21.399 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.391+0000 7fc80ffff640 1 -- 172.21.15.62:0/2147492809 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8200b6070 con 0x7fc828141160 2023-10-08T12:00:21.399 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.391+0000 7fc80ffff640 1 -- 172.21.15.62:0/2147492809 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc820009200 con 0x7fc828141160 2023-10-08T12:00:21.399 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.391+0000 7fc82d881640 1 -- 172.21.15.62:0/2147492809 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8280a0ac0 con 0x7fc828141160 2023-10-08T12:00:21.399 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.391+0000 7fc80ffff640 1 -- 172.21.15.62:0/2147492809 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8200a9c00 con 0x7fc828141160 2023-10-08T12:00:21.399 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.391+0000 7fc82d881640 1 -- 172.21.15.62:0/2147492809 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc828070380 con 0x7fc828141160 2023-10-08T12:00:21.399 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.395+0000 7fc82d881640 1 -- 172.21.15.62:0/2147492809 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8280b5be0 con 0x7fc828141160 2023-10-08T12:00:21.399 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.395+0000 7fc80ffff640 1 -- 172.21.15.62:0/2147492809 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc8200a7040 con 0x7fc828141160 2023-10-08T12:00:21.399 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.395+0000 7fc80ffff640 1 --2- 172.21.15.62:0/2147492809 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fc814066470 0x7fc814068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:21.400 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.395+0000 7fc80ffff640 1 -- 172.21.15.62:0/2147492809 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc82011ee30 con 0x7fc828141160 2023-10-08T12:00:21.400 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.395+0000 7fc826ffd640 1 --2- 172.21.15.62:0/2147492809 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fc814066470 0x7fc814068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:21.400 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.395+0000 7fc826ffd640 1 --2- 172.21.15.62:0/2147492809 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fc814066470 0x7fc814068930 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc8180065b0 tx=0x7fc818006af0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:21.403 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.399+0000 7fc80ffff640 1 -- 172.21.15.62:0/2147492809 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc8200ec220 con 0x7fc828141160 2023-10-08T12:00:21.596 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:21.591+0000 7fc82d881640 1 -- 172.21.15.62:0/2147492809 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc82804da80 con 0x7fc828141160 2023-10-08T12:00:22.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:22.603+0000 7fc80ffff640 1 -- 172.21.15.62:0/2147492809 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc8200c0070 con 0x7fc828141160 2023-10-08T12:00:22.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:22.607+0000 7fc82d881640 1 -- 172.21.15.62:0/2147492809 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fc814066470 msgr2=0x7fc814068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:22.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:22.607+0000 7fc82d881640 1 --2- 172.21.15.62:0/2147492809 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fc814066470 0x7fc814068930 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc8180065b0 tx=0x7fc818006af0 comp rx=0 tx=0).stop 2023-10-08T12:00:22.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:22.607+0000 7fc82d881640 1 -- 172.21.15.62:0/2147492809 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc828141160 msgr2=0x7fc8281dcfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:22.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:22.607+0000 7fc82d881640 1 --2- 172.21.15.62:0/2147492809 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc828141160 0x7fc8281dcfd0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc820009eb0 tx=0x7fc820005c60 comp rx=0 tx=0).stop 2023-10-08T12:00:22.613 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:22.607+0000 7fc82d881640 1 -- 172.21.15.62:0/2147492809 shutdown_connections 2023-10-08T12:00:22.613 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:22.607+0000 7fc82d881640 1 --2- 172.21.15.62:0/2147492809 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fc814066470 0x7fc814068930 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:22.613 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:22.607+0000 7fc82d881640 1 --2- 172.21.15.62:0/2147492809 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc828141160 0x7fc8281dcfd0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:22.613 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:22.607+0000 7fc82d881640 1 --2- 172.21.15.62:0/2147492809 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc82814abf0 0x7fc828140c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:22.613 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:22.607+0000 7fc82d881640 1 --2- 172.21.15.62:0/2147492809 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc82806fa90 0x7fc8281e0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:22.613 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:22.607+0000 7fc82d881640 1 -- 172.21.15.62:0/2147492809 >> 172.21.15.62:0/2147492809 conn(0x7fc82809c520 msgr2=0x7fc82809b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:22.613 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:22.607+0000 7fc82d881640 1 -- 172.21.15.62:0/2147492809 shutdown_connections 2023-10-08T12:00:22.613 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:22.607+0000 7fc82d881640 1 -- 172.21.15.62:0/2147492809 wait complete. 2023-10-08T12:00:22.634 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-10-08T12:00:22.634 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-08T12:00:22.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:22.759+0000 7f3ad3fcd640 1 -- 172.21.15.62:0/1949155011 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3acc147920 msgr2=0x7f3acc0b6ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:22.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:22.759+0000 7f3ad3fcd640 1 --2- 172.21.15.62:0/1949155011 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3acc147920 0x7f3acc0b6ad0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3ac8009900 tx=0x7f3ac801c8c0 comp rx=0 tx=0).stop 2023-10-08T12:00:22.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:22.759+0000 7f3ad3fcd640 1 -- 172.21.15.62:0/1949155011 shutdown_connections 2023-10-08T12:00:22.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:22.759+0000 7f3ad3fcd640 1 --2- 172.21.15.62:0/1949155011 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3acc147920 0x7f3acc0b6ad0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:22.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:22.759+0000 7f3ad3fcd640 1 --2- 172.21.15.62:0/1949155011 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3acc0b9260 0x7f3acc0b8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:22.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:22.759+0000 7f3ad3fcd640 1 -- 172.21.15.62:0/1949155011 >> 172.21.15.62:0/1949155011 conn(0x7f3acc09c520 msgr2=0x7f3acc09c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:22.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:22.759+0000 7f3ad3fcd640 1 -- 172.21.15.62:0/1949155011 shutdown_connections 2023-10-08T12:00:22.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:22.759+0000 7f3ad3fcd640 1 -- 172.21.15.62:0/1949155011 wait complete. 2023-10-08T12:00:22.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:22.759+0000 7f3ad3fcd640 1 Processor -- start 2023-10-08T12:00:22.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:22.759+0000 7f3ad3fcd640 1 -- start start 2023-10-08T12:00:22.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:22.759+0000 7f3ad3fcd640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3acc071410 0x7f3acc1e3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:22.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:22.759+0000 7f3ad3fcd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3acc0b9260 0x7f3acc09dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:22.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:22.759+0000 7f3ad3fcd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3acc147920 0x7f3acc1e5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:22.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:22.759+0000 7f3ad3fcd640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3acc099240 con 0x7f3acc147920 2023-10-08T12:00:22.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:22.759+0000 7f3ad3fcd640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3acc0a02a0 con 0x7f3acc0b9260 2023-10-08T12:00:22.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:22.759+0000 7f3ad3fcd640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3acc098bf0 con 0x7f3acc071410 2023-10-08T12:00:22.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:22.759+0000 7f3ad256a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3acc147920 0x7f3acc1e5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:22.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:22.759+0000 7f3ad256a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3acc147920 0x7f3acc1e5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:45098/0 (socket says 172.21.15.62:45098) 2023-10-08T12:00:22.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:22.759+0000 7f3ad256a640 1 -- 172.21.15.62:0/3400557304 learned_addr learned my addr 172.21.15.62:0/3400557304 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:22.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:22.759+0000 7f3ad1d69640 1 --2- 172.21.15.62:0/3400557304 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3acc071410 0x7f3acc1e3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:22.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:22.759+0000 7f3ad1568640 1 --2- 172.21.15.62:0/3400557304 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3acc0b9260 0x7f3acc09dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:22.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:22.759+0000 7f3ad256a640 1 -- 172.21.15.62:0/3400557304 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3acc071410 msgr2=0x7f3acc1e3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:22.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:22.759+0000 7f3ad256a640 1 --2- 172.21.15.62:0/3400557304 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3acc071410 0x7f3acc1e3710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:22.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:22.759+0000 7f3ad256a640 1 -- 172.21.15.62:0/3400557304 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3acc0b9260 msgr2=0x7f3acc09dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:22.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:22.759+0000 7f3ad256a640 1 --2- 172.21.15.62:0/3400557304 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3acc0b9260 0x7f3acc09dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:22.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:22.759+0000 7f3ad256a640 1 -- 172.21.15.62:0/3400557304 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ac8009560 con 0x7f3acc147920 2023-10-08T12:00:22.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:22.759+0000 7f3ad1568640 1 --2- 172.21.15.62:0/3400557304 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3acc0b9260 0x7f3acc09dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:00:22.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:22.759+0000 7f3ad256a640 1 --2- 172.21.15.62:0/3400557304 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3acc147920 0x7f3acc1e5810 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3ac400c770 tx=0x7f3ac400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:22.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:22.759+0000 7f3ac27fc640 1 -- 172.21.15.62:0/3400557304 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac4003b80 con 0x7f3acc147920 2023-10-08T12:00:22.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:22.759+0000 7f3ac27fc640 1 -- 172.21.15.62:0/3400557304 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3ac4003ce0 con 0x7f3acc147920 2023-10-08T12:00:22.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:22.759+0000 7f3ad3fcd640 1 -- 172.21.15.62:0/3400557304 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3acc098ed0 con 0x7f3acc147920 2023-10-08T12:00:22.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:22.759+0000 7f3ac27fc640 1 -- 172.21.15.62:0/3400557304 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac400aab0 con 0x7f3acc147920 2023-10-08T12:00:22.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:22.763+0000 7f3ad3fcd640 1 -- 172.21.15.62:0/3400557304 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3acc09ef70 con 0x7f3acc147920 2023-10-08T12:00:22.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:22.763+0000 7f3ad3fcd640 1 -- 172.21.15.62:0/3400557304 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3acc0b5be0 con 0x7f3acc147920 2023-10-08T12:00:22.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:22.763+0000 7f3ac27fc640 1 -- 172.21.15.62:0/3400557304 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3ac400ac10 con 0x7f3acc147920 2023-10-08T12:00:22.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:22.763+0000 7f3ac27fc640 1 --2- 172.21.15.62:0/3400557304 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f3ab0066470 0x7f3ab0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:22.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:22.763+0000 7f3ac27fc640 1 -- 172.21.15.62:0/3400557304 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3ac4083e80 con 0x7f3acc147920 2023-10-08T12:00:22.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:22.763+0000 7f3ad1d69640 1 --2- 172.21.15.62:0/3400557304 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f3ab0066470 0x7f3ab0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:22.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:22.763+0000 7f3ad1d69640 1 --2- 172.21.15.62:0/3400557304 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f3ab0066470 0x7f3ab0068930 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3abc0058d0 tx=0x7f3abc005860 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:22.772 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:22.767+0000 7f3ac27fc640 1 -- 172.21.15.62:0/3400557304 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3ac40512f0 con 0x7f3acc147920 2023-10-08T12:00:22.956 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:22.951+0000 7f3ad3fcd640 1 -- 172.21.15.62:0/3400557304 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f3acc0993f0 con 0x7f3acc147920 2023-10-08T12:00:23.619 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:23.615+0000 7f3ac27fc640 1 -- 172.21.15.62:0/3400557304 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3ac4054910 con 0x7f3acc147920 2023-10-08T12:00:23.623 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:23.619+0000 7f3ad3fcd640 1 -- 172.21.15.62:0/3400557304 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f3ab0066470 msgr2=0x7f3ab0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:23.623 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:23.619+0000 7f3ad3fcd640 1 --2- 172.21.15.62:0/3400557304 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f3ab0066470 0x7f3ab0068930 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3abc0058d0 tx=0x7f3abc005860 comp rx=0 tx=0).stop 2023-10-08T12:00:23.623 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:23.619+0000 7f3ad3fcd640 1 -- 172.21.15.62:0/3400557304 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3acc147920 msgr2=0x7f3acc1e5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:23.623 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:23.619+0000 7f3ad3fcd640 1 --2- 172.21.15.62:0/3400557304 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3acc147920 0x7f3acc1e5810 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3ac400c770 tx=0x7f3ac400cc30 comp rx=0 tx=0).stop 2023-10-08T12:00:23.623 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:23.619+0000 7f3ad3fcd640 1 -- 172.21.15.62:0/3400557304 shutdown_connections 2023-10-08T12:00:23.623 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:23.619+0000 7f3ad3fcd640 1 --2- 172.21.15.62:0/3400557304 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f3ab0066470 0x7f3ab0068930 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:23.623 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:23.619+0000 7f3ad3fcd640 1 --2- 172.21.15.62:0/3400557304 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3acc147920 0x7f3acc1e5810 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:23.623 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:23.619+0000 7f3ad3fcd640 1 --2- 172.21.15.62:0/3400557304 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3acc0b9260 0x7f3acc09dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:23.623 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:23.619+0000 7f3ad3fcd640 1 --2- 172.21.15.62:0/3400557304 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3acc071410 0x7f3acc1e3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:23.623 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:23.619+0000 7f3ad3fcd640 1 -- 172.21.15.62:0/3400557304 >> 172.21.15.62:0/3400557304 conn(0x7f3acc09c520 msgr2=0x7f3acc06a930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:23.624 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:23.619+0000 7f3ad3fcd640 1 -- 172.21.15.62:0/3400557304 shutdown_connections 2023-10-08T12:00:23.624 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:23.619+0000 7f3ad3fcd640 1 -- 172.21.15.62:0/3400557304 wait complete. 2023-10-08T12:00:23.641 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-08T12:00:23.641 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:00:23.770 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:23.763+0000 7f5e439a0640 1 -- 172.21.15.62:0/2536792515 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5e3c0ba6e0 msgr2=0x7f5e3c069790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:23.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:23.763+0000 7f5e439a0640 1 --2- 172.21.15.62:0/2536792515 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5e3c0ba6e0 0x7f5e3c069790 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c009840 tx=0x7f5e2c01efb0 comp rx=0 tx=0).stop 2023-10-08T12:00:23.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:23.763+0000 7f5e439a0640 1 -- 172.21.15.62:0/2536792515 shutdown_connections 2023-10-08T12:00:23.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:23.763+0000 7f5e439a0640 1 --2- 172.21.15.62:0/2536792515 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5e3c0ba6e0 0x7f5e3c069790 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:23.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:23.763+0000 7f5e439a0640 1 -- 172.21.15.62:0/2536792515 >> 172.21.15.62:0/2536792515 conn(0x7f5e3c0beac0 msgr2=0x7f5e3c0beed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:23.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:23.763+0000 7f5e439a0640 1 -- 172.21.15.62:0/2536792515 shutdown_connections 2023-10-08T12:00:23.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:23.763+0000 7f5e439a0640 1 -- 172.21.15.62:0/2536792515 wait complete. 2023-10-08T12:00:23.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:23.767+0000 7f5e439a0640 1 Processor -- start 2023-10-08T12:00:23.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:23.767+0000 7f5e439a0640 1 -- start start 2023-10-08T12:00:23.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:23.767+0000 7f5e439a0640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5e3c069cd0 0x7f5e3c1440c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:23.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:23.767+0000 7f5e439a0640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5e3c143490 0x7f5e3c13ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:23.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:23.767+0000 7f5e439a0640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5e3c137870 0x7f5e3c137d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:23.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:23.767+0000 7f5e439a0640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3c144960 con 0x7f5e3c137870 2023-10-08T12:00:23.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:23.767+0000 7f5e439a0640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3c144600 con 0x7f5e3c069cd0 2023-10-08T12:00:23.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:23.767+0000 7f5e439a0640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3c13b3a0 con 0x7f5e3c143490 2023-10-08T12:00:23.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:23.767+0000 7f5e41f3d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5e3c137870 0x7f5e3c137d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:23.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:23.767+0000 7f5e41f3d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5e3c137870 0x7f5e3c137d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:45124/0 (socket says 172.21.15.62:45124) 2023-10-08T12:00:23.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:23.767+0000 7f5e41f3d640 1 -- 172.21.15.62:0/3234361929 learned_addr learned my addr 172.21.15.62:0/3234361929 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:23.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:23.767+0000 7f5e40f3b640 1 --2- 172.21.15.62:0/3234361929 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5e3c143490 0x7f5e3c13ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:23.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:23.767+0000 7f5e4173c640 1 --2- 172.21.15.62:0/3234361929 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5e3c069cd0 0x7f5e3c1440c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:23.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:23.767+0000 7f5e41f3d640 1 -- 172.21.15.62:0/3234361929 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5e3c143490 msgr2=0x7f5e3c13ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:23.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:23.767+0000 7f5e41f3d640 1 --2- 172.21.15.62:0/3234361929 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5e3c143490 0x7f5e3c13ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:23.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:23.767+0000 7f5e41f3d640 1 -- 172.21.15.62:0/3234361929 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5e3c069cd0 msgr2=0x7f5e3c1440c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:23.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:23.767+0000 7f5e41f3d640 1 --2- 172.21.15.62:0/3234361929 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5e3c069cd0 0x7f5e3c1440c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:23.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:23.767+0000 7f5e41f3d640 1 -- 172.21.15.62:0/3234361929 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e2c0094a0 con 0x7f5e3c137870 2023-10-08T12:00:23.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:23.767+0000 7f5e41f3d640 1 --2- 172.21.15.62:0/3234361929 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5e3c137870 0x7f5e3c137d00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5e3400c450 tx=0x7f5e3400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:23.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:23.767+0000 7f5e31ffb640 1 -- 172.21.15.62:0/3234361929 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e340054e0 con 0x7f5e3c137870 2023-10-08T12:00:23.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:23.767+0000 7f5e31ffb640 1 -- 172.21.15.62:0/3234361929 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5e34003600 con 0x7f5e3c137870 2023-10-08T12:00:23.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:23.767+0000 7f5e31ffb640 1 -- 172.21.15.62:0/3234361929 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e34003a10 con 0x7f5e3c137870 2023-10-08T12:00:23.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:23.767+0000 7f5e439a0640 1 -- 172.21.15.62:0/3234361929 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e3c1459d0 con 0x7f5e3c137870 2023-10-08T12:00:23.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:23.767+0000 7f5e439a0640 1 -- 172.21.15.62:0/3234361929 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e3c145f50 con 0x7f5e3c137870 2023-10-08T12:00:23.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:23.767+0000 7f5e439a0640 1 -- 172.21.15.62:0/3234361929 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e3c066a30 con 0x7f5e3c137870 2023-10-08T12:00:23.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:23.771+0000 7f5e31ffb640 1 -- 172.21.15.62:0/3234361929 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f5e34003b70 con 0x7f5e3c137870 2023-10-08T12:00:23.776 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:23.771+0000 7f5e31ffb640 1 --2- 172.21.15.62:0/3234361929 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f5e200664a0 0x7f5e20068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:23.776 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:23.771+0000 7f5e31ffb640 1 -- 172.21.15.62:0/3234361929 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5e340834f0 con 0x7f5e3c137870 2023-10-08T12:00:23.776 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:23.771+0000 7f5e4173c640 1 --2- 172.21.15.62:0/3234361929 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f5e200664a0 0x7f5e20068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:23.776 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:23.771+0000 7f5e4173c640 1 --2- 172.21.15.62:0/3234361929 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f5e200664a0 0x7f5e20068960 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5e38009f20 tx=0x7f5e380094d0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:23.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:23.775+0000 7f5e31ffb640 1 -- 172.21.15.62:0/3234361929 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5e34050ac0 con 0x7f5e3c137870 2023-10-08T12:00:23.961 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:23.955+0000 7f5e439a0640 1 -- 172.21.15.62:0/3234361929 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5e3c0bdaa0 con 0x7f5e3c137870 2023-10-08T12:00:23.962 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:23.959+0000 7f5e31ffb640 1 -- 172.21.15.62:0/3234361929 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4120 (secure 0 0 0) 0x7f5e34017090 con 0x7f5e3c137870 2023-10-08T12:00:23.962 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T12:00:23.963 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4334,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/2629778704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":2629778704},{"type":"v1","addr":"172.21.15.130:6835","nonce":2629778704}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4359,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/2134446062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":2134446062},{"type":"v1","addr":"172.21.15.62:6835","nonce":2134446062}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T12:00:19.866714+0000","modified":"2023-10-08T12:00:22.958677+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4362},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4362":{"gid":4362,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6834/2629384568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":2629384568},{"type":"v1","addr":"172.21.15.62:6834","nonce":2629384568}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:00:23.963 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 8 2023-10-08T12:00:23.964 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:23.959+0000 7f5e439a0640 1 -- 172.21.15.62:0/3234361929 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f5e200664a0 msgr2=0x7f5e20068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:23.964 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:23.959+0000 7f5e439a0640 1 --2- 172.21.15.62:0/3234361929 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f5e200664a0 0x7f5e20068960 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5e38009f20 tx=0x7f5e380094d0 comp rx=0 tx=0).stop 2023-10-08T12:00:23.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:23.959+0000 7f5e439a0640 1 -- 172.21.15.62:0/3234361929 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5e3c137870 msgr2=0x7f5e3c137d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:23.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:23.959+0000 7f5e439a0640 1 --2- 172.21.15.62:0/3234361929 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5e3c137870 0x7f5e3c137d00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5e3400c450 tx=0x7f5e3400c910 comp rx=0 tx=0).stop 2023-10-08T12:00:23.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:23.959+0000 7f5e439a0640 1 -- 172.21.15.62:0/3234361929 shutdown_connections 2023-10-08T12:00:23.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:23.959+0000 7f5e439a0640 1 --2- 172.21.15.62:0/3234361929 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f5e200664a0 0x7f5e20068960 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:23.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:23.959+0000 7f5e439a0640 1 --2- 172.21.15.62:0/3234361929 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5e3c143490 0x7f5e3c13ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:23.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:23.959+0000 7f5e439a0640 1 --2- 172.21.15.62:0/3234361929 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5e3c137870 0x7f5e3c137d00 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:23.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:23.959+0000 7f5e439a0640 1 --2- 172.21.15.62:0/3234361929 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5e3c069cd0 0x7f5e3c1440c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:23.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:23.959+0000 7f5e439a0640 1 -- 172.21.15.62:0/3234361929 >> 172.21.15.62:0/3234361929 conn(0x7f5e3c0beac0 msgr2=0x7f5e3c13f960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:23.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:23.959+0000 7f5e439a0640 1 -- 172.21.15.62:0/3234361929 shutdown_connections 2023-10-08T12:00:23.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:23.959+0000 7f5e439a0640 1 -- 172.21.15.62:0/3234361929 wait complete. 2023-10-08T12:00:23.980 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:00:24.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.099+0000 7f8da09d2640 1 -- 172.21.15.62:0/49122751 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d9c0b8570 msgr2=0x7f8d9c0b8a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:24.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.099+0000 7f8da09d2640 1 --2- 172.21.15.62:0/49122751 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d9c0b8570 0x7f8d9c0b8a00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c009840 tx=0x7f8d8c01c7c0 comp rx=0 tx=0).stop 2023-10-08T12:00:24.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.099+0000 7f8da09d2640 1 -- 172.21.15.62:0/49122751 shutdown_connections 2023-10-08T12:00:24.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.099+0000 7f8da09d2640 1 --2- 172.21.15.62:0/49122751 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d9c0b8570 0x7f8d9c0b8a00 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:24.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.099+0000 7f8da09d2640 1 -- 172.21.15.62:0/49122751 >> 172.21.15.62:0/49122751 conn(0x7f8d9c09c520 msgr2=0x7f8d9c09c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:24.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.099+0000 7f8da09d2640 1 -- 172.21.15.62:0/49122751 shutdown_connections 2023-10-08T12:00:24.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.099+0000 7f8da09d2640 1 -- 172.21.15.62:0/49122751 wait complete. 2023-10-08T12:00:24.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.103+0000 7f8da09d2640 1 Processor -- start 2023-10-08T12:00:24.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.103+0000 7f8da09d2640 1 -- start start 2023-10-08T12:00:24.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.103+0000 7f8da09d2640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8d9c0718c0 0x7f8d9c13f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:24.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.103+0000 7f8da09d2640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8d9c0b5170 0x7f8d9c143cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:24.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.103+0000 7f8da09d2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d9c0b8570 0x7f8d9c1e4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:24.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.103+0000 7f8da09d2640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9c13fce0 con 0x7f8d9c0b8570 2023-10-08T12:00:24.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.103+0000 7f8da09d2640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9c1403f0 con 0x7f8d9c0718c0 2023-10-08T12:00:24.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.103+0000 7f8da09d2640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9c1421e0 con 0x7f8d9c0b5170 2023-10-08T12:00:24.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.103+0000 7f8d9ad9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d9c0b8570 0x7f8d9c1e4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:24.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.103+0000 7f8d9ad9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d9c0b8570 0x7f8d9c1e4220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:45146/0 (socket says 172.21.15.62:45146) 2023-10-08T12:00:24.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.103+0000 7f8d9ad9d640 1 -- 172.21.15.62:0/3259852011 learned_addr learned my addr 172.21.15.62:0/3259852011 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:24.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.103+0000 7f8d9a59c640 1 --2- 172.21.15.62:0/3259852011 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8d9c0718c0 0x7f8d9c13f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:24.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.103+0000 7f8d9ad9d640 1 -- 172.21.15.62:0/3259852011 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8d9c0b5170 msgr2=0x7f8d9c143cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:24.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.103+0000 7f8d9ad9d640 1 --2- 172.21.15.62:0/3259852011 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8d9c0b5170 0x7f8d9c143cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:24.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.103+0000 7f8d9ad9d640 1 -- 172.21.15.62:0/3259852011 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8d9c0718c0 msgr2=0x7f8d9c13f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:24.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.103+0000 7f8d9ad9d640 1 --2- 172.21.15.62:0/3259852011 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8d9c0718c0 0x7f8d9c13f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:24.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.103+0000 7f8d9ad9d640 1 -- 172.21.15.62:0/3259852011 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d8c0094a0 con 0x7f8d9c0b8570 2023-10-08T12:00:24.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.103+0000 7f8d9a59c640 1 --2- 172.21.15.62:0/3259852011 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8d9c0718c0 0x7f8d9c13f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:00:24.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.103+0000 7f8d9ad9d640 1 --2- 172.21.15.62:0/3259852011 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d9c0b8570 0x7f8d9c1e4220 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c0982b0 tx=0x7f8d8c0a5770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:24.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.103+0000 7f8d92ffd640 1 -- 172.21.15.62:0/3259852011 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d8c0042f0 con 0x7f8d9c0b8570 2023-10-08T12:00:24.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.103+0000 7f8d92ffd640 1 -- 172.21.15.62:0/3259852011 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8d8c0050c0 con 0x7f8d9c0b8570 2023-10-08T12:00:24.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.103+0000 7f8da09d2640 1 -- 172.21.15.62:0/3259852011 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d9c141f00 con 0x7f8d9c0b8570 2023-10-08T12:00:24.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.103+0000 7f8d92ffd640 1 -- 172.21.15.62:0/3259852011 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d8c005430 con 0x7f8d9c0b8570 2023-10-08T12:00:24.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.103+0000 7f8da09d2640 1 -- 172.21.15.62:0/3259852011 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d9c13c9b0 con 0x7f8d9c0b8570 2023-10-08T12:00:24.110 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.103+0000 7f8da09d2640 1 -- 172.21.15.62:0/3259852011 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d9c04da80 con 0x7f8d9c0b8570 2023-10-08T12:00:24.110 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.103+0000 7f8d92ffd640 1 -- 172.21.15.62:0/3259852011 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8d8c0046d0 con 0x7f8d9c0b8570 2023-10-08T12:00:24.110 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.103+0000 7f8d92ffd640 1 --2- 172.21.15.62:0/3259852011 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f8d7c066470 0x7f8d7c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:24.110 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.103+0000 7f8d92ffd640 1 -- 172.21.15.62:0/3259852011 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8d8c11eb40 con 0x7f8d9c0b8570 2023-10-08T12:00:24.110 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.103+0000 7f8d9a59c640 1 --2- 172.21.15.62:0/3259852011 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f8d7c066470 0x7f8d7c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:24.111 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.107+0000 7f8d9a59c640 1 --2- 172.21.15.62:0/3259852011 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f8d7c066470 0x7f8d7c068930 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8d94000f70 tx=0x7f8d94009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:24.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.107+0000 7f8d92ffd640 1 -- 172.21.15.62:0/3259852011 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8d8c0ebfd0 con 0x7f8d9c0b8570 2023-10-08T12:00:24.267 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.263+0000 7f8da09d2640 1 -- 172.21.15.62:0/3259852011 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8d9c04da80 con 0x7f8d9c0b8570 2023-10-08T12:00:24.268 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.263+0000 7f8d92ffd640 1 -- 172.21.15.62:0/3259852011 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16481 (secure 0 0 0) 0x7f8d8c0b2090 con 0x7f8d9c0b8570 2023-10-08T12:00:24.268 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T12:00:24.269 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":20,"fsid":"3e777930-c2c1-4f2b-a903-c07ee4ca2c52","created":"2023-10-08T11:59:54.510229+0000","modified":"2023-10-08T12:00:21.580704+0000","last_up_change":"2023-10-08T12:00:06.783998+0000","last_in_change":"2023-10-08T11:59:57.847944+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:00:07.189433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:00:17.895548+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T12:00:18.871217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7bc3070a-7240-43d9-9ec3-397b68a37e2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6820","nonce":2227876905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6824","nonce":2227876905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6831","nonce":2227876905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6828","nonce":2227876905}]},"public_addr":"172.21.15.62:6820/2227876905","cluster_addr":"172.21.15.62:6824/2227876905","heartbeat_back_addr":"172.21.15.62:6831/2227876905","heartbeat_front_addr":"172.21.15.62:6828/2227876905","state":["exists","up"]},{"osd":1,"uuid":"5e0fa1f5-9ddc-4882-b460-5578bb571003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6801","nonce":315660906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6803","nonce":315660906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6808","nonce":315660906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6805","nonce":315660906}]},"public_addr":"172.21.15.62:6801/315660906","cluster_addr":"172.21.15.62:6803/315660906","heartbeat_back_addr":"172.21.15.62:6808/315660906","heartbeat_front_addr":"172.21.15.62:6805/315660906","state":["exists","up"]},{"osd":2,"uuid":"262b5ee9-4243-4309-a14f-88ad4e8bf812","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6807","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6809","nonce":3784842938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6811","nonce":3784842938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6815","nonce":3784842938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6813","nonce":3784842938}]},"public_addr":"172.21.15.62:6809/3784842938","cluster_addr":"172.21.15.62:6811/3784842938","heartbeat_back_addr":"172.21.15.62:6815/3784842938","heartbeat_front_addr":"172.21.15.62:6813/3784842938","state":["exists","up"]},{"osd":3,"uuid":"1770bdb8-c12b-43b1-aaab-1d6b6fd18f4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6817","nonce":3385303160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6821","nonce":3385303160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6827","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6829","nonce":3385303160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6823","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6825","nonce":3385303160}]},"public_addr":"172.21.15.62:6817/3385303160","cluster_addr":"172.21.15.62:6821/3385303160","heartbeat_back_addr":"172.21.15.62:6829/3385303160","heartbeat_front_addr":"172.21.15.62:6825/3385303160","state":["exists","up"]},{"osd":4,"uuid":"74c73631-9351-494a-8246-28ee86e9f862","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6807","nonce":1174056987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6809","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6811","nonce":1174056987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6820","nonce":1174056987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6813","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6816","nonce":1174056987}]},"public_addr":"172.21.15.130:6807/1174056987","cluster_addr":"172.21.15.130:6811/1174056987","heartbeat_back_addr":"172.21.15.130:6820/1174056987","heartbeat_front_addr":"172.21.15.130:6816/1174056987","state":["exists","up"]},{"osd":5,"uuid":"1040f389-272c-41d6-ae76-70c04d09afa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6801","nonce":561928414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6803","nonce":561928414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6815","nonce":561928414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6808","nonce":561928414}]},"public_addr":"172.21.15.130:6801/561928414","cluster_addr":"172.21.15.130:6803/561928414","heartbeat_back_addr":"172.21.15.130:6815/561928414","heartbeat_front_addr":"172.21.15.130:6808/561928414","state":["exists","up"]},{"osd":6,"uuid":"178553eb-03e1-4ab8-9826-4f5997e6da0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6810","nonce":2877303015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6817","nonce":2877303015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6823","nonce":2877303015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6819","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6821","nonce":2877303015}]},"public_addr":"172.21.15.130:6810/2877303015","cluster_addr":"172.21.15.130:6817/2877303015","heartbeat_back_addr":"172.21.15.130:6823/2877303015","heartbeat_front_addr":"172.21.15.130:6821/2877303015","state":["exists","up"]},{"osd":7,"uuid":"b6581c8f-30b1-4dfd-b7b6-94b579128835","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6825","nonce":680009774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6827","nonce":680009774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6831","nonce":680009774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6829","nonce":680009774}]},"public_addr":"172.21.15.130:6825/680009774","cluster_addr":"172.21.15.130:6827/680009774","heartbeat_back_addr":"172.21.15.130:6831/680009774","heartbeat_front_addr":"172.21.15.130:6829/680009774","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.505543+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.394383+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.456652+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.529168+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.235414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.392158+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.347556+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.432039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:00:24.271 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.267+0000 7f8da09d2640 1 -- 172.21.15.62:0/3259852011 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f8d7c066470 msgr2=0x7f8d7c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:24.271 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.267+0000 7f8da09d2640 1 --2- 172.21.15.62:0/3259852011 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f8d7c066470 0x7f8d7c068930 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8d94000f70 tx=0x7f8d94009040 comp rx=0 tx=0).stop 2023-10-08T12:00:24.272 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.267+0000 7f8da09d2640 1 -- 172.21.15.62:0/3259852011 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d9c0b8570 msgr2=0x7f8d9c1e4220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:24.272 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.267+0000 7f8da09d2640 1 --2- 172.21.15.62:0/3259852011 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d9c0b8570 0x7f8d9c1e4220 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c0982b0 tx=0x7f8d8c0a5770 comp rx=0 tx=0).stop 2023-10-08T12:00:24.272 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.267+0000 7f8da09d2640 1 -- 172.21.15.62:0/3259852011 shutdown_connections 2023-10-08T12:00:24.272 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.267+0000 7f8da09d2640 1 --2- 172.21.15.62:0/3259852011 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f8d7c066470 0x7f8d7c068930 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:24.272 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.267+0000 7f8da09d2640 1 --2- 172.21.15.62:0/3259852011 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8d9c0b5170 0x7f8d9c143cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:24.272 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.267+0000 7f8da09d2640 1 --2- 172.21.15.62:0/3259852011 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d9c0b8570 0x7f8d9c1e4220 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:24.273 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.267+0000 7f8da09d2640 1 --2- 172.21.15.62:0/3259852011 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8d9c0718c0 0x7f8d9c13f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:24.273 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.267+0000 7f8da09d2640 1 -- 172.21.15.62:0/3259852011 >> 172.21.15.62:0/3259852011 conn(0x7f8d9c09c520 msgr2=0x7f8d9c06a930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:24.273 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.267+0000 7f8da09d2640 1 -- 172.21.15.62:0/3259852011 shutdown_connections 2023-10-08T12:00:24.273 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.267+0000 7f8da09d2640 1 -- 172.21.15.62:0/3259852011 wait complete. 2023-10-08T12:00:24.287 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-08T12:00:24.288 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T12:00:24.418 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.415+0000 7fc76af90640 1 -- 172.21.15.62:0/100373775 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc74c003980 msgr2=0x7fc74c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:24.418 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.415+0000 7fc76af90640 1 --2- 172.21.15.62:0/100373775 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc74c003980 0x7fc74c003da0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc75400c5c0 tx=0x7fc75401d310 comp rx=0 tx=0).stop 2023-10-08T12:00:24.418 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.415+0000 7fc76af90640 1 -- 172.21.15.62:0/100373775 shutdown_connections 2023-10-08T12:00:24.418 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.415+0000 7fc76af90640 1 --2- 172.21.15.62:0/100373775 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc74c003980 0x7fc74c003da0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:24.419 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.415+0000 7fc76af90640 1 -- 172.21.15.62:0/100373775 >> 172.21.15.62:0/100373775 conn(0x7fc76409c520 msgr2=0x7fc76409c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:24.419 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.415+0000 7fc76af90640 1 -- 172.21.15.62:0/100373775 shutdown_connections 2023-10-08T12:00:24.419 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.415+0000 7fc76af90640 1 -- 172.21.15.62:0/100373775 wait complete. 2023-10-08T12:00:24.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.415+0000 7fc76af90640 1 Processor -- start 2023-10-08T12:00:24.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.415+0000 7fc76af90640 1 -- start start 2023-10-08T12:00:24.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.415+0000 7fc76af90640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc74c003980 0x7fc764146640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:24.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.415+0000 7fc76af90640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc76409feb0 0x7fc7641d2890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:24.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.415+0000 7fc76af90640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc76413fdb0 0x7fc764140260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:24.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.415+0000 7fc76af90640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7641e2be0 con 0x7fc76413fdb0 2023-10-08T12:00:24.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.415+0000 7fc76af90640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc76409f6d0 con 0x7fc76409feb0 2023-10-08T12:00:24.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.415+0000 7fc76af90640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7641d4670 con 0x7fc74c003980 2023-10-08T12:00:24.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.415+0000 7fc76952d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc76413fdb0 0x7fc764140260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:24.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.415+0000 7fc76952d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc76413fdb0 0x7fc764140260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:45150/0 (socket says 172.21.15.62:45150) 2023-10-08T12:00:24.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.415+0000 7fc76952d640 1 -- 172.21.15.62:0/2239296197 learned_addr learned my addr 172.21.15.62:0/2239296197 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:24.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.415+0000 7fc768d2c640 1 --2- 172.21.15.62:0/2239296197 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc74c003980 0x7fc764146640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:24.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.415+0000 7fc763fff640 1 --2- 172.21.15.62:0/2239296197 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc76409feb0 0x7fc7641d2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:24.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.415+0000 7fc76952d640 1 -- 172.21.15.62:0/2239296197 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc74c003980 msgr2=0x7fc764146640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:24.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.415+0000 7fc76952d640 1 --2- 172.21.15.62:0/2239296197 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc74c003980 0x7fc764146640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:24.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.415+0000 7fc76952d640 1 -- 172.21.15.62:0/2239296197 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc76409feb0 msgr2=0x7fc7641d2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:24.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.415+0000 7fc76952d640 1 --2- 172.21.15.62:0/2239296197 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc76409feb0 0x7fc7641d2890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:24.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.415+0000 7fc76952d640 1 -- 172.21.15.62:0/2239296197 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7641d4420 con 0x7fc76413fdb0 2023-10-08T12:00:24.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.415+0000 7fc763fff640 1 --2- 172.21.15.62:0/2239296197 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc76409feb0 0x7fc7641d2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:00:24.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.415+0000 7fc76952d640 1 --2- 172.21.15.62:0/2239296197 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc76413fdb0 0x7fc764140260 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc76414a400 tx=0x7fc75c00d9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:24.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.415+0000 7fc7617fa640 1 -- 172.21.15.62:0/2239296197 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc75c018070 con 0x7fc76413fdb0 2023-10-08T12:00:24.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.415+0000 7fc7617fa640 1 -- 172.21.15.62:0/2239296197 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc75c005130 con 0x7fc76413fdb0 2023-10-08T12:00:24.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.415+0000 7fc7617fa640 1 -- 172.21.15.62:0/2239296197 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc75c005540 con 0x7fc76413fdb0 2023-10-08T12:00:24.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.415+0000 7fc76af90640 1 -- 172.21.15.62:0/2239296197 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7641e2800 con 0x7fc76413fdb0 2023-10-08T12:00:24.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.415+0000 7fc76af90640 1 -- 172.21.15.62:0/2239296197 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc764146ea0 con 0x7fc76413fdb0 2023-10-08T12:00:24.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.419+0000 7fc76af90640 1 -- 172.21.15.62:0/2239296197 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7641d3e20 con 0x7fc76413fdb0 2023-10-08T12:00:24.424 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.419+0000 7fc7617fa640 1 -- 172.21.15.62:0/2239296197 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc75c0047b0 con 0x7fc76413fdb0 2023-10-08T12:00:24.424 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.419+0000 7fc7617fa640 1 --2- 172.21.15.62:0/2239296197 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fc7500664a0 0x7fc750068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:24.424 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.419+0000 7fc7617fa640 1 -- 172.21.15.62:0/2239296197 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc75c083830 con 0x7fc76413fdb0 2023-10-08T12:00:24.425 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.419+0000 7fc768d2c640 1 --2- 172.21.15.62:0/2239296197 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fc7500664a0 0x7fc750068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:24.425 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.419+0000 7fc768d2c640 1 --2- 172.21.15.62:0/2239296197 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fc7500664a0 0x7fc750068960 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc7540ac000 tx=0x7fc7540b1040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:24.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.423+0000 7fc7617fa640 1 -- 172.21.15.62:0/2239296197 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc7641d3e20 con 0x7fc76413fdb0 2023-10-08T12:00:24.484 INFO:tasks.ceph.mds.a.smithi062.stderr:2023-10-08T12:00:24.479+0000 7f34590cb640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T12:00:24.580 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.575+0000 7fc76af90640 1 -- 172.21.15.62:0/2239296197 --> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc7641e2d20 con 0x7fc7500664a0 2023-10-08T12:00:24.601 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.599+0000 7fc7617fa640 1 -- 172.21.15.62:0/2239296197 <== mgr.4111 v2:172.21.15.130:6832/826384843 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264579 (secure 0 0 0) 0x7fc7641e2d20 con 0x7fc7500664a0 2023-10-08T12:00:24.605 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T12:00:24.607 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2023-10-08T12:00:24.609 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.599+0000 7fc76af90640 1 -- 172.21.15.62:0/2239296197 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fc7500664a0 msgr2=0x7fc750068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:24.609 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.599+0000 7fc76af90640 1 --2- 172.21.15.62:0/2239296197 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fc7500664a0 0x7fc750068960 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc7540ac000 tx=0x7fc7540b1040 comp rx=0 tx=0).stop 2023-10-08T12:00:24.609 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.599+0000 7fc76af90640 1 -- 172.21.15.62:0/2239296197 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc76413fdb0 msgr2=0x7fc764140260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:24.609 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.599+0000 7fc76af90640 1 --2- 172.21.15.62:0/2239296197 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc76413fdb0 0x7fc764140260 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc76414a400 tx=0x7fc75c00d9a0 comp rx=0 tx=0).stop 2023-10-08T12:00:24.609 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.603+0000 7fc76af90640 1 -- 172.21.15.62:0/2239296197 shutdown_connections 2023-10-08T12:00:24.609 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.603+0000 7fc76af90640 1 --2- 172.21.15.62:0/2239296197 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fc7500664a0 0x7fc750068960 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:24.609 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.603+0000 7fc76af90640 1 --2- 172.21.15.62:0/2239296197 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc76413fdb0 0x7fc764140260 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:24.609 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.603+0000 7fc76af90640 1 --2- 172.21.15.62:0/2239296197 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc76409feb0 0x7fc7641d2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:24.610 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.603+0000 7fc76af90640 1 --2- 172.21.15.62:0/2239296197 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc74c003980 0x7fc764146640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:24.610 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.603+0000 7fc76af90640 1 -- 172.21.15.62:0/2239296197 >> 172.21.15.62:0/2239296197 conn(0x7fc76409c520 msgr2=0x7fc76409c900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:24.610 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.603+0000 7fc76af90640 1 -- 172.21.15.62:0/2239296197 shutdown_connections 2023-10-08T12:00:24.610 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.603+0000 7fc76af90640 1 -- 172.21.15.62:0/2239296197 wait complete. 2023-10-08T12:00:24.623 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-10-08T12:00:23.111496+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":185,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219020,"kb_used_data":2812,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755700,"statfs":{"total":773094113280,"available":772869836800,"internally_reserved":0,"allocated":2879488,"data_stored":1746440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":73,"apply_latency_ms":73,"commit_latency_ns":73000000,"apply_latency_ns":73000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.619248"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.632466+0000","last_change":"2023-10-08T12:00:20.627789+0000","last_active":"2023-10-08T12:00:21.632466+0000","last_peered":"2023-10-08T12:00:21.632466+0000","last_clean":"2023-10-08T12:00:21.632466+0000","last_became_active":"2023-10-08T12:00:20.624907+0000","last_became_peered":"2023-10-08T12:00:20.624907+0000","last_unstale":"2023-10-08T12:00:21.632466+0000","last_undegraded":"2023-10-08T12:00:21.632466+0000","last_fullsized":"2023-10-08T12:00:21.632466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:43:35.534698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.598994+0000","last_change":"2023-10-08T12:00:20.600909+0000","last_active":"2023-10-08T12:00:21.598994+0000","last_peered":"2023-10-08T12:00:21.598994+0000","last_clean":"2023-10-08T12:00:21.598994+0000","last_became_active":"2023-10-08T12:00:20.600498+0000","last_became_peered":"2023-10-08T12:00:20.600498+0000","last_unstale":"2023-10-08T12:00:21.598994+0000","last_undegraded":"2023-10-08T12:00:21.598994+0000","last_fullsized":"2023-10-08T12:00:21.598994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:54:07.447661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855469+0000","last_change":"2023-10-08T12:00:20.591739+0000","last_active":"2023-10-08T12:00:21.855469+0000","last_peered":"2023-10-08T12:00:21.855469+0000","last_clean":"2023-10-08T12:00:21.855469+0000","last_became_active":"2023-10-08T12:00:20.591277+0000","last_became_peered":"2023-10-08T12:00:20.591277+0000","last_unstale":"2023-10-08T12:00:21.855469+0000","last_undegraded":"2023-10-08T12:00:21.855469+0000","last_fullsized":"2023-10-08T12:00:21.855469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:54:25.498802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.602411+0000","last_change":"2023-10-08T12:00:20.595788+0000","last_active":"2023-10-08T12:00:21.602411+0000","last_peered":"2023-10-08T12:00:21.602411+0000","last_clean":"2023-10-08T12:00:21.602411+0000","last_became_active":"2023-10-08T12:00:20.595025+0000","last_became_peered":"2023-10-08T12:00:20.595025+0000","last_unstale":"2023-10-08T12:00:21.602411+0000","last_undegraded":"2023-10-08T12:00:21.602411+0000","last_fullsized":"2023-10-08T12:00:21.602411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:17:42.290460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.631819+0000","last_change":"2023-10-08T12:00:20.625363+0000","last_active":"2023-10-08T12:00:21.631819+0000","last_peered":"2023-10-08T12:00:21.631819+0000","last_clean":"2023-10-08T12:00:21.631819+0000","last_became_active":"2023-10-08T12:00:20.623270+0000","last_became_peered":"2023-10-08T12:00:20.623270+0000","last_unstale":"2023-10-08T12:00:21.631819+0000","last_undegraded":"2023-10-08T12:00:21.631819+0000","last_fullsized":"2023-10-08T12:00:21.631819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:53:47.853039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.602599+0000","last_change":"2023-10-08T12:00:20.600868+0000","last_active":"2023-10-08T12:00:21.602599+0000","last_peered":"2023-10-08T12:00:21.602599+0000","last_clean":"2023-10-08T12:00:21.602599+0000","last_became_active":"2023-10-08T12:00:20.600160+0000","last_became_peered":"2023-10-08T12:00:20.600160+0000","last_unstale":"2023-10-08T12:00:21.602599+0000","last_undegraded":"2023-10-08T12:00:21.602599+0000","last_fullsized":"2023-10-08T12:00:21.602599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:57:40.359987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.631537+0000","last_change":"2023-10-08T12:00:20.625181+0000","last_active":"2023-10-08T12:00:21.631537+0000","last_peered":"2023-10-08T12:00:21.631537+0000","last_clean":"2023-10-08T12:00:21.631537+0000","last_became_active":"2023-10-08T12:00:20.623344+0000","last_became_peered":"2023-10-08T12:00:20.623344+0000","last_unstale":"2023-10-08T12:00:21.631537+0000","last_undegraded":"2023-10-08T12:00:21.631537+0000","last_fullsized":"2023-10-08T12:00:21.631537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:17:42.290460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855227+0000","last_change":"2023-10-08T12:00:20.594960+0000","last_active":"2023-10-08T12:00:21.855227+0000","last_peered":"2023-10-08T12:00:21.855227+0000","last_clean":"2023-10-08T12:00:21.855227+0000","last_became_active":"2023-10-08T12:00:20.594580+0000","last_became_peered":"2023-10-08T12:00:20.594580+0000","last_unstale":"2023-10-08T12:00:21.855227+0000","last_undegraded":"2023-10-08T12:00:21.855227+0000","last_fullsized":"2023-10-08T12:00:21.855227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:10:09.509770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.632479+0000","last_change":"2023-10-08T12:00:20.625978+0000","last_active":"2023-10-08T12:00:21.632479+0000","last_peered":"2023-10-08T12:00:21.632479+0000","last_clean":"2023-10-08T12:00:21.632479+0000","last_became_active":"2023-10-08T12:00:20.624917+0000","last_became_peered":"2023-10-08T12:00:20.624917+0000","last_unstale":"2023-10-08T12:00:21.632479+0000","last_undegraded":"2023-10-08T12:00:21.632479+0000","last_fullsized":"2023-10-08T12:00:21.632479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:11:56.311548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855967+0000","last_change":"2023-10-08T12:00:20.613419+0000","last_active":"2023-10-08T12:00:21.855967+0000","last_peered":"2023-10-08T12:00:21.855967+0000","last_clean":"2023-10-08T12:00:21.855967+0000","last_became_active":"2023-10-08T12:00:20.612588+0000","last_became_peered":"2023-10-08T12:00:20.612588+0000","last_unstale":"2023-10-08T12:00:21.855967+0000","last_undegraded":"2023-10-08T12:00:21.855967+0000","last_fullsized":"2023-10-08T12:00:21.855967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:54:07.447661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855739+0000","last_change":"2023-10-08T12:00:20.614307+0000","last_active":"2023-10-08T12:00:21.855739+0000","last_peered":"2023-10-08T12:00:21.855739+0000","last_clean":"2023-10-08T12:00:21.855739+0000","last_became_active":"2023-10-08T12:00:20.613632+0000","last_became_peered":"2023-10-08T12:00:20.613632+0000","last_unstale":"2023-10-08T12:00:21.855739+0000","last_undegraded":"2023-10-08T12:00:21.855739+0000","last_fullsized":"2023-10-08T12:00:21.855739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:54:25.498802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.602167+0000","last_change":"2023-10-08T12:00:20.615632+0000","last_active":"2023-10-08T12:00:21.602167+0000","last_peered":"2023-10-08T12:00:21.602167+0000","last_clean":"2023-10-08T12:00:21.602167+0000","last_became_active":"2023-10-08T12:00:20.615011+0000","last_became_peered":"2023-10-08T12:00:20.615011+0000","last_unstale":"2023-10-08T12:00:21.602167+0000","last_undegraded":"2023-10-08T12:00:21.602167+0000","last_fullsized":"2023-10-08T12:00:21.602167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:03:28.440799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.856538+0000","last_change":"2023-10-08T12:00:20.621730+0000","last_active":"2023-10-08T12:00:21.856538+0000","last_peered":"2023-10-08T12:00:21.856538+0000","last_clean":"2023-10-08T12:00:21.856538+0000","last_became_active":"2023-10-08T12:00:20.621145+0000","last_became_peered":"2023-10-08T12:00:20.621145+0000","last_unstale":"2023-10-08T12:00:21.856538+0000","last_undegraded":"2023-10-08T12:00:21.856538+0000","last_fullsized":"2023-10-08T12:00:21.856538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:54:07.447661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.854760+0000","last_change":"2023-10-08T12:00:20.590571+0000","last_active":"2023-10-08T12:00:21.854760+0000","last_peered":"2023-10-08T12:00:21.854760+0000","last_clean":"2023-10-08T12:00:21.854760+0000","last_became_active":"2023-10-08T12:00:20.590216+0000","last_became_peered":"2023-10-08T12:00:20.590216+0000","last_unstale":"2023-10-08T12:00:21.854760+0000","last_undegraded":"2023-10-08T12:00:21.854760+0000","last_fullsized":"2023-10-08T12:00:21.854760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:58:37.629058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.598733+0000","last_change":"2023-10-08T12:00:20.609487+0000","last_active":"2023-10-08T12:00:21.598733+0000","last_peered":"2023-10-08T12:00:21.598733+0000","last_clean":"2023-10-08T12:00:21.598733+0000","last_became_active":"2023-10-08T12:00:20.609198+0000","last_became_peered":"2023-10-08T12:00:20.609198+0000","last_unstale":"2023-10-08T12:00:21.598733+0000","last_undegraded":"2023-10-08T12:00:21.598733+0000","last_fullsized":"2023-10-08T12:00:21.598733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:22:42.527070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.601660+0000","last_change":"2023-10-08T12:00:20.605444+0000","last_active":"2023-10-08T12:00:21.601660+0000","last_peered":"2023-10-08T12:00:21.601660+0000","last_clean":"2023-10-08T12:00:21.601660+0000","last_became_active":"2023-10-08T12:00:20.604696+0000","last_became_peered":"2023-10-08T12:00:20.604696+0000","last_unstale":"2023-10-08T12:00:21.601660+0000","last_undegraded":"2023-10-08T12:00:21.601660+0000","last_fullsized":"2023-10-08T12:00:21.601660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:46:22.522999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.604436+0000","last_change":"2023-10-08T12:00:20.626616+0000","last_active":"2023-10-08T12:00:21.604436+0000","last_peered":"2023-10-08T12:00:21.604436+0000","last_clean":"2023-10-08T12:00:21.604436+0000","last_became_active":"2023-10-08T12:00:20.626042+0000","last_became_peered":"2023-10-08T12:00:20.626042+0000","last_unstale":"2023-10-08T12:00:21.604436+0000","last_undegraded":"2023-10-08T12:00:21.604436+0000","last_fullsized":"2023-10-08T12:00:21.604436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:11:56.311548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.640507+0000","last_change":"2023-10-08T12:00:20.621413+0000","last_active":"2023-10-08T12:00:21.640507+0000","last_peered":"2023-10-08T12:00:21.640507+0000","last_clean":"2023-10-08T12:00:21.640507+0000","last_became_active":"2023-10-08T12:00:20.621169+0000","last_became_peered":"2023-10-08T12:00:20.621169+0000","last_unstale":"2023-10-08T12:00:21.640507+0000","last_undegraded":"2023-10-08T12:00:21.640507+0000","last_fullsized":"2023-10-08T12:00:21.640507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:03:28.440799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.632631+0000","last_change":"2023-10-08T12:00:20.627431+0000","last_active":"2023-10-08T12:00:21.632631+0000","last_peered":"2023-10-08T12:00:21.632631+0000","last_clean":"2023-10-08T12:00:21.632631+0000","last_became_active":"2023-10-08T12:00:20.624730+0000","last_became_peered":"2023-10-08T12:00:20.624730+0000","last_unstale":"2023-10-08T12:00:21.632631+0000","last_undegraded":"2023-10-08T12:00:21.632631+0000","last_fullsized":"2023-10-08T12:00:21.632631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:22:34.137787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855624+0000","last_change":"2023-10-08T12:00:20.620364+0000","last_active":"2023-10-08T12:00:21.855624+0000","last_peered":"2023-10-08T12:00:21.855624+0000","last_clean":"2023-10-08T12:00:21.855624+0000","last_became_active":"2023-10-08T12:00:20.619755+0000","last_became_peered":"2023-10-08T12:00:20.619755+0000","last_unstale":"2023-10-08T12:00:21.855624+0000","last_undegraded":"2023-10-08T12:00:21.855624+0000","last_fullsized":"2023-10-08T12:00:21.855624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:42:54.801760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855087+0000","last_change":"2023-10-08T12:00:20.623340+0000","last_active":"2023-10-08T12:00:21.855087+0000","last_peered":"2023-10-08T12:00:21.855087+0000","last_clean":"2023-10-08T12:00:21.855087+0000","last_became_active":"2023-10-08T12:00:20.623038+0000","last_became_peered":"2023-10-08T12:00:20.623038+0000","last_unstale":"2023-10-08T12:00:21.855087+0000","last_undegraded":"2023-10-08T12:00:21.855087+0000","last_fullsized":"2023-10-08T12:00:21.855087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:06:51.286457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.602856+0000","last_change":"2023-10-08T12:00:20.627019+0000","last_active":"2023-10-08T12:00:21.602856+0000","last_peered":"2023-10-08T12:00:21.602856+0000","last_clean":"2023-10-08T12:00:21.602856+0000","last_became_active":"2023-10-08T12:00:20.626509+0000","last_became_peered":"2023-10-08T12:00:20.626509+0000","last_unstale":"2023-10-08T12:00:21.602856+0000","last_undegraded":"2023-10-08T12:00:21.602856+0000","last_fullsized":"2023-10-08T12:00:21.602856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:30:47.199431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.856085+0000","last_change":"2023-10-08T12:00:20.608919+0000","last_active":"2023-10-08T12:00:21.856085+0000","last_peered":"2023-10-08T12:00:21.856085+0000","last_clean":"2023-10-08T12:00:21.856085+0000","last_became_active":"2023-10-08T12:00:20.608477+0000","last_became_peered":"2023-10-08T12:00:20.608477+0000","last_unstale":"2023-10-08T12:00:21.856085+0000","last_undegraded":"2023-10-08T12:00:21.856085+0000","last_fullsized":"2023-10-08T12:00:21.856085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:42:54.801760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.601997+0000","last_change":"2023-10-08T12:00:20.590431+0000","last_active":"2023-10-08T12:00:21.601997+0000","last_peered":"2023-10-08T12:00:21.601997+0000","last_clean":"2023-10-08T12:00:21.601997+0000","last_became_active":"2023-10-08T12:00:20.589585+0000","last_became_peered":"2023-10-08T12:00:20.589585+0000","last_unstale":"2023-10-08T12:00:21.601997+0000","last_undegraded":"2023-10-08T12:00:21.601997+0000","last_fullsized":"2023-10-08T12:00:21.601997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:55:19.542748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.856733+0000","last_change":"2023-10-08T12:00:20.603260+0000","last_active":"2023-10-08T12:00:21.856733+0000","last_peered":"2023-10-08T12:00:21.856733+0000","last_clean":"2023-10-08T12:00:21.856733+0000","last_became_active":"2023-10-08T12:00:20.602872+0000","last_became_peered":"2023-10-08T12:00:20.602872+0000","last_unstale":"2023-10-08T12:00:21.856733+0000","last_undegraded":"2023-10-08T12:00:21.856733+0000","last_fullsized":"2023-10-08T12:00:21.856733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:17:42.290460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.856070+0000","last_change":"2023-10-08T12:00:20.624667+0000","last_active":"2023-10-08T12:00:21.856070+0000","last_peered":"2023-10-08T12:00:21.856070+0000","last_clean":"2023-10-08T12:00:21.856070+0000","last_became_active":"2023-10-08T12:00:20.624080+0000","last_became_peered":"2023-10-08T12:00:20.624080+0000","last_unstale":"2023-10-08T12:00:21.856070+0000","last_undegraded":"2023-10-08T12:00:21.856070+0000","last_fullsized":"2023-10-08T12:00:21.856070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:46:22.522999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.599492+0000","last_change":"2023-10-08T12:00:20.606784+0000","last_active":"2023-10-08T12:00:21.599492+0000","last_peered":"2023-10-08T12:00:21.599492+0000","last_clean":"2023-10-08T12:00:21.599492+0000","last_became_active":"2023-10-08T12:00:20.606415+0000","last_became_peered":"2023-10-08T12:00:20.606415+0000","last_unstale":"2023-10-08T12:00:21.599492+0000","last_undegraded":"2023-10-08T12:00:21.599492+0000","last_fullsized":"2023-10-08T12:00:21.599492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:55:19.542748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.856912+0000","last_change":"2023-10-08T12:00:20.619158+0000","last_active":"2023-10-08T12:00:21.856912+0000","last_peered":"2023-10-08T12:00:21.856912+0000","last_clean":"2023-10-08T12:00:21.856912+0000","last_became_active":"2023-10-08T12:00:20.618857+0000","last_became_peered":"2023-10-08T12:00:20.618857+0000","last_unstale":"2023-10-08T12:00:21.856912+0000","last_undegraded":"2023-10-08T12:00:21.856912+0000","last_fullsized":"2023-10-08T12:00:21.856912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:57:40.359987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855238+0000","last_change":"2023-10-08T12:00:20.601375+0000","last_active":"2023-10-08T12:00:21.855238+0000","last_peered":"2023-10-08T12:00:21.855238+0000","last_clean":"2023-10-08T12:00:21.855238+0000","last_became_active":"2023-10-08T12:00:20.600980+0000","last_became_peered":"2023-10-08T12:00:20.600980+0000","last_unstale":"2023-10-08T12:00:21.855238+0000","last_undegraded":"2023-10-08T12:00:21.855238+0000","last_fullsized":"2023-10-08T12:00:21.855238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:30:14.921064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.603029+0000","last_change":"2023-10-08T12:00:20.608122+0000","last_active":"2023-10-08T12:00:21.603029+0000","last_peered":"2023-10-08T12:00:21.603029+0000","last_clean":"2023-10-08T12:00:21.603029+0000","last_became_active":"2023-10-08T12:00:20.603444+0000","last_became_peered":"2023-10-08T12:00:20.603444+0000","last_unstale":"2023-10-08T12:00:21.603029+0000","last_undegraded":"2023-10-08T12:00:21.603029+0000","last_fullsized":"2023-10-08T12:00:21.603029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:42:51.152070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.640418+0000","last_change":"2023-10-08T12:00:20.604312+0000","last_active":"2023-10-08T12:00:21.640418+0000","last_peered":"2023-10-08T12:00:21.640418+0000","last_clean":"2023-10-08T12:00:21.640418+0000","last_became_active":"2023-10-08T12:00:20.603285+0000","last_became_peered":"2023-10-08T12:00:20.603285+0000","last_unstale":"2023-10-08T12:00:21.640418+0000","last_undegraded":"2023-10-08T12:00:21.640418+0000","last_fullsized":"2023-10-08T12:00:21.640418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:27:04.539065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855353+0000","last_change":"2023-10-08T12:00:20.604806+0000","last_active":"2023-10-08T12:00:21.855353+0000","last_peered":"2023-10-08T12:00:21.855353+0000","last_clean":"2023-10-08T12:00:21.855353+0000","last_became_active":"2023-10-08T12:00:20.602679+0000","last_became_peered":"2023-10-08T12:00:20.602679+0000","last_unstale":"2023-10-08T12:00:21.855353+0000","last_undegraded":"2023-10-08T12:00:21.855353+0000","last_fullsized":"2023-10-08T12:00:21.855353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:10:09.509770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.601550+0000","last_change":"2023-10-08T12:00:20.587095+0000","last_active":"2023-10-08T12:00:21.601550+0000","last_peered":"2023-10-08T12:00:21.601550+0000","last_clean":"2023-10-08T12:00:21.601550+0000","last_became_active":"2023-10-08T12:00:20.586374+0000","last_became_peered":"2023-10-08T12:00:20.586374+0000","last_unstale":"2023-10-08T12:00:21.601550+0000","last_undegraded":"2023-10-08T12:00:21.601550+0000","last_fullsized":"2023-10-08T12:00:21.601550+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:37:45.357564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.856807+0000","last_change":"2023-10-08T12:00:19.547119+0000","last_active":"2023-10-08T12:00:21.856807+0000","last_peered":"2023-10-08T12:00:21.856807+0000","last_clean":"2023-10-08T12:00:21.856807+0000","last_became_active":"2023-10-08T12:00:19.546721+0000","last_became_peered":"2023-10-08T12:00:19.546721+0000","last_unstale":"2023-10-08T12:00:21.856807+0000","last_undegraded":"2023-10-08T12:00:21.856807+0000","last_fullsized":"2023-10-08T12:00:21.856807+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:58:36.625035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855308+0000","last_change":"2023-10-08T12:00:20.587928+0000","last_active":"2023-10-08T12:00:21.855308+0000","last_peered":"2023-10-08T12:00:21.855308+0000","last_clean":"2023-10-08T12:00:21.855308+0000","last_became_active":"2023-10-08T12:00:20.587195+0000","last_became_peered":"2023-10-08T12:00:20.587195+0000","last_unstale":"2023-10-08T12:00:21.855308+0000","last_undegraded":"2023-10-08T12:00:21.855308+0000","last_fullsized":"2023-10-08T12:00:21.855308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:22:42.527070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855483+0000","last_change":"2023-10-08T12:00:19.544794+0000","last_active":"2023-10-08T12:00:21.855483+0000","last_peered":"2023-10-08T12:00:21.855483+0000","last_clean":"2023-10-08T12:00:21.855483+0000","last_became_active":"2023-10-08T12:00:19.544159+0000","last_became_peered":"2023-10-08T12:00:19.544159+0000","last_unstale":"2023-10-08T12:00:21.855483+0000","last_undegraded":"2023-10-08T12:00:21.855483+0000","last_fullsized":"2023-10-08T12:00:21.855483+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:03:27.436776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.856316+0000","last_change":"2023-10-08T12:00:19.533572+0000","last_active":"2023-10-08T12:00:21.856316+0000","last_peered":"2023-10-08T12:00:21.856316+0000","last_clean":"2023-10-08T12:00:21.856316+0000","last_became_active":"2023-10-08T12:00:19.533122+0000","last_became_peered":"2023-10-08T12:00:19.533122+0000","last_unstale":"2023-10-08T12:00:21.856316+0000","last_undegraded":"2023-10-08T12:00:21.856316+0000","last_fullsized":"2023-10-08T12:00:21.856316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:45:15.530667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855898+0000","last_change":"2023-10-08T12:00:20.600857+0000","last_active":"2023-10-08T12:00:21.855898+0000","last_peered":"2023-10-08T12:00:21.855898+0000","last_clean":"2023-10-08T12:00:21.855898+0000","last_became_active":"2023-10-08T12:00:20.600486+0000","last_became_peered":"2023-10-08T12:00:20.600486+0000","last_unstale":"2023-10-08T12:00:21.855898+0000","last_undegraded":"2023-10-08T12:00:21.855898+0000","last_fullsized":"2023-10-08T12:00:21.855898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:30:14.921064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.602215+0000","last_change":"2023-10-08T12:00:19.537352+0000","last_active":"2023-10-08T12:00:21.602215+0000","last_peered":"2023-10-08T12:00:21.602215+0000","last_clean":"2023-10-08T12:00:21.602215+0000","last_became_active":"2023-10-08T12:00:19.536451+0000","last_became_peered":"2023-10-08T12:00:19.536451+0000","last_unstale":"2023-10-08T12:00:21.602215+0000","last_undegraded":"2023-10-08T12:00:21.602215+0000","last_fullsized":"2023-10-08T12:00:21.602215+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:03:27.436776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.598788+0000","last_change":"2023-10-08T12:00:20.606398+0000","last_active":"2023-10-08T12:00:21.598788+0000","last_peered":"2023-10-08T12:00:21.598788+0000","last_clean":"2023-10-08T12:00:21.598788+0000","last_became_active":"2023-10-08T12:00:20.606065+0000","last_became_peered":"2023-10-08T12:00:20.606065+0000","last_unstale":"2023-10-08T12:00:21.598788+0000","last_undegraded":"2023-10-08T12:00:21.598788+0000","last_fullsized":"2023-10-08T12:00:21.598788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:42:54.801760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855996+0000","last_change":"2023-10-08T12:00:19.549304+0000","last_active":"2023-10-08T12:00:21.855996+0000","last_peered":"2023-10-08T12:00:21.855996+0000","last_clean":"2023-10-08T12:00:21.855996+0000","last_became_active":"2023-10-08T12:00:19.548656+0000","last_became_peered":"2023-10-08T12:00:19.548656+0000","last_unstale":"2023-10-08T12:00:21.855996+0000","last_undegraded":"2023-10-08T12:00:21.855996+0000","last_fullsized":"2023-10-08T12:00:21.855996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:37:27.924905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.603981+0000","last_change":"2023-10-08T12:00:20.626582+0000","last_active":"2023-10-08T12:00:21.603981+0000","last_peered":"2023-10-08T12:00:21.603981+0000","last_clean":"2023-10-08T12:00:21.603981+0000","last_became_active":"2023-10-08T12:00:20.626022+0000","last_became_peered":"2023-10-08T12:00:20.626022+0000","last_unstale":"2023-10-08T12:00:21.603981+0000","last_undegraded":"2023-10-08T12:00:21.603981+0000","last_fullsized":"2023-10-08T12:00:21.603981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:43:35.534698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.604190+0000","last_change":"2023-10-08T12:00:19.541832+0000","last_active":"2023-10-08T12:00:21.604190+0000","last_peered":"2023-10-08T12:00:21.604190+0000","last_clean":"2023-10-08T12:00:21.604190+0000","last_became_active":"2023-10-08T12:00:19.538528+0000","last_became_peered":"2023-10-08T12:00:19.538528+0000","last_unstale":"2023-10-08T12:00:21.604190+0000","last_undegraded":"2023-10-08T12:00:21.604190+0000","last_fullsized":"2023-10-08T12:00:21.604190+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:06:50.282434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855468+0000","last_change":"2023-10-08T12:00:20.586258+0000","last_active":"2023-10-08T12:00:21.855468+0000","last_peered":"2023-10-08T12:00:21.855468+0000","last_clean":"2023-10-08T12:00:21.855468+0000","last_became_active":"2023-10-08T12:00:20.585881+0000","last_became_peered":"2023-10-08T12:00:20.585881+0000","last_unstale":"2023-10-08T12:00:21.855468+0000","last_undegraded":"2023-10-08T12:00:21.855468+0000","last_fullsized":"2023-10-08T12:00:21.855468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:42:54.801760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.599480+0000","last_change":"2023-10-08T12:00:19.534608+0000","last_active":"2023-10-08T12:00:21.599480+0000","last_peered":"2023-10-08T12:00:21.599480+0000","last_clean":"2023-10-08T12:00:21.599480+0000","last_became_active":"2023-10-08T12:00:19.534194+0000","last_became_peered":"2023-10-08T12:00:19.534194+0000","last_unstale":"2023-10-08T12:00:21.599480+0000","last_undegraded":"2023-10-08T12:00:21.599480+0000","last_fullsized":"2023-10-08T12:00:21.599480+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:58:36.625035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.602490+0000","last_change":"2023-10-08T12:00:20.631795+0000","last_active":"2023-10-08T12:00:21.602490+0000","last_peered":"2023-10-08T12:00:21.602490+0000","last_clean":"2023-10-08T12:00:21.602490+0000","last_became_active":"2023-10-08T12:00:20.630218+0000","last_became_peered":"2023-10-08T12:00:20.630218+0000","last_unstale":"2023-10-08T12:00:21.602490+0000","last_undegraded":"2023-10-08T12:00:21.602490+0000","last_fullsized":"2023-10-08T12:00:21.602490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:37:28.928928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855668+0000","last_change":"2023-10-08T12:00:19.531553+0000","last_active":"2023-10-08T12:00:21.855668+0000","last_peered":"2023-10-08T12:00:21.855668+0000","last_clean":"2023-10-08T12:00:21.855668+0000","last_became_active":"2023-10-08T12:00:19.530408+0000","last_became_peered":"2023-10-08T12:00:19.530408+0000","last_unstale":"2023-10-08T12:00:21.855668+0000","last_undegraded":"2023-10-08T12:00:21.855668+0000","last_fullsized":"2023-10-08T12:00:21.855668+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:45:15.530667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.632040+0000","last_change":"2023-10-08T12:00:20.625311+0000","last_active":"2023-10-08T12:00:21.632040+0000","last_peered":"2023-10-08T12:00:21.632040+0000","last_clean":"2023-10-08T12:00:21.632040+0000","last_became_active":"2023-10-08T12:00:20.623142+0000","last_became_peered":"2023-10-08T12:00:20.623142+0000","last_unstale":"2023-10-08T12:00:21.632040+0000","last_undegraded":"2023-10-08T12:00:21.632040+0000","last_fullsized":"2023-10-08T12:00:21.632040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:08:02.997033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855519+0000","last_change":"2023-10-08T12:00:19.536104+0000","last_active":"2023-10-08T12:00:21.855519+0000","last_peered":"2023-10-08T12:00:21.855519+0000","last_clean":"2023-10-08T12:00:21.855519+0000","last_became_active":"2023-10-08T12:00:19.535651+0000","last_became_peered":"2023-10-08T12:00:19.535651+0000","last_unstale":"2023-10-08T12:00:21.855519+0000","last_undegraded":"2023-10-08T12:00:21.855519+0000","last_fullsized":"2023-10-08T12:00:21.855519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:50:34.635731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855128+0000","last_change":"2023-10-08T12:00:20.598434+0000","last_active":"2023-10-08T12:00:21.855128+0000","last_peered":"2023-10-08T12:00:21.855128+0000","last_clean":"2023-10-08T12:00:21.855128+0000","last_became_active":"2023-10-08T12:00:20.598046+0000","last_became_peered":"2023-10-08T12:00:20.598046+0000","last_unstale":"2023-10-08T12:00:21.855128+0000","last_undegraded":"2023-10-08T12:00:21.855128+0000","last_fullsized":"2023-10-08T12:00:21.855128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:10:09.509770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.603141+0000","last_change":"2023-10-08T12:00:19.522917+0000","last_active":"2023-10-08T12:00:21.603141+0000","last_peered":"2023-10-08T12:00:21.603141+0000","last_clean":"2023-10-08T12:00:21.603141+0000","last_became_active":"2023-10-08T12:00:19.522172+0000","last_became_peered":"2023-10-08T12:00:19.522172+0000","last_unstale":"2023-10-08T12:00:21.603141+0000","last_undegraded":"2023-10-08T12:00:21.603141+0000","last_fullsized":"2023-10-08T12:00:21.603141+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:51:26.897821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.632418+0000","last_change":"2023-10-08T12:00:20.626570+0000","last_active":"2023-10-08T12:00:21.632418+0000","last_peered":"2023-10-08T12:00:21.632418+0000","last_clean":"2023-10-08T12:00:21.632418+0000","last_became_active":"2023-10-08T12:00:20.625928+0000","last_became_peered":"2023-10-08T12:00:20.625928+0000","last_unstale":"2023-10-08T12:00:21.632418+0000","last_undegraded":"2023-10-08T12:00:21.632418+0000","last_fullsized":"2023-10-08T12:00:21.632418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:30:47.199431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855385+0000","last_change":"2023-10-08T12:00:19.545158+0000","last_active":"2023-10-08T12:00:21.855385+0000","last_peered":"2023-10-08T12:00:21.855385+0000","last_clean":"2023-10-08T12:00:21.855385+0000","last_became_active":"2023-10-08T12:00:19.544490+0000","last_became_peered":"2023-10-08T12:00:19.544490+0000","last_unstale":"2023-10-08T12:00:21.855385+0000","last_undegraded":"2023-10-08T12:00:21.855385+0000","last_fullsized":"2023-10-08T12:00:21.855385+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:27:03.535042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855412+0000","last_change":"2023-10-08T12:00:20.602776+0000","last_active":"2023-10-08T12:00:21.855412+0000","last_peered":"2023-10-08T12:00:21.855412+0000","last_clean":"2023-10-08T12:00:21.855412+0000","last_became_active":"2023-10-08T12:00:20.601726+0000","last_became_peered":"2023-10-08T12:00:20.601726+0000","last_unstale":"2023-10-08T12:00:21.855412+0000","last_undegraded":"2023-10-08T12:00:21.855412+0000","last_fullsized":"2023-10-08T12:00:21.855412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:30:14.921064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.640174+0000","last_change":"2023-10-08T12:00:19.525010+0000","last_active":"2023-10-08T12:00:21.640174+0000","last_peered":"2023-10-08T12:00:21.640174+0000","last_clean":"2023-10-08T12:00:21.640174+0000","last_became_active":"2023-10-08T12:00:19.524689+0000","last_became_peered":"2023-10-08T12:00:19.524689+0000","last_unstale":"2023-10-08T12:00:21.640174+0000","last_undegraded":"2023-10-08T12:00:21.640174+0000","last_fullsized":"2023-10-08T12:00:21.640174+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:39:17.089135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.631709+0000","last_change":"2023-10-08T12:00:20.624644+0000","last_active":"2023-10-08T12:00:21.631709+0000","last_peered":"2023-10-08T12:00:21.631709+0000","last_clean":"2023-10-08T12:00:21.631709+0000","last_became_active":"2023-10-08T12:00:20.623936+0000","last_became_peered":"2023-10-08T12:00:20.623936+0000","last_unstale":"2023-10-08T12:00:21.631709+0000","last_undegraded":"2023-10-08T12:00:21.631709+0000","last_fullsized":"2023-10-08T12:00:21.631709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:57:40.359987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.602477+0000","last_change":"2023-10-08T12:00:19.525128+0000","last_active":"2023-10-08T12:00:21.602477+0000","last_peered":"2023-10-08T12:00:21.602477+0000","last_clean":"2023-10-08T12:00:21.602477+0000","last_became_active":"2023-10-08T12:00:19.524428+0000","last_became_peered":"2023-10-08T12:00:19.524428+0000","last_unstale":"2023-10-08T12:00:21.602477+0000","last_undegraded":"2023-10-08T12:00:21.602477+0000","last_fullsized":"2023-10-08T12:00:21.602477+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:28:30.235998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.632464+0000","last_change":"2023-10-08T12:00:20.624158+0000","last_active":"2023-10-08T12:00:21.632464+0000","last_peered":"2023-10-08T12:00:21.632464+0000","last_clean":"2023-10-08T12:00:21.632464+0000","last_became_active":"2023-10-08T12:00:20.623663+0000","last_became_peered":"2023-10-08T12:00:20.623663+0000","last_unstale":"2023-10-08T12:00:21.632464+0000","last_undegraded":"2023-10-08T12:00:21.632464+0000","last_fullsized":"2023-10-08T12:00:21.632464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:35:25.862808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.640474+0000","last_change":"2023-10-08T12:00:19.521327+0000","last_active":"2023-10-08T12:00:21.640474+0000","last_peered":"2023-10-08T12:00:21.640474+0000","last_clean":"2023-10-08T12:00:21.640474+0000","last_became_active":"2023-10-08T12:00:19.520907+0000","last_became_peered":"2023-10-08T12:00:19.520907+0000","last_unstale":"2023-10-08T12:00:21.640474+0000","last_undegraded":"2023-10-08T12:00:21.640474+0000","last_fullsized":"2023-10-08T12:00:21.640474+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:17:52.345672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.632767+0000","last_change":"2023-10-08T12:00:20.631419+0000","last_active":"2023-10-08T12:00:21.632767+0000","last_peered":"2023-10-08T12:00:21.632767+0000","last_clean":"2023-10-08T12:00:21.632767+0000","last_became_active":"2023-10-08T12:00:20.630933+0000","last_became_peered":"2023-10-08T12:00:20.630933+0000","last_unstale":"2023-10-08T12:00:21.632767+0000","last_undegraded":"2023-10-08T12:00:21.632767+0000","last_fullsized":"2023-10-08T12:00:21.632767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:23:03.900263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.599639+0000","last_change":"2023-10-08T12:00:19.535778+0000","last_active":"2023-10-08T12:00:21.599639+0000","last_peered":"2023-10-08T12:00:21.599639+0000","last_clean":"2023-10-08T12:00:21.599639+0000","last_became_active":"2023-10-08T12:00:19.535463+0000","last_became_peered":"2023-10-08T12:00:19.535463+0000","last_unstale":"2023-10-08T12:00:21.599639+0000","last_undegraded":"2023-10-08T12:00:21.599639+0000","last_fullsized":"2023-10-08T12:00:21.599639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:06:50.282434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.602845+0000","last_change":"2023-10-08T12:00:20.590511+0000","last_active":"2023-10-08T12:00:21.602845+0000","last_peered":"2023-10-08T12:00:21.602845+0000","last_clean":"2023-10-08T12:00:21.602845+0000","last_became_active":"2023-10-08T12:00:20.589762+0000","last_became_peered":"2023-10-08T12:00:20.589762+0000","last_unstale":"2023-10-08T12:00:21.602845+0000","last_undegraded":"2023-10-08T12:00:21.602845+0000","last_fullsized":"2023-10-08T12:00:21.602845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:08:02.997033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.640487+0000","last_change":"2023-10-08T12:00:19.530223+0000","last_active":"2023-10-08T12:00:21.640487+0000","last_peered":"2023-10-08T12:00:21.640487+0000","last_clean":"2023-10-08T12:00:21.640487+0000","last_became_active":"2023-10-08T12:00:19.529830+0000","last_became_peered":"2023-10-08T12:00:19.529830+0000","last_unstale":"2023-10-08T12:00:21.640487+0000","last_undegraded":"2023-10-08T12:00:21.640487+0000","last_fullsized":"2023-10-08T12:00:21.640487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:47:56.523501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.632457+0000","last_change":"2023-10-08T12:00:20.626826+0000","last_active":"2023-10-08T12:00:21.632457+0000","last_peered":"2023-10-08T12:00:21.632457+0000","last_clean":"2023-10-08T12:00:21.632457+0000","last_became_active":"2023-10-08T12:00:20.624034+0000","last_became_peered":"2023-10-08T12:00:20.624034+0000","last_unstale":"2023-10-08T12:00:21.632457+0000","last_undegraded":"2023-10-08T12:00:21.632457+0000","last_fullsized":"2023-10-08T12:00:21.632457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:42:51.152070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:00:20.587986+0000","last_change":"2023-10-08T12:00:08.887559+0000","last_active":"2023-10-08T12:00:20.587986+0000","last_peered":"2023-10-08T12:00:20.587986+0000","last_clean":"2023-10-08T12:00:20.587986+0000","last_became_active":"2023-10-08T12:00:08.884794+0000","last_became_peered":"2023-10-08T12:00:08.884794+0000","last_unstale":"2023-10-08T12:00:20.587986+0000","last_undegraded":"2023-10-08T12:00:20.587986+0000","last_fullsized":"2023-10-08T12:00:20.587986+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:07.812869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:07.812869+0000","last_clean_scrub_stamp":"2023-10-08T12:00:07.812869+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:58:36.123159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.603377+0000","last_change":"2023-10-08T12:00:19.524401+0000","last_active":"2023-10-08T12:00:21.603377+0000","last_peered":"2023-10-08T12:00:21.603377+0000","last_clean":"2023-10-08T12:00:21.603377+0000","last_became_active":"2023-10-08T12:00:19.523604+0000","last_became_peered":"2023-10-08T12:00:19.523604+0000","last_unstale":"2023-10-08T12:00:21.603377+0000","last_undegraded":"2023-10-08T12:00:21.603377+0000","last_fullsized":"2023-10-08T12:00:21.603377+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:10:08.505747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.856444+0000","last_change":"2023-10-08T12:00:20.605554+0000","last_active":"2023-10-08T12:00:21.856444+0000","last_peered":"2023-10-08T12:00:21.856444+0000","last_clean":"2023-10-08T12:00:21.856444+0000","last_became_active":"2023-10-08T12:00:20.604329+0000","last_became_peered":"2023-10-08T12:00:20.604329+0000","last_unstale":"2023-10-08T12:00:21.856444+0000","last_undegraded":"2023-10-08T12:00:21.856444+0000","last_fullsized":"2023-10-08T12:00:21.856444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:54:25.498802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.631264+0000","last_change":"2023-10-08T12:00:19.552974+0000","last_active":"2023-10-08T12:00:21.631264+0000","last_peered":"2023-10-08T12:00:21.631264+0000","last_clean":"2023-10-08T12:00:21.631264+0000","last_became_active":"2023-10-08T12:00:19.552408+0000","last_became_peered":"2023-10-08T12:00:19.552408+0000","last_unstale":"2023-10-08T12:00:21.631264+0000","last_undegraded":"2023-10-08T12:00:21.631264+0000","last_fullsized":"2023-10-08T12:00:21.631264+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:37:44.353541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.854532+0000","last_change":"2023-10-08T12:00:20.609466+0000","last_active":"2023-10-08T12:00:21.854532+0000","last_peered":"2023-10-08T12:00:21.854532+0000","last_clean":"2023-10-08T12:00:21.854532+0000","last_became_active":"2023-10-08T12:00:20.609116+0000","last_became_peered":"2023-10-08T12:00:20.609116+0000","last_unstale":"2023-10-08T12:00:21.854532+0000","last_undegraded":"2023-10-08T12:00:21.854532+0000","last_fullsized":"2023-10-08T12:00:21.854532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:51:27.901843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.640292+0000","last_change":"2023-10-08T12:00:19.520729+0000","last_active":"2023-10-08T12:00:21.640292+0000","last_peered":"2023-10-08T12:00:21.640292+0000","last_clean":"2023-10-08T12:00:21.640292+0000","last_became_active":"2023-10-08T12:00:19.520254+0000","last_became_peered":"2023-10-08T12:00:19.520254+0000","last_unstale":"2023-10-08T12:00:21.640292+0000","last_undegraded":"2023-10-08T12:00:21.640292+0000","last_fullsized":"2023-10-08T12:00:21.640292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:50:34.635731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.598860+0000","last_change":"2023-10-08T12:00:20.591873+0000","last_active":"2023-10-08T12:00:21.598860+0000","last_peered":"2023-10-08T12:00:21.598860+0000","last_clean":"2023-10-08T12:00:21.598860+0000","last_became_active":"2023-10-08T12:00:20.591431+0000","last_became_peered":"2023-10-08T12:00:20.591431+0000","last_unstale":"2023-10-08T12:00:21.598860+0000","last_undegraded":"2023-10-08T12:00:21.598860+0000","last_fullsized":"2023-10-08T12:00:21.598860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:54:25.498802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.603246+0000","last_change":"2023-10-08T12:00:19.530940+0000","last_active":"2023-10-08T12:00:21.603246+0000","last_peered":"2023-10-08T12:00:21.603246+0000","last_clean":"2023-10-08T12:00:21.603246+0000","last_became_active":"2023-10-08T12:00:19.530216+0000","last_became_peered":"2023-10-08T12:00:19.530216+0000","last_unstale":"2023-10-08T12:00:21.603246+0000","last_undegraded":"2023-10-08T12:00:21.603246+0000","last_fullsized":"2023-10-08T12:00:21.603246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:45:15.530667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.602773+0000","last_change":"2023-10-08T12:00:20.584188+0000","last_active":"2023-10-08T12:00:21.602773+0000","last_peered":"2023-10-08T12:00:21.602773+0000","last_clean":"2023-10-08T12:00:21.602773+0000","last_became_active":"2023-10-08T12:00:20.583209+0000","last_became_peered":"2023-10-08T12:00:20.583209+0000","last_unstale":"2023-10-08T12:00:21.602773+0000","last_undegraded":"2023-10-08T12:00:21.602773+0000","last_fullsized":"2023-10-08T12:00:21.602773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:51:27.901843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.599342+0000","last_change":"2023-10-08T12:00:19.525924+0000","last_active":"2023-10-08T12:00:21.599342+0000","last_peered":"2023-10-08T12:00:21.599342+0000","last_clean":"2023-10-08T12:00:21.599342+0000","last_became_active":"2023-10-08T12:00:19.525508+0000","last_became_peered":"2023-10-08T12:00:19.525508+0000","last_unstale":"2023-10-08T12:00:21.599342+0000","last_undegraded":"2023-10-08T12:00:21.599342+0000","last_fullsized":"2023-10-08T12:00:21.599342+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:51:26.897821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.604521+0000","last_change":"2023-10-08T12:00:20.591551+0000","last_active":"2023-10-08T12:00:21.604521+0000","last_peered":"2023-10-08T12:00:21.604521+0000","last_clean":"2023-10-08T12:00:21.604521+0000","last_became_active":"2023-10-08T12:00:20.589572+0000","last_became_peered":"2023-10-08T12:00:20.589572+0000","last_unstale":"2023-10-08T12:00:21.604521+0000","last_undegraded":"2023-10-08T12:00:21.604521+0000","last_fullsized":"2023-10-08T12:00:21.604521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:22:34.137787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.632679+0000","last_change":"2023-10-08T12:00:19.555017+0000","last_active":"2023-10-08T12:00:21.632679+0000","last_peered":"2023-10-08T12:00:21.632679+0000","last_clean":"2023-10-08T12:00:21.632679+0000","last_became_active":"2023-10-08T12:00:19.554451+0000","last_became_peered":"2023-10-08T12:00:19.554451+0000","last_unstale":"2023-10-08T12:00:21.632679+0000","last_undegraded":"2023-10-08T12:00:21.632679+0000","last_fullsized":"2023-10-08T12:00:21.632679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:54:06.443638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.599236+0000","last_change":"2023-10-08T12:00:20.595603+0000","last_active":"2023-10-08T12:00:21.599236+0000","last_peered":"2023-10-08T12:00:21.599236+0000","last_clean":"2023-10-08T12:00:21.599236+0000","last_became_active":"2023-10-08T12:00:20.595176+0000","last_became_peered":"2023-10-08T12:00:20.595176+0000","last_unstale":"2023-10-08T12:00:21.599236+0000","last_undegraded":"2023-10-08T12:00:21.599236+0000","last_fullsized":"2023-10-08T12:00:21.599236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:46:22.522999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.599108+0000","last_change":"2023-10-08T12:00:19.542919+0000","last_active":"2023-10-08T12:00:21.599108+0000","last_peered":"2023-10-08T12:00:21.599108+0000","last_clean":"2023-10-08T12:00:21.599108+0000","last_became_active":"2023-10-08T12:00:19.542518+0000","last_became_peered":"2023-10-08T12:00:19.542518+0000","last_unstale":"2023-10-08T12:00:21.599108+0000","last_undegraded":"2023-10-08T12:00:21.599108+0000","last_fullsized":"2023-10-08T12:00:21.599108+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:10:08.505747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.857089+0000","last_change":"2023-10-08T12:00:20.625910+0000","last_active":"2023-10-08T12:00:21.857089+0000","last_peered":"2023-10-08T12:00:21.857089+0000","last_clean":"2023-10-08T12:00:21.857089+0000","last_became_active":"2023-10-08T12:00:20.625608+0000","last_became_peered":"2023-10-08T12:00:20.625608+0000","last_unstale":"2023-10-08T12:00:21.857089+0000","last_undegraded":"2023-10-08T12:00:21.857089+0000","last_fullsized":"2023-10-08T12:00:21.857089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:53:47.853039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.856048+0000","last_change":"2023-10-08T12:00:19.553242+0000","last_active":"2023-10-08T12:00:21.856048+0000","last_peered":"2023-10-08T12:00:21.856048+0000","last_clean":"2023-10-08T12:00:21.856048+0000","last_became_active":"2023-10-08T12:00:19.552693+0000","last_became_peered":"2023-10-08T12:00:19.552693+0000","last_unstale":"2023-10-08T12:00:21.856048+0000","last_undegraded":"2023-10-08T12:00:21.856048+0000","last_fullsized":"2023-10-08T12:00:21.856048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:51:26.897821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855831+0000","last_change":"2023-10-08T12:00:20.591317+0000","last_active":"2023-10-08T12:00:21.855831+0000","last_peered":"2023-10-08T12:00:21.855831+0000","last_clean":"2023-10-08T12:00:21.855831+0000","last_became_active":"2023-10-08T12:00:20.591008+0000","last_became_peered":"2023-10-08T12:00:20.591008+0000","last_unstale":"2023-10-08T12:00:21.855831+0000","last_undegraded":"2023-10-08T12:00:21.855831+0000","last_fullsized":"2023-10-08T12:00:21.855831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:54:07.447661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.631260+0000","last_change":"2023-10-08T12:00:19.554635+0000","last_active":"2023-10-08T12:00:21.631260+0000","last_peered":"2023-10-08T12:00:21.631260+0000","last_clean":"2023-10-08T12:00:21.631260+0000","last_became_active":"2023-10-08T12:00:19.553990+0000","last_became_peered":"2023-10-08T12:00:19.553990+0000","last_unstale":"2023-10-08T12:00:21.631260+0000","last_undegraded":"2023-10-08T12:00:21.631260+0000","last_fullsized":"2023-10-08T12:00:21.631260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:50:34.635731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.601954+0000","last_change":"2023-10-08T12:00:20.596182+0000","last_active":"2023-10-08T12:00:21.601954+0000","last_peered":"2023-10-08T12:00:21.601954+0000","last_clean":"2023-10-08T12:00:21.601954+0000","last_became_active":"2023-10-08T12:00:20.595333+0000","last_became_peered":"2023-10-08T12:00:20.595333+0000","last_unstale":"2023-10-08T12:00:21.601954+0000","last_undegraded":"2023-10-08T12:00:21.601954+0000","last_fullsized":"2023-10-08T12:00:21.601954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:27:04.539065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.598828+0000","last_change":"2023-10-08T12:00:19.552883+0000","last_active":"2023-10-08T12:00:21.598828+0000","last_peered":"2023-10-08T12:00:21.598828+0000","last_clean":"2023-10-08T12:00:21.598828+0000","last_became_active":"2023-10-08T12:00:19.552343+0000","last_became_peered":"2023-10-08T12:00:19.552343+0000","last_unstale":"2023-10-08T12:00:21.598828+0000","last_undegraded":"2023-10-08T12:00:21.598828+0000","last_fullsized":"2023-10-08T12:00:21.598828+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:37:27.924905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855959+0000","last_change":"2023-10-08T12:00:20.593145+0000","last_active":"2023-10-08T12:00:21.855959+0000","last_peered":"2023-10-08T12:00:21.855959+0000","last_clean":"2023-10-08T12:00:21.855959+0000","last_became_active":"2023-10-08T12:00:20.592778+0000","last_became_peered":"2023-10-08T12:00:20.592778+0000","last_unstale":"2023-10-08T12:00:21.855959+0000","last_undegraded":"2023-10-08T12:00:21.855959+0000","last_fullsized":"2023-10-08T12:00:21.855959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:22:42.527070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.599800+0000","last_change":"2023-10-08T12:00:19.524846+0000","last_active":"2023-10-08T12:00:21.599800+0000","last_peered":"2023-10-08T12:00:21.599800+0000","last_clean":"2023-10-08T12:00:21.599800+0000","last_became_active":"2023-10-08T12:00:19.524431+0000","last_became_peered":"2023-10-08T12:00:19.524431+0000","last_unstale":"2023-10-08T12:00:21.599800+0000","last_undegraded":"2023-10-08T12:00:21.599800+0000","last_fullsized":"2023-10-08T12:00:21.599800+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:45:15.530667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.856621+0000","last_change":"2023-10-08T12:00:20.603921+0000","last_active":"2023-10-08T12:00:21.856621+0000","last_peered":"2023-10-08T12:00:21.856621+0000","last_clean":"2023-10-08T12:00:21.856621+0000","last_became_active":"2023-10-08T12:00:20.601742+0000","last_became_peered":"2023-10-08T12:00:20.601742+0000","last_unstale":"2023-10-08T12:00:21.856621+0000","last_undegraded":"2023-10-08T12:00:21.856621+0000","last_fullsized":"2023-10-08T12:00:21.856621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:55:19.542748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.632096+0000","last_change":"2023-10-08T12:00:19.554323+0000","last_active":"2023-10-08T12:00:21.632096+0000","last_peered":"2023-10-08T12:00:21.632096+0000","last_clean":"2023-10-08T12:00:21.632096+0000","last_became_active":"2023-10-08T12:00:19.553748+0000","last_became_peered":"2023-10-08T12:00:19.553748+0000","last_unstale":"2023-10-08T12:00:21.632096+0000","last_undegraded":"2023-10-08T12:00:21.632096+0000","last_fullsized":"2023-10-08T12:00:21.632096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:51:26.897821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855418+0000","last_change":"2023-10-08T12:00:20.613066+0000","last_active":"2023-10-08T12:00:21.855418+0000","last_peered":"2023-10-08T12:00:21.855418+0000","last_clean":"2023-10-08T12:00:21.855418+0000","last_became_active":"2023-10-08T12:00:20.612422+0000","last_became_peered":"2023-10-08T12:00:20.612422+0000","last_unstale":"2023-10-08T12:00:21.855418+0000","last_undegraded":"2023-10-08T12:00:21.855418+0000","last_fullsized":"2023-10-08T12:00:21.855418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:22:42.527070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.604197+0000","last_change":"2023-10-08T12:00:20.607333+0000","last_active":"2023-10-08T12:00:21.604197+0000","last_peered":"2023-10-08T12:00:21.604197+0000","last_clean":"2023-10-08T12:00:21.604197+0000","last_became_active":"2023-10-08T12:00:20.606634+0000","last_became_peered":"2023-10-08T12:00:20.606634+0000","last_unstale":"2023-10-08T12:00:21.604197+0000","last_undegraded":"2023-10-08T12:00:21.604197+0000","last_fullsized":"2023-10-08T12:00:21.604197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:35:25.862808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.631868+0000","last_change":"2023-10-08T12:00:19.553120+0000","last_active":"2023-10-08T12:00:21.631868+0000","last_peered":"2023-10-08T12:00:21.631868+0000","last_clean":"2023-10-08T12:00:21.631868+0000","last_became_active":"2023-10-08T12:00:19.552479+0000","last_became_peered":"2023-10-08T12:00:19.552479+0000","last_unstale":"2023-10-08T12:00:21.631868+0000","last_undegraded":"2023-10-08T12:00:21.631868+0000","last_fullsized":"2023-10-08T12:00:21.631868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:35:48.346462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.602591+0000","last_change":"2023-10-08T12:00:20.607581+0000","last_active":"2023-10-08T12:00:21.602591+0000","last_peered":"2023-10-08T12:00:21.602591+0000","last_clean":"2023-10-08T12:00:21.602591+0000","last_became_active":"2023-10-08T12:00:20.606887+0000","last_became_peered":"2023-10-08T12:00:20.606887+0000","last_unstale":"2023-10-08T12:00:21.602591+0000","last_undegraded":"2023-10-08T12:00:21.602591+0000","last_fullsized":"2023-10-08T12:00:21.602591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:53:47.853039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.632291+0000","last_change":"2023-10-08T12:00:19.555477+0000","last_active":"2023-10-08T12:00:21.632291+0000","last_peered":"2023-10-08T12:00:21.632291+0000","last_clean":"2023-10-08T12:00:21.632291+0000","last_became_active":"2023-10-08T12:00:19.553643+0000","last_became_peered":"2023-10-08T12:00:19.553643+0000","last_unstale":"2023-10-08T12:00:21.632291+0000","last_undegraded":"2023-10-08T12:00:21.632291+0000","last_fullsized":"2023-10-08T12:00:21.632291+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:30:13.917041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855050+0000","last_change":"2023-10-08T12:00:20.576541+0000","last_active":"2023-10-08T12:00:21.855050+0000","last_peered":"2023-10-08T12:00:21.855050+0000","last_clean":"2023-10-08T12:00:21.855050+0000","last_became_active":"2023-10-08T12:00:20.575715+0000","last_became_peered":"2023-10-08T12:00:20.575715+0000","last_unstale":"2023-10-08T12:00:21.855050+0000","last_undegraded":"2023-10-08T12:00:21.855050+0000","last_fullsized":"2023-10-08T12:00:21.855050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:45:16.534690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.857043+0000","last_change":"2023-10-08T12:00:19.524299+0000","last_active":"2023-10-08T12:00:21.857043+0000","last_peered":"2023-10-08T12:00:21.857043+0000","last_clean":"2023-10-08T12:00:21.857043+0000","last_became_active":"2023-10-08T12:00:19.523979+0000","last_became_peered":"2023-10-08T12:00:19.523979+0000","last_unstale":"2023-10-08T12:00:21.857043+0000","last_undegraded":"2023-10-08T12:00:21.857043+0000","last_fullsized":"2023-10-08T12:00:21.857043+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:06:50.282434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.856602+0000","last_change":"2023-10-08T12:00:20.621615+0000","last_active":"2023-10-08T12:00:21.856602+0000","last_peered":"2023-10-08T12:00:21.856602+0000","last_clean":"2023-10-08T12:00:21.856602+0000","last_became_active":"2023-10-08T12:00:20.621249+0000","last_became_peered":"2023-10-08T12:00:20.621249+0000","last_unstale":"2023-10-08T12:00:21.856602+0000","last_undegraded":"2023-10-08T12:00:21.856602+0000","last_fullsized":"2023-10-08T12:00:21.856602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:46:22.522999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855793+0000","last_change":"2023-10-08T12:00:19.546557+0000","last_active":"2023-10-08T12:00:21.855793+0000","last_peered":"2023-10-08T12:00:21.855793+0000","last_clean":"2023-10-08T12:00:21.855793+0000","last_became_active":"2023-10-08T12:00:19.546297+0000","last_became_peered":"2023-10-08T12:00:19.546297+0000","last_unstale":"2023-10-08T12:00:21.855793+0000","last_undegraded":"2023-10-08T12:00:21.855793+0000","last_fullsized":"2023-10-08T12:00:21.855793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:37:27.924905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":661848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.256}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.294}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.22}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1399999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":72510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.204}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":208896,"data_stored":70988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.877}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.228}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1950000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91100000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94099999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1819999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.093}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":192512,"data_stored":64598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2190000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.079}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.286}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.325}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.454}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":811008,"data_stored":661904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.175}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0529999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T12:00:24.630 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T12:00:24.789 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.783+0000 7f2f7201d640 1 -- 172.21.15.62:0/3657832752 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f6c0bc670 msgr2=0x7f2f6c069790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:24.789 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.783+0000 7f2f7201d640 1 --2- 172.21.15.62:0/3657832752 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f6c0bc670 0x7f2f6c069790 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2f60009900 tx=0x7f2f6001c760 comp rx=0 tx=0).stop 2023-10-08T12:00:24.790 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.783+0000 7f2f7201d640 1 -- 172.21.15.62:0/3657832752 shutdown_connections 2023-10-08T12:00:24.790 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.783+0000 7f2f7201d640 1 --2- 172.21.15.62:0/3657832752 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f6c0bc670 0x7f2f6c069790 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:24.790 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.783+0000 7f2f7201d640 1 --2- 172.21.15.62:0/3657832752 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2f6c06a520 0x7f2f6c149be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:24.790 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.783+0000 7f2f7201d640 1 -- 172.21.15.62:0/3657832752 >> 172.21.15.62:0/3657832752 conn(0x7f2f6c0a0540 msgr2=0x7f2f6c0a0950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:24.790 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.783+0000 7f2f7201d640 1 -- 172.21.15.62:0/3657832752 shutdown_connections 2023-10-08T12:00:24.790 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.783+0000 7f2f7201d640 1 -- 172.21.15.62:0/3657832752 wait complete. 2023-10-08T12:00:24.792 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.787+0000 7f2f7201d640 1 Processor -- start 2023-10-08T12:00:24.792 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.787+0000 7f2f7201d640 1 -- start start 2023-10-08T12:00:24.793 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.787+0000 7f2f7201d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2f6c06a520 0x7f2f6c13a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:24.793 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.787+0000 7f2f7201d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f6c0bc670 0x7f2f6c13c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:24.793 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.787+0000 7f2f7201d640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2f6c0bdba0 0x7f2f6c13c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:24.793 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.787+0000 7f2f7201d640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6c1e3150 con 0x7f2f6c0bc670 2023-10-08T12:00:24.793 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.787+0000 7f2f7201d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6c13d7e0 con 0x7f2f6c06a520 2023-10-08T12:00:24.793 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.787+0000 7f2f7201d640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6c1e2b00 con 0x7f2f6c0bdba0 2023-10-08T12:00:24.794 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.787+0000 7f2f6affd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f6c0bc670 0x7f2f6c13c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:24.794 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.787+0000 7f2f6affd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f6c0bc670 0x7f2f6c13c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:45156/0 (socket says 172.21.15.62:45156) 2023-10-08T12:00:24.794 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.787+0000 7f2f6affd640 1 -- 172.21.15.62:0/1763659212 learned_addr learned my addr 172.21.15.62:0/1763659212 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:24.794 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.787+0000 7f2f6b7fe640 1 --2- 172.21.15.62:0/1763659212 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2f6c06a520 0x7f2f6c13a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:24.794 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.787+0000 7f2f6bfff640 1 --2- 172.21.15.62:0/1763659212 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2f6c0bdba0 0x7f2f6c13c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:24.794 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.787+0000 7f2f6affd640 1 -- 172.21.15.62:0/1763659212 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2f6c0bdba0 msgr2=0x7f2f6c13c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:24.794 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.787+0000 7f2f6affd640 1 --2- 172.21.15.62:0/1763659212 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2f6c0bdba0 0x7f2f6c13c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:24.794 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.787+0000 7f2f6affd640 1 -- 172.21.15.62:0/1763659212 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2f6c06a520 msgr2=0x7f2f6c13a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:24.794 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.787+0000 7f2f6affd640 1 --2- 172.21.15.62:0/1763659212 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2f6c06a520 0x7f2f6c13a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:24.795 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.787+0000 7f2f6affd640 1 -- 172.21.15.62:0/1763659212 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f60009560 con 0x7f2f6c0bc670 2023-10-08T12:00:24.795 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.787+0000 7f2f6affd640 1 --2- 172.21.15.62:0/1763659212 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f6c0bc670 0x7f2f6c13c130 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2f60009850 tx=0x7f2f600a6700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:24.795 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.787+0000 7f2f53fff640 1 -- 172.21.15.62:0/1763659212 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f600040c0 con 0x7f2f6c0bc670 2023-10-08T12:00:24.795 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.787+0000 7f2f53fff640 1 -- 172.21.15.62:0/1763659212 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2f60004310 con 0x7f2f6c0bc670 2023-10-08T12:00:24.795 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.787+0000 7f2f7201d640 1 -- 172.21.15.62:0/1763659212 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f6c1e2de0 con 0x7f2f6c0bc670 2023-10-08T12:00:24.795 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.787+0000 7f2f53fff640 1 -- 172.21.15.62:0/1763659212 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f60003860 con 0x7f2f6c0bc670 2023-10-08T12:00:24.795 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.787+0000 7f2f7201d640 1 -- 172.21.15.62:0/1763659212 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f6c14bf40 con 0x7f2f6c0bc670 2023-10-08T12:00:24.796 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.787+0000 7f2f7201d640 1 -- 172.21.15.62:0/1763659212 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f6c066a30 con 0x7f2f6c0bc670 2023-10-08T12:00:24.796 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.791+0000 7f2f53fff640 1 -- 172.21.15.62:0/1763659212 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2f600039c0 con 0x7f2f6c0bc670 2023-10-08T12:00:24.796 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.791+0000 7f2f53fff640 1 --2- 172.21.15.62:0/1763659212 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f2f580664a0 0x7f2f58068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:24.797 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.791+0000 7f2f53fff640 1 -- 172.21.15.62:0/1763659212 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2f600aa070 con 0x7f2f6c0bc670 2023-10-08T12:00:24.797 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.791+0000 7f2f6b7fe640 1 --2- 172.21.15.62:0/1763659212 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f2f580664a0 0x7f2f58068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:24.797 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.791+0000 7f2f6b7fe640 1 --2- 172.21.15.62:0/1763659212 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f2f580664a0 0x7f2f58068960 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c006fd0 tx=0x7f2f5c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:24.798 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.795+0000 7f2f53fff640 1 -- 172.21.15.62:0/1763659212 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2f600ec280 con 0x7f2f6c0bc670 2023-10-08T12:00:24.944 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.939+0000 7f2f7201d640 1 -- 172.21.15.62:0/1763659212 --> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2f6c04da80 con 0x7f2f580664a0 2023-10-08T12:00:24.964 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.963+0000 7f2f53fff640 1 -- 172.21.15.62:0/1763659212 <== mgr.4111 v2:172.21.15.130:6832/826384843 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264579 (secure 0 0 0) 0x7f2f6c04da80 con 0x7f2f580664a0 2023-10-08T12:00:24.966 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T12:00:24.968 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2023-10-08T12:00:24.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.963+0000 7f2f7201d640 1 -- 172.21.15.62:0/1763659212 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f2f580664a0 msgr2=0x7f2f58068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:24.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.963+0000 7f2f7201d640 1 --2- 172.21.15.62:0/1763659212 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f2f580664a0 0x7f2f58068960 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c006fd0 tx=0x7f2f5c008040 comp rx=0 tx=0).stop 2023-10-08T12:00:24.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.963+0000 7f2f7201d640 1 -- 172.21.15.62:0/1763659212 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f6c0bc670 msgr2=0x7f2f6c13c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:24.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.963+0000 7f2f7201d640 1 --2- 172.21.15.62:0/1763659212 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f6c0bc670 0x7f2f6c13c130 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2f60009850 tx=0x7f2f600a6700 comp rx=0 tx=0).stop 2023-10-08T12:00:24.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.963+0000 7f2f7201d640 1 -- 172.21.15.62:0/1763659212 shutdown_connections 2023-10-08T12:00:24.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.963+0000 7f2f7201d640 1 --2- 172.21.15.62:0/1763659212 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f2f580664a0 0x7f2f58068960 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:24.970 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.963+0000 7f2f7201d640 1 --2- 172.21.15.62:0/1763659212 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2f6c0bdba0 0x7f2f6c13c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:24.970 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.963+0000 7f2f7201d640 1 --2- 172.21.15.62:0/1763659212 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f6c0bc670 0x7f2f6c13c130 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:24.970 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.963+0000 7f2f7201d640 1 --2- 172.21.15.62:0/1763659212 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2f6c06a520 0x7f2f6c13a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:24.970 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.963+0000 7f2f7201d640 1 -- 172.21.15.62:0/1763659212 >> 172.21.15.62:0/1763659212 conn(0x7f2f6c0a0540 msgr2=0x7f2f6c0bace0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:24.970 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.963+0000 7f2f7201d640 1 -- 172.21.15.62:0/1763659212 shutdown_connections 2023-10-08T12:00:24.970 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:24.963+0000 7f2f7201d640 1 -- 172.21.15.62:0/1763659212 wait complete. 2023-10-08T12:00:24.983 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-10-08T12:00:23.111496+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":185,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219020,"kb_used_data":2812,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755700,"statfs":{"total":773094113280,"available":772869836800,"internally_reserved":0,"allocated":2879488,"data_stored":1746440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":73,"apply_latency_ms":73,"commit_latency_ns":73000000,"apply_latency_ns":73000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.619248"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.632466+0000","last_change":"2023-10-08T12:00:20.627789+0000","last_active":"2023-10-08T12:00:21.632466+0000","last_peered":"2023-10-08T12:00:21.632466+0000","last_clean":"2023-10-08T12:00:21.632466+0000","last_became_active":"2023-10-08T12:00:20.624907+0000","last_became_peered":"2023-10-08T12:00:20.624907+0000","last_unstale":"2023-10-08T12:00:21.632466+0000","last_undegraded":"2023-10-08T12:00:21.632466+0000","last_fullsized":"2023-10-08T12:00:21.632466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:43:35.534698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.598994+0000","last_change":"2023-10-08T12:00:20.600909+0000","last_active":"2023-10-08T12:00:21.598994+0000","last_peered":"2023-10-08T12:00:21.598994+0000","last_clean":"2023-10-08T12:00:21.598994+0000","last_became_active":"2023-10-08T12:00:20.600498+0000","last_became_peered":"2023-10-08T12:00:20.600498+0000","last_unstale":"2023-10-08T12:00:21.598994+0000","last_undegraded":"2023-10-08T12:00:21.598994+0000","last_fullsized":"2023-10-08T12:00:21.598994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:54:07.447661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855469+0000","last_change":"2023-10-08T12:00:20.591739+0000","last_active":"2023-10-08T12:00:21.855469+0000","last_peered":"2023-10-08T12:00:21.855469+0000","last_clean":"2023-10-08T12:00:21.855469+0000","last_became_active":"2023-10-08T12:00:20.591277+0000","last_became_peered":"2023-10-08T12:00:20.591277+0000","last_unstale":"2023-10-08T12:00:21.855469+0000","last_undegraded":"2023-10-08T12:00:21.855469+0000","last_fullsized":"2023-10-08T12:00:21.855469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:54:25.498802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.602411+0000","last_change":"2023-10-08T12:00:20.595788+0000","last_active":"2023-10-08T12:00:21.602411+0000","last_peered":"2023-10-08T12:00:21.602411+0000","last_clean":"2023-10-08T12:00:21.602411+0000","last_became_active":"2023-10-08T12:00:20.595025+0000","last_became_peered":"2023-10-08T12:00:20.595025+0000","last_unstale":"2023-10-08T12:00:21.602411+0000","last_undegraded":"2023-10-08T12:00:21.602411+0000","last_fullsized":"2023-10-08T12:00:21.602411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:17:42.290460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.631819+0000","last_change":"2023-10-08T12:00:20.625363+0000","last_active":"2023-10-08T12:00:21.631819+0000","last_peered":"2023-10-08T12:00:21.631819+0000","last_clean":"2023-10-08T12:00:21.631819+0000","last_became_active":"2023-10-08T12:00:20.623270+0000","last_became_peered":"2023-10-08T12:00:20.623270+0000","last_unstale":"2023-10-08T12:00:21.631819+0000","last_undegraded":"2023-10-08T12:00:21.631819+0000","last_fullsized":"2023-10-08T12:00:21.631819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:53:47.853039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.602599+0000","last_change":"2023-10-08T12:00:20.600868+0000","last_active":"2023-10-08T12:00:21.602599+0000","last_peered":"2023-10-08T12:00:21.602599+0000","last_clean":"2023-10-08T12:00:21.602599+0000","last_became_active":"2023-10-08T12:00:20.600160+0000","last_became_peered":"2023-10-08T12:00:20.600160+0000","last_unstale":"2023-10-08T12:00:21.602599+0000","last_undegraded":"2023-10-08T12:00:21.602599+0000","last_fullsized":"2023-10-08T12:00:21.602599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:57:40.359987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.631537+0000","last_change":"2023-10-08T12:00:20.625181+0000","last_active":"2023-10-08T12:00:21.631537+0000","last_peered":"2023-10-08T12:00:21.631537+0000","last_clean":"2023-10-08T12:00:21.631537+0000","last_became_active":"2023-10-08T12:00:20.623344+0000","last_became_peered":"2023-10-08T12:00:20.623344+0000","last_unstale":"2023-10-08T12:00:21.631537+0000","last_undegraded":"2023-10-08T12:00:21.631537+0000","last_fullsized":"2023-10-08T12:00:21.631537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:17:42.290460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855227+0000","last_change":"2023-10-08T12:00:20.594960+0000","last_active":"2023-10-08T12:00:21.855227+0000","last_peered":"2023-10-08T12:00:21.855227+0000","last_clean":"2023-10-08T12:00:21.855227+0000","last_became_active":"2023-10-08T12:00:20.594580+0000","last_became_peered":"2023-10-08T12:00:20.594580+0000","last_unstale":"2023-10-08T12:00:21.855227+0000","last_undegraded":"2023-10-08T12:00:21.855227+0000","last_fullsized":"2023-10-08T12:00:21.855227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:10:09.509770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.632479+0000","last_change":"2023-10-08T12:00:20.625978+0000","last_active":"2023-10-08T12:00:21.632479+0000","last_peered":"2023-10-08T12:00:21.632479+0000","last_clean":"2023-10-08T12:00:21.632479+0000","last_became_active":"2023-10-08T12:00:20.624917+0000","last_became_peered":"2023-10-08T12:00:20.624917+0000","last_unstale":"2023-10-08T12:00:21.632479+0000","last_undegraded":"2023-10-08T12:00:21.632479+0000","last_fullsized":"2023-10-08T12:00:21.632479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:11:56.311548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855967+0000","last_change":"2023-10-08T12:00:20.613419+0000","last_active":"2023-10-08T12:00:21.855967+0000","last_peered":"2023-10-08T12:00:21.855967+0000","last_clean":"2023-10-08T12:00:21.855967+0000","last_became_active":"2023-10-08T12:00:20.612588+0000","last_became_peered":"2023-10-08T12:00:20.612588+0000","last_unstale":"2023-10-08T12:00:21.855967+0000","last_undegraded":"2023-10-08T12:00:21.855967+0000","last_fullsized":"2023-10-08T12:00:21.855967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:54:07.447661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855739+0000","last_change":"2023-10-08T12:00:20.614307+0000","last_active":"2023-10-08T12:00:21.855739+0000","last_peered":"2023-10-08T12:00:21.855739+0000","last_clean":"2023-10-08T12:00:21.855739+0000","last_became_active":"2023-10-08T12:00:20.613632+0000","last_became_peered":"2023-10-08T12:00:20.613632+0000","last_unstale":"2023-10-08T12:00:21.855739+0000","last_undegraded":"2023-10-08T12:00:21.855739+0000","last_fullsized":"2023-10-08T12:00:21.855739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:54:25.498802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.602167+0000","last_change":"2023-10-08T12:00:20.615632+0000","last_active":"2023-10-08T12:00:21.602167+0000","last_peered":"2023-10-08T12:00:21.602167+0000","last_clean":"2023-10-08T12:00:21.602167+0000","last_became_active":"2023-10-08T12:00:20.615011+0000","last_became_peered":"2023-10-08T12:00:20.615011+0000","last_unstale":"2023-10-08T12:00:21.602167+0000","last_undegraded":"2023-10-08T12:00:21.602167+0000","last_fullsized":"2023-10-08T12:00:21.602167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:03:28.440799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.856538+0000","last_change":"2023-10-08T12:00:20.621730+0000","last_active":"2023-10-08T12:00:21.856538+0000","last_peered":"2023-10-08T12:00:21.856538+0000","last_clean":"2023-10-08T12:00:21.856538+0000","last_became_active":"2023-10-08T12:00:20.621145+0000","last_became_peered":"2023-10-08T12:00:20.621145+0000","last_unstale":"2023-10-08T12:00:21.856538+0000","last_undegraded":"2023-10-08T12:00:21.856538+0000","last_fullsized":"2023-10-08T12:00:21.856538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:54:07.447661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.854760+0000","last_change":"2023-10-08T12:00:20.590571+0000","last_active":"2023-10-08T12:00:21.854760+0000","last_peered":"2023-10-08T12:00:21.854760+0000","last_clean":"2023-10-08T12:00:21.854760+0000","last_became_active":"2023-10-08T12:00:20.590216+0000","last_became_peered":"2023-10-08T12:00:20.590216+0000","last_unstale":"2023-10-08T12:00:21.854760+0000","last_undegraded":"2023-10-08T12:00:21.854760+0000","last_fullsized":"2023-10-08T12:00:21.854760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:58:37.629058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.598733+0000","last_change":"2023-10-08T12:00:20.609487+0000","last_active":"2023-10-08T12:00:21.598733+0000","last_peered":"2023-10-08T12:00:21.598733+0000","last_clean":"2023-10-08T12:00:21.598733+0000","last_became_active":"2023-10-08T12:00:20.609198+0000","last_became_peered":"2023-10-08T12:00:20.609198+0000","last_unstale":"2023-10-08T12:00:21.598733+0000","last_undegraded":"2023-10-08T12:00:21.598733+0000","last_fullsized":"2023-10-08T12:00:21.598733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:22:42.527070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.601660+0000","last_change":"2023-10-08T12:00:20.605444+0000","last_active":"2023-10-08T12:00:21.601660+0000","last_peered":"2023-10-08T12:00:21.601660+0000","last_clean":"2023-10-08T12:00:21.601660+0000","last_became_active":"2023-10-08T12:00:20.604696+0000","last_became_peered":"2023-10-08T12:00:20.604696+0000","last_unstale":"2023-10-08T12:00:21.601660+0000","last_undegraded":"2023-10-08T12:00:21.601660+0000","last_fullsized":"2023-10-08T12:00:21.601660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:46:22.522999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.604436+0000","last_change":"2023-10-08T12:00:20.626616+0000","last_active":"2023-10-08T12:00:21.604436+0000","last_peered":"2023-10-08T12:00:21.604436+0000","last_clean":"2023-10-08T12:00:21.604436+0000","last_became_active":"2023-10-08T12:00:20.626042+0000","last_became_peered":"2023-10-08T12:00:20.626042+0000","last_unstale":"2023-10-08T12:00:21.604436+0000","last_undegraded":"2023-10-08T12:00:21.604436+0000","last_fullsized":"2023-10-08T12:00:21.604436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:11:56.311548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.640507+0000","last_change":"2023-10-08T12:00:20.621413+0000","last_active":"2023-10-08T12:00:21.640507+0000","last_peered":"2023-10-08T12:00:21.640507+0000","last_clean":"2023-10-08T12:00:21.640507+0000","last_became_active":"2023-10-08T12:00:20.621169+0000","last_became_peered":"2023-10-08T12:00:20.621169+0000","last_unstale":"2023-10-08T12:00:21.640507+0000","last_undegraded":"2023-10-08T12:00:21.640507+0000","last_fullsized":"2023-10-08T12:00:21.640507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:03:28.440799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.632631+0000","last_change":"2023-10-08T12:00:20.627431+0000","last_active":"2023-10-08T12:00:21.632631+0000","last_peered":"2023-10-08T12:00:21.632631+0000","last_clean":"2023-10-08T12:00:21.632631+0000","last_became_active":"2023-10-08T12:00:20.624730+0000","last_became_peered":"2023-10-08T12:00:20.624730+0000","last_unstale":"2023-10-08T12:00:21.632631+0000","last_undegraded":"2023-10-08T12:00:21.632631+0000","last_fullsized":"2023-10-08T12:00:21.632631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:22:34.137787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855624+0000","last_change":"2023-10-08T12:00:20.620364+0000","last_active":"2023-10-08T12:00:21.855624+0000","last_peered":"2023-10-08T12:00:21.855624+0000","last_clean":"2023-10-08T12:00:21.855624+0000","last_became_active":"2023-10-08T12:00:20.619755+0000","last_became_peered":"2023-10-08T12:00:20.619755+0000","last_unstale":"2023-10-08T12:00:21.855624+0000","last_undegraded":"2023-10-08T12:00:21.855624+0000","last_fullsized":"2023-10-08T12:00:21.855624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:42:54.801760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855087+0000","last_change":"2023-10-08T12:00:20.623340+0000","last_active":"2023-10-08T12:00:21.855087+0000","last_peered":"2023-10-08T12:00:21.855087+0000","last_clean":"2023-10-08T12:00:21.855087+0000","last_became_active":"2023-10-08T12:00:20.623038+0000","last_became_peered":"2023-10-08T12:00:20.623038+0000","last_unstale":"2023-10-08T12:00:21.855087+0000","last_undegraded":"2023-10-08T12:00:21.855087+0000","last_fullsized":"2023-10-08T12:00:21.855087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:06:51.286457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.602856+0000","last_change":"2023-10-08T12:00:20.627019+0000","last_active":"2023-10-08T12:00:21.602856+0000","last_peered":"2023-10-08T12:00:21.602856+0000","last_clean":"2023-10-08T12:00:21.602856+0000","last_became_active":"2023-10-08T12:00:20.626509+0000","last_became_peered":"2023-10-08T12:00:20.626509+0000","last_unstale":"2023-10-08T12:00:21.602856+0000","last_undegraded":"2023-10-08T12:00:21.602856+0000","last_fullsized":"2023-10-08T12:00:21.602856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:30:47.199431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.856085+0000","last_change":"2023-10-08T12:00:20.608919+0000","last_active":"2023-10-08T12:00:21.856085+0000","last_peered":"2023-10-08T12:00:21.856085+0000","last_clean":"2023-10-08T12:00:21.856085+0000","last_became_active":"2023-10-08T12:00:20.608477+0000","last_became_peered":"2023-10-08T12:00:20.608477+0000","last_unstale":"2023-10-08T12:00:21.856085+0000","last_undegraded":"2023-10-08T12:00:21.856085+0000","last_fullsized":"2023-10-08T12:00:21.856085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:42:54.801760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.601997+0000","last_change":"2023-10-08T12:00:20.590431+0000","last_active":"2023-10-08T12:00:21.601997+0000","last_peered":"2023-10-08T12:00:21.601997+0000","last_clean":"2023-10-08T12:00:21.601997+0000","last_became_active":"2023-10-08T12:00:20.589585+0000","last_became_peered":"2023-10-08T12:00:20.589585+0000","last_unstale":"2023-10-08T12:00:21.601997+0000","last_undegraded":"2023-10-08T12:00:21.601997+0000","last_fullsized":"2023-10-08T12:00:21.601997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:55:19.542748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.856733+0000","last_change":"2023-10-08T12:00:20.603260+0000","last_active":"2023-10-08T12:00:21.856733+0000","last_peered":"2023-10-08T12:00:21.856733+0000","last_clean":"2023-10-08T12:00:21.856733+0000","last_became_active":"2023-10-08T12:00:20.602872+0000","last_became_peered":"2023-10-08T12:00:20.602872+0000","last_unstale":"2023-10-08T12:00:21.856733+0000","last_undegraded":"2023-10-08T12:00:21.856733+0000","last_fullsized":"2023-10-08T12:00:21.856733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:17:42.290460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.856070+0000","last_change":"2023-10-08T12:00:20.624667+0000","last_active":"2023-10-08T12:00:21.856070+0000","last_peered":"2023-10-08T12:00:21.856070+0000","last_clean":"2023-10-08T12:00:21.856070+0000","last_became_active":"2023-10-08T12:00:20.624080+0000","last_became_peered":"2023-10-08T12:00:20.624080+0000","last_unstale":"2023-10-08T12:00:21.856070+0000","last_undegraded":"2023-10-08T12:00:21.856070+0000","last_fullsized":"2023-10-08T12:00:21.856070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:46:22.522999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.599492+0000","last_change":"2023-10-08T12:00:20.606784+0000","last_active":"2023-10-08T12:00:21.599492+0000","last_peered":"2023-10-08T12:00:21.599492+0000","last_clean":"2023-10-08T12:00:21.599492+0000","last_became_active":"2023-10-08T12:00:20.606415+0000","last_became_peered":"2023-10-08T12:00:20.606415+0000","last_unstale":"2023-10-08T12:00:21.599492+0000","last_undegraded":"2023-10-08T12:00:21.599492+0000","last_fullsized":"2023-10-08T12:00:21.599492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:55:19.542748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.856912+0000","last_change":"2023-10-08T12:00:20.619158+0000","last_active":"2023-10-08T12:00:21.856912+0000","last_peered":"2023-10-08T12:00:21.856912+0000","last_clean":"2023-10-08T12:00:21.856912+0000","last_became_active":"2023-10-08T12:00:20.618857+0000","last_became_peered":"2023-10-08T12:00:20.618857+0000","last_unstale":"2023-10-08T12:00:21.856912+0000","last_undegraded":"2023-10-08T12:00:21.856912+0000","last_fullsized":"2023-10-08T12:00:21.856912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:57:40.359987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855238+0000","last_change":"2023-10-08T12:00:20.601375+0000","last_active":"2023-10-08T12:00:21.855238+0000","last_peered":"2023-10-08T12:00:21.855238+0000","last_clean":"2023-10-08T12:00:21.855238+0000","last_became_active":"2023-10-08T12:00:20.600980+0000","last_became_peered":"2023-10-08T12:00:20.600980+0000","last_unstale":"2023-10-08T12:00:21.855238+0000","last_undegraded":"2023-10-08T12:00:21.855238+0000","last_fullsized":"2023-10-08T12:00:21.855238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:30:14.921064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.603029+0000","last_change":"2023-10-08T12:00:20.608122+0000","last_active":"2023-10-08T12:00:21.603029+0000","last_peered":"2023-10-08T12:00:21.603029+0000","last_clean":"2023-10-08T12:00:21.603029+0000","last_became_active":"2023-10-08T12:00:20.603444+0000","last_became_peered":"2023-10-08T12:00:20.603444+0000","last_unstale":"2023-10-08T12:00:21.603029+0000","last_undegraded":"2023-10-08T12:00:21.603029+0000","last_fullsized":"2023-10-08T12:00:21.603029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:42:51.152070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.640418+0000","last_change":"2023-10-08T12:00:20.604312+0000","last_active":"2023-10-08T12:00:21.640418+0000","last_peered":"2023-10-08T12:00:21.640418+0000","last_clean":"2023-10-08T12:00:21.640418+0000","last_became_active":"2023-10-08T12:00:20.603285+0000","last_became_peered":"2023-10-08T12:00:20.603285+0000","last_unstale":"2023-10-08T12:00:21.640418+0000","last_undegraded":"2023-10-08T12:00:21.640418+0000","last_fullsized":"2023-10-08T12:00:21.640418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:27:04.539065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855353+0000","last_change":"2023-10-08T12:00:20.604806+0000","last_active":"2023-10-08T12:00:21.855353+0000","last_peered":"2023-10-08T12:00:21.855353+0000","last_clean":"2023-10-08T12:00:21.855353+0000","last_became_active":"2023-10-08T12:00:20.602679+0000","last_became_peered":"2023-10-08T12:00:20.602679+0000","last_unstale":"2023-10-08T12:00:21.855353+0000","last_undegraded":"2023-10-08T12:00:21.855353+0000","last_fullsized":"2023-10-08T12:00:21.855353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:10:09.509770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.601550+0000","last_change":"2023-10-08T12:00:20.587095+0000","last_active":"2023-10-08T12:00:21.601550+0000","last_peered":"2023-10-08T12:00:21.601550+0000","last_clean":"2023-10-08T12:00:21.601550+0000","last_became_active":"2023-10-08T12:00:20.586374+0000","last_became_peered":"2023-10-08T12:00:20.586374+0000","last_unstale":"2023-10-08T12:00:21.601550+0000","last_undegraded":"2023-10-08T12:00:21.601550+0000","last_fullsized":"2023-10-08T12:00:21.601550+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:37:45.357564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.856807+0000","last_change":"2023-10-08T12:00:19.547119+0000","last_active":"2023-10-08T12:00:21.856807+0000","last_peered":"2023-10-08T12:00:21.856807+0000","last_clean":"2023-10-08T12:00:21.856807+0000","last_became_active":"2023-10-08T12:00:19.546721+0000","last_became_peered":"2023-10-08T12:00:19.546721+0000","last_unstale":"2023-10-08T12:00:21.856807+0000","last_undegraded":"2023-10-08T12:00:21.856807+0000","last_fullsized":"2023-10-08T12:00:21.856807+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:58:36.625035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855308+0000","last_change":"2023-10-08T12:00:20.587928+0000","last_active":"2023-10-08T12:00:21.855308+0000","last_peered":"2023-10-08T12:00:21.855308+0000","last_clean":"2023-10-08T12:00:21.855308+0000","last_became_active":"2023-10-08T12:00:20.587195+0000","last_became_peered":"2023-10-08T12:00:20.587195+0000","last_unstale":"2023-10-08T12:00:21.855308+0000","last_undegraded":"2023-10-08T12:00:21.855308+0000","last_fullsized":"2023-10-08T12:00:21.855308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:22:42.527070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855483+0000","last_change":"2023-10-08T12:00:19.544794+0000","last_active":"2023-10-08T12:00:21.855483+0000","last_peered":"2023-10-08T12:00:21.855483+0000","last_clean":"2023-10-08T12:00:21.855483+0000","last_became_active":"2023-10-08T12:00:19.544159+0000","last_became_peered":"2023-10-08T12:00:19.544159+0000","last_unstale":"2023-10-08T12:00:21.855483+0000","last_undegraded":"2023-10-08T12:00:21.855483+0000","last_fullsized":"2023-10-08T12:00:21.855483+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:03:27.436776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.856316+0000","last_change":"2023-10-08T12:00:19.533572+0000","last_active":"2023-10-08T12:00:21.856316+0000","last_peered":"2023-10-08T12:00:21.856316+0000","last_clean":"2023-10-08T12:00:21.856316+0000","last_became_active":"2023-10-08T12:00:19.533122+0000","last_became_peered":"2023-10-08T12:00:19.533122+0000","last_unstale":"2023-10-08T12:00:21.856316+0000","last_undegraded":"2023-10-08T12:00:21.856316+0000","last_fullsized":"2023-10-08T12:00:21.856316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:45:15.530667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855898+0000","last_change":"2023-10-08T12:00:20.600857+0000","last_active":"2023-10-08T12:00:21.855898+0000","last_peered":"2023-10-08T12:00:21.855898+0000","last_clean":"2023-10-08T12:00:21.855898+0000","last_became_active":"2023-10-08T12:00:20.600486+0000","last_became_peered":"2023-10-08T12:00:20.600486+0000","last_unstale":"2023-10-08T12:00:21.855898+0000","last_undegraded":"2023-10-08T12:00:21.855898+0000","last_fullsized":"2023-10-08T12:00:21.855898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:30:14.921064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.602215+0000","last_change":"2023-10-08T12:00:19.537352+0000","last_active":"2023-10-08T12:00:21.602215+0000","last_peered":"2023-10-08T12:00:21.602215+0000","last_clean":"2023-10-08T12:00:21.602215+0000","last_became_active":"2023-10-08T12:00:19.536451+0000","last_became_peered":"2023-10-08T12:00:19.536451+0000","last_unstale":"2023-10-08T12:00:21.602215+0000","last_undegraded":"2023-10-08T12:00:21.602215+0000","last_fullsized":"2023-10-08T12:00:21.602215+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:03:27.436776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.598788+0000","last_change":"2023-10-08T12:00:20.606398+0000","last_active":"2023-10-08T12:00:21.598788+0000","last_peered":"2023-10-08T12:00:21.598788+0000","last_clean":"2023-10-08T12:00:21.598788+0000","last_became_active":"2023-10-08T12:00:20.606065+0000","last_became_peered":"2023-10-08T12:00:20.606065+0000","last_unstale":"2023-10-08T12:00:21.598788+0000","last_undegraded":"2023-10-08T12:00:21.598788+0000","last_fullsized":"2023-10-08T12:00:21.598788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:42:54.801760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855996+0000","last_change":"2023-10-08T12:00:19.549304+0000","last_active":"2023-10-08T12:00:21.855996+0000","last_peered":"2023-10-08T12:00:21.855996+0000","last_clean":"2023-10-08T12:00:21.855996+0000","last_became_active":"2023-10-08T12:00:19.548656+0000","last_became_peered":"2023-10-08T12:00:19.548656+0000","last_unstale":"2023-10-08T12:00:21.855996+0000","last_undegraded":"2023-10-08T12:00:21.855996+0000","last_fullsized":"2023-10-08T12:00:21.855996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:37:27.924905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.603981+0000","last_change":"2023-10-08T12:00:20.626582+0000","last_active":"2023-10-08T12:00:21.603981+0000","last_peered":"2023-10-08T12:00:21.603981+0000","last_clean":"2023-10-08T12:00:21.603981+0000","last_became_active":"2023-10-08T12:00:20.626022+0000","last_became_peered":"2023-10-08T12:00:20.626022+0000","last_unstale":"2023-10-08T12:00:21.603981+0000","last_undegraded":"2023-10-08T12:00:21.603981+0000","last_fullsized":"2023-10-08T12:00:21.603981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:43:35.534698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.604190+0000","last_change":"2023-10-08T12:00:19.541832+0000","last_active":"2023-10-08T12:00:21.604190+0000","last_peered":"2023-10-08T12:00:21.604190+0000","last_clean":"2023-10-08T12:00:21.604190+0000","last_became_active":"2023-10-08T12:00:19.538528+0000","last_became_peered":"2023-10-08T12:00:19.538528+0000","last_unstale":"2023-10-08T12:00:21.604190+0000","last_undegraded":"2023-10-08T12:00:21.604190+0000","last_fullsized":"2023-10-08T12:00:21.604190+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:06:50.282434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855468+0000","last_change":"2023-10-08T12:00:20.586258+0000","last_active":"2023-10-08T12:00:21.855468+0000","last_peered":"2023-10-08T12:00:21.855468+0000","last_clean":"2023-10-08T12:00:21.855468+0000","last_became_active":"2023-10-08T12:00:20.585881+0000","last_became_peered":"2023-10-08T12:00:20.585881+0000","last_unstale":"2023-10-08T12:00:21.855468+0000","last_undegraded":"2023-10-08T12:00:21.855468+0000","last_fullsized":"2023-10-08T12:00:21.855468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:42:54.801760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.599480+0000","last_change":"2023-10-08T12:00:19.534608+0000","last_active":"2023-10-08T12:00:21.599480+0000","last_peered":"2023-10-08T12:00:21.599480+0000","last_clean":"2023-10-08T12:00:21.599480+0000","last_became_active":"2023-10-08T12:00:19.534194+0000","last_became_peered":"2023-10-08T12:00:19.534194+0000","last_unstale":"2023-10-08T12:00:21.599480+0000","last_undegraded":"2023-10-08T12:00:21.599480+0000","last_fullsized":"2023-10-08T12:00:21.599480+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:58:36.625035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.602490+0000","last_change":"2023-10-08T12:00:20.631795+0000","last_active":"2023-10-08T12:00:21.602490+0000","last_peered":"2023-10-08T12:00:21.602490+0000","last_clean":"2023-10-08T12:00:21.602490+0000","last_became_active":"2023-10-08T12:00:20.630218+0000","last_became_peered":"2023-10-08T12:00:20.630218+0000","last_unstale":"2023-10-08T12:00:21.602490+0000","last_undegraded":"2023-10-08T12:00:21.602490+0000","last_fullsized":"2023-10-08T12:00:21.602490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:37:28.928928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855668+0000","last_change":"2023-10-08T12:00:19.531553+0000","last_active":"2023-10-08T12:00:21.855668+0000","last_peered":"2023-10-08T12:00:21.855668+0000","last_clean":"2023-10-08T12:00:21.855668+0000","last_became_active":"2023-10-08T12:00:19.530408+0000","last_became_peered":"2023-10-08T12:00:19.530408+0000","last_unstale":"2023-10-08T12:00:21.855668+0000","last_undegraded":"2023-10-08T12:00:21.855668+0000","last_fullsized":"2023-10-08T12:00:21.855668+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:45:15.530667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.632040+0000","last_change":"2023-10-08T12:00:20.625311+0000","last_active":"2023-10-08T12:00:21.632040+0000","last_peered":"2023-10-08T12:00:21.632040+0000","last_clean":"2023-10-08T12:00:21.632040+0000","last_became_active":"2023-10-08T12:00:20.623142+0000","last_became_peered":"2023-10-08T12:00:20.623142+0000","last_unstale":"2023-10-08T12:00:21.632040+0000","last_undegraded":"2023-10-08T12:00:21.632040+0000","last_fullsized":"2023-10-08T12:00:21.632040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:08:02.997033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855519+0000","last_change":"2023-10-08T12:00:19.536104+0000","last_active":"2023-10-08T12:00:21.855519+0000","last_peered":"2023-10-08T12:00:21.855519+0000","last_clean":"2023-10-08T12:00:21.855519+0000","last_became_active":"2023-10-08T12:00:19.535651+0000","last_became_peered":"2023-10-08T12:00:19.535651+0000","last_unstale":"2023-10-08T12:00:21.855519+0000","last_undegraded":"2023-10-08T12:00:21.855519+0000","last_fullsized":"2023-10-08T12:00:21.855519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:50:34.635731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855128+0000","last_change":"2023-10-08T12:00:20.598434+0000","last_active":"2023-10-08T12:00:21.855128+0000","last_peered":"2023-10-08T12:00:21.855128+0000","last_clean":"2023-10-08T12:00:21.855128+0000","last_became_active":"2023-10-08T12:00:20.598046+0000","last_became_peered":"2023-10-08T12:00:20.598046+0000","last_unstale":"2023-10-08T12:00:21.855128+0000","last_undegraded":"2023-10-08T12:00:21.855128+0000","last_fullsized":"2023-10-08T12:00:21.855128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:10:09.509770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.603141+0000","last_change":"2023-10-08T12:00:19.522917+0000","last_active":"2023-10-08T12:00:21.603141+0000","last_peered":"2023-10-08T12:00:21.603141+0000","last_clean":"2023-10-08T12:00:21.603141+0000","last_became_active":"2023-10-08T12:00:19.522172+0000","last_became_peered":"2023-10-08T12:00:19.522172+0000","last_unstale":"2023-10-08T12:00:21.603141+0000","last_undegraded":"2023-10-08T12:00:21.603141+0000","last_fullsized":"2023-10-08T12:00:21.603141+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:51:26.897821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.632418+0000","last_change":"2023-10-08T12:00:20.626570+0000","last_active":"2023-10-08T12:00:21.632418+0000","last_peered":"2023-10-08T12:00:21.632418+0000","last_clean":"2023-10-08T12:00:21.632418+0000","last_became_active":"2023-10-08T12:00:20.625928+0000","last_became_peered":"2023-10-08T12:00:20.625928+0000","last_unstale":"2023-10-08T12:00:21.632418+0000","last_undegraded":"2023-10-08T12:00:21.632418+0000","last_fullsized":"2023-10-08T12:00:21.632418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:30:47.199431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855385+0000","last_change":"2023-10-08T12:00:19.545158+0000","last_active":"2023-10-08T12:00:21.855385+0000","last_peered":"2023-10-08T12:00:21.855385+0000","last_clean":"2023-10-08T12:00:21.855385+0000","last_became_active":"2023-10-08T12:00:19.544490+0000","last_became_peered":"2023-10-08T12:00:19.544490+0000","last_unstale":"2023-10-08T12:00:21.855385+0000","last_undegraded":"2023-10-08T12:00:21.855385+0000","last_fullsized":"2023-10-08T12:00:21.855385+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:27:03.535042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855412+0000","last_change":"2023-10-08T12:00:20.602776+0000","last_active":"2023-10-08T12:00:21.855412+0000","last_peered":"2023-10-08T12:00:21.855412+0000","last_clean":"2023-10-08T12:00:21.855412+0000","last_became_active":"2023-10-08T12:00:20.601726+0000","last_became_peered":"2023-10-08T12:00:20.601726+0000","last_unstale":"2023-10-08T12:00:21.855412+0000","last_undegraded":"2023-10-08T12:00:21.855412+0000","last_fullsized":"2023-10-08T12:00:21.855412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:30:14.921064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.640174+0000","last_change":"2023-10-08T12:00:19.525010+0000","last_active":"2023-10-08T12:00:21.640174+0000","last_peered":"2023-10-08T12:00:21.640174+0000","last_clean":"2023-10-08T12:00:21.640174+0000","last_became_active":"2023-10-08T12:00:19.524689+0000","last_became_peered":"2023-10-08T12:00:19.524689+0000","last_unstale":"2023-10-08T12:00:21.640174+0000","last_undegraded":"2023-10-08T12:00:21.640174+0000","last_fullsized":"2023-10-08T12:00:21.640174+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:39:17.089135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.631709+0000","last_change":"2023-10-08T12:00:20.624644+0000","last_active":"2023-10-08T12:00:21.631709+0000","last_peered":"2023-10-08T12:00:21.631709+0000","last_clean":"2023-10-08T12:00:21.631709+0000","last_became_active":"2023-10-08T12:00:20.623936+0000","last_became_peered":"2023-10-08T12:00:20.623936+0000","last_unstale":"2023-10-08T12:00:21.631709+0000","last_undegraded":"2023-10-08T12:00:21.631709+0000","last_fullsized":"2023-10-08T12:00:21.631709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:57:40.359987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.602477+0000","last_change":"2023-10-08T12:00:19.525128+0000","last_active":"2023-10-08T12:00:21.602477+0000","last_peered":"2023-10-08T12:00:21.602477+0000","last_clean":"2023-10-08T12:00:21.602477+0000","last_became_active":"2023-10-08T12:00:19.524428+0000","last_became_peered":"2023-10-08T12:00:19.524428+0000","last_unstale":"2023-10-08T12:00:21.602477+0000","last_undegraded":"2023-10-08T12:00:21.602477+0000","last_fullsized":"2023-10-08T12:00:21.602477+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:28:30.235998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.632464+0000","last_change":"2023-10-08T12:00:20.624158+0000","last_active":"2023-10-08T12:00:21.632464+0000","last_peered":"2023-10-08T12:00:21.632464+0000","last_clean":"2023-10-08T12:00:21.632464+0000","last_became_active":"2023-10-08T12:00:20.623663+0000","last_became_peered":"2023-10-08T12:00:20.623663+0000","last_unstale":"2023-10-08T12:00:21.632464+0000","last_undegraded":"2023-10-08T12:00:21.632464+0000","last_fullsized":"2023-10-08T12:00:21.632464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:35:25.862808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.640474+0000","last_change":"2023-10-08T12:00:19.521327+0000","last_active":"2023-10-08T12:00:21.640474+0000","last_peered":"2023-10-08T12:00:21.640474+0000","last_clean":"2023-10-08T12:00:21.640474+0000","last_became_active":"2023-10-08T12:00:19.520907+0000","last_became_peered":"2023-10-08T12:00:19.520907+0000","last_unstale":"2023-10-08T12:00:21.640474+0000","last_undegraded":"2023-10-08T12:00:21.640474+0000","last_fullsized":"2023-10-08T12:00:21.640474+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:17:52.345672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.632767+0000","last_change":"2023-10-08T12:00:20.631419+0000","last_active":"2023-10-08T12:00:21.632767+0000","last_peered":"2023-10-08T12:00:21.632767+0000","last_clean":"2023-10-08T12:00:21.632767+0000","last_became_active":"2023-10-08T12:00:20.630933+0000","last_became_peered":"2023-10-08T12:00:20.630933+0000","last_unstale":"2023-10-08T12:00:21.632767+0000","last_undegraded":"2023-10-08T12:00:21.632767+0000","last_fullsized":"2023-10-08T12:00:21.632767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:23:03.900263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.599639+0000","last_change":"2023-10-08T12:00:19.535778+0000","last_active":"2023-10-08T12:00:21.599639+0000","last_peered":"2023-10-08T12:00:21.599639+0000","last_clean":"2023-10-08T12:00:21.599639+0000","last_became_active":"2023-10-08T12:00:19.535463+0000","last_became_peered":"2023-10-08T12:00:19.535463+0000","last_unstale":"2023-10-08T12:00:21.599639+0000","last_undegraded":"2023-10-08T12:00:21.599639+0000","last_fullsized":"2023-10-08T12:00:21.599639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:06:50.282434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.602845+0000","last_change":"2023-10-08T12:00:20.590511+0000","last_active":"2023-10-08T12:00:21.602845+0000","last_peered":"2023-10-08T12:00:21.602845+0000","last_clean":"2023-10-08T12:00:21.602845+0000","last_became_active":"2023-10-08T12:00:20.589762+0000","last_became_peered":"2023-10-08T12:00:20.589762+0000","last_unstale":"2023-10-08T12:00:21.602845+0000","last_undegraded":"2023-10-08T12:00:21.602845+0000","last_fullsized":"2023-10-08T12:00:21.602845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:08:02.997033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.640487+0000","last_change":"2023-10-08T12:00:19.530223+0000","last_active":"2023-10-08T12:00:21.640487+0000","last_peered":"2023-10-08T12:00:21.640487+0000","last_clean":"2023-10-08T12:00:21.640487+0000","last_became_active":"2023-10-08T12:00:19.529830+0000","last_became_peered":"2023-10-08T12:00:19.529830+0000","last_unstale":"2023-10-08T12:00:21.640487+0000","last_undegraded":"2023-10-08T12:00:21.640487+0000","last_fullsized":"2023-10-08T12:00:21.640487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:47:56.523501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.632457+0000","last_change":"2023-10-08T12:00:20.626826+0000","last_active":"2023-10-08T12:00:21.632457+0000","last_peered":"2023-10-08T12:00:21.632457+0000","last_clean":"2023-10-08T12:00:21.632457+0000","last_became_active":"2023-10-08T12:00:20.624034+0000","last_became_peered":"2023-10-08T12:00:20.624034+0000","last_unstale":"2023-10-08T12:00:21.632457+0000","last_undegraded":"2023-10-08T12:00:21.632457+0000","last_fullsized":"2023-10-08T12:00:21.632457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:42:51.152070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:00:20.587986+0000","last_change":"2023-10-08T12:00:08.887559+0000","last_active":"2023-10-08T12:00:20.587986+0000","last_peered":"2023-10-08T12:00:20.587986+0000","last_clean":"2023-10-08T12:00:20.587986+0000","last_became_active":"2023-10-08T12:00:08.884794+0000","last_became_peered":"2023-10-08T12:00:08.884794+0000","last_unstale":"2023-10-08T12:00:20.587986+0000","last_undegraded":"2023-10-08T12:00:20.587986+0000","last_fullsized":"2023-10-08T12:00:20.587986+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:07.812869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:07.812869+0000","last_clean_scrub_stamp":"2023-10-08T12:00:07.812869+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:58:36.123159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.603377+0000","last_change":"2023-10-08T12:00:19.524401+0000","last_active":"2023-10-08T12:00:21.603377+0000","last_peered":"2023-10-08T12:00:21.603377+0000","last_clean":"2023-10-08T12:00:21.603377+0000","last_became_active":"2023-10-08T12:00:19.523604+0000","last_became_peered":"2023-10-08T12:00:19.523604+0000","last_unstale":"2023-10-08T12:00:21.603377+0000","last_undegraded":"2023-10-08T12:00:21.603377+0000","last_fullsized":"2023-10-08T12:00:21.603377+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:10:08.505747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.856444+0000","last_change":"2023-10-08T12:00:20.605554+0000","last_active":"2023-10-08T12:00:21.856444+0000","last_peered":"2023-10-08T12:00:21.856444+0000","last_clean":"2023-10-08T12:00:21.856444+0000","last_became_active":"2023-10-08T12:00:20.604329+0000","last_became_peered":"2023-10-08T12:00:20.604329+0000","last_unstale":"2023-10-08T12:00:21.856444+0000","last_undegraded":"2023-10-08T12:00:21.856444+0000","last_fullsized":"2023-10-08T12:00:21.856444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:54:25.498802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.631264+0000","last_change":"2023-10-08T12:00:19.552974+0000","last_active":"2023-10-08T12:00:21.631264+0000","last_peered":"2023-10-08T12:00:21.631264+0000","last_clean":"2023-10-08T12:00:21.631264+0000","last_became_active":"2023-10-08T12:00:19.552408+0000","last_became_peered":"2023-10-08T12:00:19.552408+0000","last_unstale":"2023-10-08T12:00:21.631264+0000","last_undegraded":"2023-10-08T12:00:21.631264+0000","last_fullsized":"2023-10-08T12:00:21.631264+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:37:44.353541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.854532+0000","last_change":"2023-10-08T12:00:20.609466+0000","last_active":"2023-10-08T12:00:21.854532+0000","last_peered":"2023-10-08T12:00:21.854532+0000","last_clean":"2023-10-08T12:00:21.854532+0000","last_became_active":"2023-10-08T12:00:20.609116+0000","last_became_peered":"2023-10-08T12:00:20.609116+0000","last_unstale":"2023-10-08T12:00:21.854532+0000","last_undegraded":"2023-10-08T12:00:21.854532+0000","last_fullsized":"2023-10-08T12:00:21.854532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:51:27.901843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.640292+0000","last_change":"2023-10-08T12:00:19.520729+0000","last_active":"2023-10-08T12:00:21.640292+0000","last_peered":"2023-10-08T12:00:21.640292+0000","last_clean":"2023-10-08T12:00:21.640292+0000","last_became_active":"2023-10-08T12:00:19.520254+0000","last_became_peered":"2023-10-08T12:00:19.520254+0000","last_unstale":"2023-10-08T12:00:21.640292+0000","last_undegraded":"2023-10-08T12:00:21.640292+0000","last_fullsized":"2023-10-08T12:00:21.640292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:50:34.635731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.598860+0000","last_change":"2023-10-08T12:00:20.591873+0000","last_active":"2023-10-08T12:00:21.598860+0000","last_peered":"2023-10-08T12:00:21.598860+0000","last_clean":"2023-10-08T12:00:21.598860+0000","last_became_active":"2023-10-08T12:00:20.591431+0000","last_became_peered":"2023-10-08T12:00:20.591431+0000","last_unstale":"2023-10-08T12:00:21.598860+0000","last_undegraded":"2023-10-08T12:00:21.598860+0000","last_fullsized":"2023-10-08T12:00:21.598860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:54:25.498802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.603246+0000","last_change":"2023-10-08T12:00:19.530940+0000","last_active":"2023-10-08T12:00:21.603246+0000","last_peered":"2023-10-08T12:00:21.603246+0000","last_clean":"2023-10-08T12:00:21.603246+0000","last_became_active":"2023-10-08T12:00:19.530216+0000","last_became_peered":"2023-10-08T12:00:19.530216+0000","last_unstale":"2023-10-08T12:00:21.603246+0000","last_undegraded":"2023-10-08T12:00:21.603246+0000","last_fullsized":"2023-10-08T12:00:21.603246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:45:15.530667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.602773+0000","last_change":"2023-10-08T12:00:20.584188+0000","last_active":"2023-10-08T12:00:21.602773+0000","last_peered":"2023-10-08T12:00:21.602773+0000","last_clean":"2023-10-08T12:00:21.602773+0000","last_became_active":"2023-10-08T12:00:20.583209+0000","last_became_peered":"2023-10-08T12:00:20.583209+0000","last_unstale":"2023-10-08T12:00:21.602773+0000","last_undegraded":"2023-10-08T12:00:21.602773+0000","last_fullsized":"2023-10-08T12:00:21.602773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:51:27.901843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.599342+0000","last_change":"2023-10-08T12:00:19.525924+0000","last_active":"2023-10-08T12:00:21.599342+0000","last_peered":"2023-10-08T12:00:21.599342+0000","last_clean":"2023-10-08T12:00:21.599342+0000","last_became_active":"2023-10-08T12:00:19.525508+0000","last_became_peered":"2023-10-08T12:00:19.525508+0000","last_unstale":"2023-10-08T12:00:21.599342+0000","last_undegraded":"2023-10-08T12:00:21.599342+0000","last_fullsized":"2023-10-08T12:00:21.599342+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:51:26.897821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.604521+0000","last_change":"2023-10-08T12:00:20.591551+0000","last_active":"2023-10-08T12:00:21.604521+0000","last_peered":"2023-10-08T12:00:21.604521+0000","last_clean":"2023-10-08T12:00:21.604521+0000","last_became_active":"2023-10-08T12:00:20.589572+0000","last_became_peered":"2023-10-08T12:00:20.589572+0000","last_unstale":"2023-10-08T12:00:21.604521+0000","last_undegraded":"2023-10-08T12:00:21.604521+0000","last_fullsized":"2023-10-08T12:00:21.604521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:22:34.137787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.632679+0000","last_change":"2023-10-08T12:00:19.555017+0000","last_active":"2023-10-08T12:00:21.632679+0000","last_peered":"2023-10-08T12:00:21.632679+0000","last_clean":"2023-10-08T12:00:21.632679+0000","last_became_active":"2023-10-08T12:00:19.554451+0000","last_became_peered":"2023-10-08T12:00:19.554451+0000","last_unstale":"2023-10-08T12:00:21.632679+0000","last_undegraded":"2023-10-08T12:00:21.632679+0000","last_fullsized":"2023-10-08T12:00:21.632679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:54:06.443638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.599236+0000","last_change":"2023-10-08T12:00:20.595603+0000","last_active":"2023-10-08T12:00:21.599236+0000","last_peered":"2023-10-08T12:00:21.599236+0000","last_clean":"2023-10-08T12:00:21.599236+0000","last_became_active":"2023-10-08T12:00:20.595176+0000","last_became_peered":"2023-10-08T12:00:20.595176+0000","last_unstale":"2023-10-08T12:00:21.599236+0000","last_undegraded":"2023-10-08T12:00:21.599236+0000","last_fullsized":"2023-10-08T12:00:21.599236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:46:22.522999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.599108+0000","last_change":"2023-10-08T12:00:19.542919+0000","last_active":"2023-10-08T12:00:21.599108+0000","last_peered":"2023-10-08T12:00:21.599108+0000","last_clean":"2023-10-08T12:00:21.599108+0000","last_became_active":"2023-10-08T12:00:19.542518+0000","last_became_peered":"2023-10-08T12:00:19.542518+0000","last_unstale":"2023-10-08T12:00:21.599108+0000","last_undegraded":"2023-10-08T12:00:21.599108+0000","last_fullsized":"2023-10-08T12:00:21.599108+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:10:08.505747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.857089+0000","last_change":"2023-10-08T12:00:20.625910+0000","last_active":"2023-10-08T12:00:21.857089+0000","last_peered":"2023-10-08T12:00:21.857089+0000","last_clean":"2023-10-08T12:00:21.857089+0000","last_became_active":"2023-10-08T12:00:20.625608+0000","last_became_peered":"2023-10-08T12:00:20.625608+0000","last_unstale":"2023-10-08T12:00:21.857089+0000","last_undegraded":"2023-10-08T12:00:21.857089+0000","last_fullsized":"2023-10-08T12:00:21.857089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:53:47.853039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.856048+0000","last_change":"2023-10-08T12:00:19.553242+0000","last_active":"2023-10-08T12:00:21.856048+0000","last_peered":"2023-10-08T12:00:21.856048+0000","last_clean":"2023-10-08T12:00:21.856048+0000","last_became_active":"2023-10-08T12:00:19.552693+0000","last_became_peered":"2023-10-08T12:00:19.552693+0000","last_unstale":"2023-10-08T12:00:21.856048+0000","last_undegraded":"2023-10-08T12:00:21.856048+0000","last_fullsized":"2023-10-08T12:00:21.856048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:51:26.897821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855831+0000","last_change":"2023-10-08T12:00:20.591317+0000","last_active":"2023-10-08T12:00:21.855831+0000","last_peered":"2023-10-08T12:00:21.855831+0000","last_clean":"2023-10-08T12:00:21.855831+0000","last_became_active":"2023-10-08T12:00:20.591008+0000","last_became_peered":"2023-10-08T12:00:20.591008+0000","last_unstale":"2023-10-08T12:00:21.855831+0000","last_undegraded":"2023-10-08T12:00:21.855831+0000","last_fullsized":"2023-10-08T12:00:21.855831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:54:07.447661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.631260+0000","last_change":"2023-10-08T12:00:19.554635+0000","last_active":"2023-10-08T12:00:21.631260+0000","last_peered":"2023-10-08T12:00:21.631260+0000","last_clean":"2023-10-08T12:00:21.631260+0000","last_became_active":"2023-10-08T12:00:19.553990+0000","last_became_peered":"2023-10-08T12:00:19.553990+0000","last_unstale":"2023-10-08T12:00:21.631260+0000","last_undegraded":"2023-10-08T12:00:21.631260+0000","last_fullsized":"2023-10-08T12:00:21.631260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:50:34.635731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.601954+0000","last_change":"2023-10-08T12:00:20.596182+0000","last_active":"2023-10-08T12:00:21.601954+0000","last_peered":"2023-10-08T12:00:21.601954+0000","last_clean":"2023-10-08T12:00:21.601954+0000","last_became_active":"2023-10-08T12:00:20.595333+0000","last_became_peered":"2023-10-08T12:00:20.595333+0000","last_unstale":"2023-10-08T12:00:21.601954+0000","last_undegraded":"2023-10-08T12:00:21.601954+0000","last_fullsized":"2023-10-08T12:00:21.601954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:27:04.539065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.598828+0000","last_change":"2023-10-08T12:00:19.552883+0000","last_active":"2023-10-08T12:00:21.598828+0000","last_peered":"2023-10-08T12:00:21.598828+0000","last_clean":"2023-10-08T12:00:21.598828+0000","last_became_active":"2023-10-08T12:00:19.552343+0000","last_became_peered":"2023-10-08T12:00:19.552343+0000","last_unstale":"2023-10-08T12:00:21.598828+0000","last_undegraded":"2023-10-08T12:00:21.598828+0000","last_fullsized":"2023-10-08T12:00:21.598828+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:37:27.924905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855959+0000","last_change":"2023-10-08T12:00:20.593145+0000","last_active":"2023-10-08T12:00:21.855959+0000","last_peered":"2023-10-08T12:00:21.855959+0000","last_clean":"2023-10-08T12:00:21.855959+0000","last_became_active":"2023-10-08T12:00:20.592778+0000","last_became_peered":"2023-10-08T12:00:20.592778+0000","last_unstale":"2023-10-08T12:00:21.855959+0000","last_undegraded":"2023-10-08T12:00:21.855959+0000","last_fullsized":"2023-10-08T12:00:21.855959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:22:42.527070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.599800+0000","last_change":"2023-10-08T12:00:19.524846+0000","last_active":"2023-10-08T12:00:21.599800+0000","last_peered":"2023-10-08T12:00:21.599800+0000","last_clean":"2023-10-08T12:00:21.599800+0000","last_became_active":"2023-10-08T12:00:19.524431+0000","last_became_peered":"2023-10-08T12:00:19.524431+0000","last_unstale":"2023-10-08T12:00:21.599800+0000","last_undegraded":"2023-10-08T12:00:21.599800+0000","last_fullsized":"2023-10-08T12:00:21.599800+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:45:15.530667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.856621+0000","last_change":"2023-10-08T12:00:20.603921+0000","last_active":"2023-10-08T12:00:21.856621+0000","last_peered":"2023-10-08T12:00:21.856621+0000","last_clean":"2023-10-08T12:00:21.856621+0000","last_became_active":"2023-10-08T12:00:20.601742+0000","last_became_peered":"2023-10-08T12:00:20.601742+0000","last_unstale":"2023-10-08T12:00:21.856621+0000","last_undegraded":"2023-10-08T12:00:21.856621+0000","last_fullsized":"2023-10-08T12:00:21.856621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:55:19.542748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.632096+0000","last_change":"2023-10-08T12:00:19.554323+0000","last_active":"2023-10-08T12:00:21.632096+0000","last_peered":"2023-10-08T12:00:21.632096+0000","last_clean":"2023-10-08T12:00:21.632096+0000","last_became_active":"2023-10-08T12:00:19.553748+0000","last_became_peered":"2023-10-08T12:00:19.553748+0000","last_unstale":"2023-10-08T12:00:21.632096+0000","last_undegraded":"2023-10-08T12:00:21.632096+0000","last_fullsized":"2023-10-08T12:00:21.632096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:51:26.897821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855418+0000","last_change":"2023-10-08T12:00:20.613066+0000","last_active":"2023-10-08T12:00:21.855418+0000","last_peered":"2023-10-08T12:00:21.855418+0000","last_clean":"2023-10-08T12:00:21.855418+0000","last_became_active":"2023-10-08T12:00:20.612422+0000","last_became_peered":"2023-10-08T12:00:20.612422+0000","last_unstale":"2023-10-08T12:00:21.855418+0000","last_undegraded":"2023-10-08T12:00:21.855418+0000","last_fullsized":"2023-10-08T12:00:21.855418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:22:42.527070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.604197+0000","last_change":"2023-10-08T12:00:20.607333+0000","last_active":"2023-10-08T12:00:21.604197+0000","last_peered":"2023-10-08T12:00:21.604197+0000","last_clean":"2023-10-08T12:00:21.604197+0000","last_became_active":"2023-10-08T12:00:20.606634+0000","last_became_peered":"2023-10-08T12:00:20.606634+0000","last_unstale":"2023-10-08T12:00:21.604197+0000","last_undegraded":"2023-10-08T12:00:21.604197+0000","last_fullsized":"2023-10-08T12:00:21.604197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:35:25.862808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.631868+0000","last_change":"2023-10-08T12:00:19.553120+0000","last_active":"2023-10-08T12:00:21.631868+0000","last_peered":"2023-10-08T12:00:21.631868+0000","last_clean":"2023-10-08T12:00:21.631868+0000","last_became_active":"2023-10-08T12:00:19.552479+0000","last_became_peered":"2023-10-08T12:00:19.552479+0000","last_unstale":"2023-10-08T12:00:21.631868+0000","last_undegraded":"2023-10-08T12:00:21.631868+0000","last_fullsized":"2023-10-08T12:00:21.631868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:35:48.346462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.602591+0000","last_change":"2023-10-08T12:00:20.607581+0000","last_active":"2023-10-08T12:00:21.602591+0000","last_peered":"2023-10-08T12:00:21.602591+0000","last_clean":"2023-10-08T12:00:21.602591+0000","last_became_active":"2023-10-08T12:00:20.606887+0000","last_became_peered":"2023-10-08T12:00:20.606887+0000","last_unstale":"2023-10-08T12:00:21.602591+0000","last_undegraded":"2023-10-08T12:00:21.602591+0000","last_fullsized":"2023-10-08T12:00:21.602591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:53:47.853039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.632291+0000","last_change":"2023-10-08T12:00:19.555477+0000","last_active":"2023-10-08T12:00:21.632291+0000","last_peered":"2023-10-08T12:00:21.632291+0000","last_clean":"2023-10-08T12:00:21.632291+0000","last_became_active":"2023-10-08T12:00:19.553643+0000","last_became_peered":"2023-10-08T12:00:19.553643+0000","last_unstale":"2023-10-08T12:00:21.632291+0000","last_undegraded":"2023-10-08T12:00:21.632291+0000","last_fullsized":"2023-10-08T12:00:21.632291+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:30:13.917041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855050+0000","last_change":"2023-10-08T12:00:20.576541+0000","last_active":"2023-10-08T12:00:21.855050+0000","last_peered":"2023-10-08T12:00:21.855050+0000","last_clean":"2023-10-08T12:00:21.855050+0000","last_became_active":"2023-10-08T12:00:20.575715+0000","last_became_peered":"2023-10-08T12:00:20.575715+0000","last_unstale":"2023-10-08T12:00:21.855050+0000","last_undegraded":"2023-10-08T12:00:21.855050+0000","last_fullsized":"2023-10-08T12:00:21.855050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:45:16.534690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.857043+0000","last_change":"2023-10-08T12:00:19.524299+0000","last_active":"2023-10-08T12:00:21.857043+0000","last_peered":"2023-10-08T12:00:21.857043+0000","last_clean":"2023-10-08T12:00:21.857043+0000","last_became_active":"2023-10-08T12:00:19.523979+0000","last_became_peered":"2023-10-08T12:00:19.523979+0000","last_unstale":"2023-10-08T12:00:21.857043+0000","last_undegraded":"2023-10-08T12:00:21.857043+0000","last_fullsized":"2023-10-08T12:00:21.857043+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:06:50.282434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.856602+0000","last_change":"2023-10-08T12:00:20.621615+0000","last_active":"2023-10-08T12:00:21.856602+0000","last_peered":"2023-10-08T12:00:21.856602+0000","last_clean":"2023-10-08T12:00:21.856602+0000","last_became_active":"2023-10-08T12:00:20.621249+0000","last_became_peered":"2023-10-08T12:00:20.621249+0000","last_unstale":"2023-10-08T12:00:21.856602+0000","last_undegraded":"2023-10-08T12:00:21.856602+0000","last_fullsized":"2023-10-08T12:00:21.856602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:46:22.522999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855793+0000","last_change":"2023-10-08T12:00:19.546557+0000","last_active":"2023-10-08T12:00:21.855793+0000","last_peered":"2023-10-08T12:00:21.855793+0000","last_clean":"2023-10-08T12:00:21.855793+0000","last_became_active":"2023-10-08T12:00:19.546297+0000","last_became_peered":"2023-10-08T12:00:19.546297+0000","last_unstale":"2023-10-08T12:00:21.855793+0000","last_undegraded":"2023-10-08T12:00:21.855793+0000","last_fullsized":"2023-10-08T12:00:21.855793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:37:27.924905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":661848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.256}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.294}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.22}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1399999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":72510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.204}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":208896,"data_stored":70988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.877}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.228}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1950000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91100000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94099999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1819999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.093}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":192512,"data_stored":64598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2190000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.079}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.286}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.325}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.454}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":811008,"data_stored":661904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.175}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0529999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T12:00:24.989 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-08T12:00:24.989 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2023-10-08T12:00:24.989 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-08T12:00:25.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.151+0000 7f0ac4603640 1 -- 172.21.15.62:0/437341353 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0abc147920 msgr2=0x7f0abc0b6ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:25.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.151+0000 7f0ac4603640 1 --2- 172.21.15.62:0/437341353 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0abc147920 0x7f0abc0b6ad0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0abc073480 tx=0x7f0ab801f090 comp rx=0 tx=0).stop 2023-10-08T12:00:25.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.151+0000 7f0ac4603640 1 -- 172.21.15.62:0/437341353 shutdown_connections 2023-10-08T12:00:25.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.151+0000 7f0ac4603640 1 --2- 172.21.15.62:0/437341353 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0abc071410 0x7f0abc146d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:25.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.151+0000 7f0ac4603640 1 --2- 172.21.15.62:0/437341353 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0abc147920 0x7f0abc0b6ad0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:25.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.151+0000 7f0ac4603640 1 --2- 172.21.15.62:0/437341353 >> v2:172.21.15.130:3300/0 conn(0x7f0abc0b9260 0x7f0abc0b8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:25.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.151+0000 7f0ac4603640 1 -- 172.21.15.62:0/437341353 >> 172.21.15.62:0/437341353 conn(0x7f0abc09c520 msgr2=0x7f0abc09c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:25.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.151+0000 7f0ac4603640 1 -- 172.21.15.62:0/437341353 shutdown_connections 2023-10-08T12:00:25.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.151+0000 7f0ac4603640 1 -- 172.21.15.62:0/437341353 wait complete. 2023-10-08T12:00:25.158 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.151+0000 7f0ac4603640 1 Processor -- start 2023-10-08T12:00:25.158 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.151+0000 7f0ac4603640 1 -- start start 2023-10-08T12:00:25.158 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.151+0000 7f0ac4603640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0abc071410 0x7f0abc1e6c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:25.158 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.151+0000 7f0ac4603640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0abc0b9260 0x7f0abc1dd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:25.158 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.151+0000 7f0ac4603640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0abc147920 0x7f0abc1dd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:25.158 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.151+0000 7f0ac4603640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0abc1e71b0 con 0x7f0abc147920 2023-10-08T12:00:25.158 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.151+0000 7f0ac4603640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0abc0af830 con 0x7f0abc071410 2023-10-08T12:00:25.158 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.151+0000 7f0ac4603640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0abc0a0870 con 0x7f0abc0b9260 2023-10-08T12:00:25.158 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.151+0000 7f0ac2ba0640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0abc147920 0x7f0abc1dd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:25.158 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.151+0000 7f0ac2ba0640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0abc147920 0x7f0abc1dd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:45186/0 (socket says 172.21.15.62:45186) 2023-10-08T12:00:25.159 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.151+0000 7f0ac2ba0640 1 -- 172.21.15.62:0/830482490 learned_addr learned my addr 172.21.15.62:0/830482490 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:25.159 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.151+0000 7f0ac1b9e640 1 --2- 172.21.15.62:0/830482490 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0abc0b9260 0x7f0abc1dd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:25.159 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.151+0000 7f0ac239f640 1 --2- 172.21.15.62:0/830482490 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0abc071410 0x7f0abc1e6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:25.159 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.151+0000 7f0ac2ba0640 1 -- 172.21.15.62:0/830482490 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0abc0b9260 msgr2=0x7f0abc1dd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:25.159 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.151+0000 7f0ac2ba0640 1 --2- 172.21.15.62:0/830482490 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0abc0b9260 0x7f0abc1dd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:25.159 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.151+0000 7f0ac2ba0640 1 -- 172.21.15.62:0/830482490 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0abc071410 msgr2=0x7f0abc1e6c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:25.159 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.151+0000 7f0ac2ba0640 1 --2- 172.21.15.62:0/830482490 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0abc071410 0x7f0abc1e6c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:25.159 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.151+0000 7f0ac2ba0640 1 -- 172.21.15.62:0/830482490 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ab8009560 con 0x7f0abc147920 2023-10-08T12:00:25.159 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.151+0000 7f0ac1b9e640 1 --2- 172.21.15.62:0/830482490 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0abc0b9260 0x7f0abc1dd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:00:25.159 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.151+0000 7f0ac239f640 1 --2- 172.21.15.62:0/830482490 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0abc071410 0x7f0abc1e6c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:00:25.159 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.151+0000 7f0ac2ba0640 1 --2- 172.21.15.62:0/830482490 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0abc147920 0x7f0abc1dd700 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0ab400ca60 tx=0x7f0ab400cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:25.159 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.151+0000 7f0ab2ffd640 1 -- 172.21.15.62:0/830482490 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab400adc0 con 0x7f0abc147920 2023-10-08T12:00:25.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.151+0000 7f0ab2ffd640 1 -- 172.21.15.62:0/830482490 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0ab4004c40 con 0x7f0abc147920 2023-10-08T12:00:25.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.151+0000 7f0ac4603640 1 -- 172.21.15.62:0/830482490 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0abc09e360 con 0x7f0abc147920 2023-10-08T12:00:25.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.151+0000 7f0ab2ffd640 1 -- 172.21.15.62:0/830482490 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab4005280 con 0x7f0abc147920 2023-10-08T12:00:25.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.155+0000 7f0ac4603640 1 -- 172.21.15.62:0/830482490 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0abc0afdb0 con 0x7f0abc147920 2023-10-08T12:00:25.161 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.155+0000 7f0ac4603640 1 -- 172.21.15.62:0/830482490 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0abc0b5be0 con 0x7f0abc147920 2023-10-08T12:00:25.161 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.155+0000 7f0ab2ffd640 1 -- 172.21.15.62:0/830482490 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f0ab40053e0 con 0x7f0abc147920 2023-10-08T12:00:25.161 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.155+0000 7f0ab2ffd640 1 --2- 172.21.15.62:0/830482490 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f0aa0066470 0x7f0aa0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:25.161 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.155+0000 7f0ab2ffd640 1 -- 172.21.15.62:0/830482490 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0ab4084630 con 0x7f0abc147920 2023-10-08T12:00:25.161 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.155+0000 7f0ac239f640 1 --2- 172.21.15.62:0/830482490 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f0aa0066470 0x7f0aa0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:25.161 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.155+0000 7f0ac239f640 1 --2- 172.21.15.62:0/830482490 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f0aa0066470 0x7f0aa0068930 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0aac005fd0 tx=0x7f0aac005da0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:25.165 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.159+0000 7f0ab2ffd640 1 -- 172.21.15.62:0/830482490 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0ab4051ab0 con 0x7f0abc147920 2023-10-08T12:00:25.320 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.315+0000 7f0ac4603640 1 -- 172.21.15.62:0/830482490 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) v1 -- 0x7f0abc0affa0 con 0x7f0abc147920 2023-10-08T12:00:25.320 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.315+0000 7f0ab2ffd640 1 -- 172.21.15.62:0/830482490 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v30) v1 ==== 86+0+160 (secure 0 0 0) 0x7f0ab401d090 con 0x7f0abc147920 2023-10-08T12:00:25.321 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T12:00:25.323 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.319+0000 7f0ac4603640 1 -- 172.21.15.62:0/830482490 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f0aa0066470 msgr2=0x7f0aa0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:25.323 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.319+0000 7f0ac4603640 1 --2- 172.21.15.62:0/830482490 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f0aa0066470 0x7f0aa0068930 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0aac005fd0 tx=0x7f0aac005da0 comp rx=0 tx=0).stop 2023-10-08T12:00:25.323 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.319+0000 7f0ac4603640 1 -- 172.21.15.62:0/830482490 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0abc147920 msgr2=0x7f0abc1dd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:25.323 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.319+0000 7f0ac4603640 1 --2- 172.21.15.62:0/830482490 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0abc147920 0x7f0abc1dd700 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0ab400ca60 tx=0x7f0ab400cf20 comp rx=0 tx=0).stop 2023-10-08T12:00:25.323 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.319+0000 7f0ac4603640 1 -- 172.21.15.62:0/830482490 shutdown_connections 2023-10-08T12:00:25.324 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.319+0000 7f0ac4603640 1 --2- 172.21.15.62:0/830482490 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f0aa0066470 0x7f0aa0068930 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:25.324 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.319+0000 7f0ac4603640 1 --2- 172.21.15.62:0/830482490 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0abc0b9260 0x7f0abc1dd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:25.324 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.319+0000 7f0ac4603640 1 --2- 172.21.15.62:0/830482490 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0abc147920 0x7f0abc1dd700 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:25.324 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.319+0000 7f0ac4603640 1 --2- 172.21.15.62:0/830482490 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0abc071410 0x7f0abc1e6c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:25.324 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.319+0000 7f0ac4603640 1 -- 172.21.15.62:0/830482490 >> 172.21.15.62:0/830482490 conn(0x7f0abc09c520 msgr2=0x7f0abc14a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:25.324 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.319+0000 7f0ac4603640 1 -- 172.21.15.62:0/830482490 shutdown_connections 2023-10-08T12:00:25.324 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.319+0000 7f0ac4603640 1 -- 172.21.15.62:0/830482490 wait complete. 2023-10-08T12:00:25.339 INFO:teuthology.orchestra.run.smithi062.stdout:[{"version":30,"timestamp":"2023-10-08T12:00:05.977475+0000","name":"","changes":[{"name":"osd.2/osd_mclock_max_capacity_iops_ssd","new_value":"3547.566142"}]}] 2023-10-08T12:00:25.339 INFO:tasks.ceph_manager:config epoch is 30 2023-10-08T12:00:25.339 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-08T12:00:25.339 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-08T12:00:25.339 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-08T12:00:25.466 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.463+0000 7f1309689640 1 -- 172.21.15.62:0/1227508809 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13040b99e0 msgr2=0x7f130409d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:25.466 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.463+0000 7f1309689640 1 --2- 172.21.15.62:0/1227508809 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13040b99e0 0x7f130409d040 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f130406bd80 tx=0x7f12f401ccf0 comp rx=0 tx=0).stop 2023-10-08T12:00:25.466 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.463+0000 7f1309689640 1 -- 172.21.15.62:0/1227508809 shutdown_connections 2023-10-08T12:00:25.466 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.463+0000 7f1309689640 1 --2- 172.21.15.62:0/1227508809 >> v2:172.21.15.130:3300/0 conn(0x7f1304149910 0x7f1304149d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:25.467 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.463+0000 7f1309689640 1 --2- 172.21.15.62:0/1227508809 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13040b99e0 0x7f130409d040 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:25.467 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.463+0000 7f1309689640 1 -- 172.21.15.62:0/1227508809 >> 172.21.15.62:0/1227508809 conn(0x7f130409c520 msgr2=0x7f130409c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:25.467 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.463+0000 7f1309689640 1 -- 172.21.15.62:0/1227508809 shutdown_connections 2023-10-08T12:00:25.467 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.463+0000 7f1309689640 1 -- 172.21.15.62:0/1227508809 wait complete. 2023-10-08T12:00:25.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.463+0000 7f1309689640 1 Processor -- start 2023-10-08T12:00:25.470 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.463+0000 7f1309689640 1 -- start start 2023-10-08T12:00:25.470 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.463+0000 7f1309689640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f13040b5170 0x7f1304142670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:25.470 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.463+0000 7f1309689640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13040b99e0 0x7f13041414c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:25.470 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.463+0000 7f1309689640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1304149910 0x7f130414fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:25.470 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.463+0000 7f1309689640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1304142bb0 con 0x7f13040b99e0 2023-10-08T12:00:25.470 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.463+0000 7f1309689640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f130413e8d0 con 0x7f1304149910 2023-10-08T12:00:25.470 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.463+0000 7f1309689640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1304140da0 con 0x7f13040b5170 2023-10-08T12:00:25.470 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.463+0000 7f13027fc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13040b99e0 0x7f13041414c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:25.470 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.463+0000 7f13027fc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13040b99e0 0x7f13041414c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:45218/0 (socket says 172.21.15.62:45218) 2023-10-08T12:00:25.470 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.463+0000 7f13027fc640 1 -- 172.21.15.62:0/2896654358 learned_addr learned my addr 172.21.15.62:0/2896654358 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:25.470 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.463+0000 7f13027fc640 1 -- 172.21.15.62:0/2896654358 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f13040b5170 msgr2=0x7f1304142670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:25.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.463+0000 7f13027fc640 1 --2- 172.21.15.62:0/2896654358 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f13040b5170 0x7f1304142670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:25.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.463+0000 7f13027fc640 1 -- 172.21.15.62:0/2896654358 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1304149910 msgr2=0x7f130414fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:25.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.463+0000 7f13037fe640 1 --2- 172.21.15.62:0/2896654358 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1304149910 0x7f130414fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:25.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.463+0000 7f13027fc640 1 --2- 172.21.15.62:0/2896654358 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1304149910 0x7f130414fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:25.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.463+0000 7f13027fc640 1 -- 172.21.15.62:0/2896654358 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f40098e0 con 0x7f13040b99e0 2023-10-08T12:00:25.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.463+0000 7f13027fc640 1 --2- 172.21.15.62:0/2896654358 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13040b99e0 0x7f13041414c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f12f800c4f0 tx=0x7f12f8001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:25.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.463+0000 7f12eb7fe640 1 -- 172.21.15.62:0/2896654358 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f8005480 con 0x7f13040b99e0 2023-10-08T12:00:25.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.463+0000 7f1309689640 1 -- 172.21.15.62:0/2896654358 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1304146d40 con 0x7f13040b99e0 2023-10-08T12:00:25.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.463+0000 7f1309689640 1 -- 172.21.15.62:0/2896654358 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f130413ba20 con 0x7f13040b99e0 2023-10-08T12:00:25.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.463+0000 7f12eb7fe640 1 -- 172.21.15.62:0/2896654358 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f12f8003600 con 0x7f13040b99e0 2023-10-08T12:00:25.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.463+0000 7f12eb7fe640 1 -- 172.21.15.62:0/2896654358 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f80039b0 con 0x7f13040b99e0 2023-10-08T12:00:25.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.463+0000 7f1309689640 1 -- 172.21.15.62:0/2896654358 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12e4005260 con 0x7f13040b99e0 2023-10-08T12:00:25.472 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.467+0000 7f12eb7fe640 1 -- 172.21.15.62:0/2896654358 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f12f801b3b0 con 0x7f13040b99e0 2023-10-08T12:00:25.472 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.467+0000 7f12eb7fe640 1 --2- 172.21.15.62:0/2896654358 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f12f00664a0 0x7f12f0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:25.472 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.467+0000 7f12eb7fe640 1 -- 172.21.15.62:0/2896654358 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f12f8083700 con 0x7f13040b99e0 2023-10-08T12:00:25.472 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.467+0000 7f1302ffd640 1 --2- 172.21.15.62:0/2896654358 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f12f00664a0 0x7f12f0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:25.472 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.467+0000 7f1302ffd640 1 --2- 172.21.15.62:0/2896654358 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f12f00664a0 0x7f12f0068960 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f12f40af000 tx=0x7f12f4019a90 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:25.474 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.471+0000 7f12eb7fe640 1 -- 172.21.15.62:0/2896654358 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f12f8050af0 con 0x7f13040b99e0 2023-10-08T12:00:25.668 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.663+0000 7f1309689640 1 -- 172.21.15.62:0/2896654358 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f12e40050d0 con 0x7f13040b99e0 2023-10-08T12:00:25.675 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.671+0000 7f12eb7fe640 1 -- 172.21.15.62:0/2896654358 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164433 (secure 0 0 0) 0x7f12f8054110 con 0x7f13040b99e0 2023-10-08T12:00:25.677 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T12:00:25.679 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.675+0000 7f1309689640 1 -- 172.21.15.62:0/2896654358 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f12f00664a0 msgr2=0x7f12f0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:25.679 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.675+0000 7f1309689640 1 --2- 172.21.15.62:0/2896654358 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f12f00664a0 0x7f12f0068960 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f12f40af000 tx=0x7f12f4019a90 comp rx=0 tx=0).stop 2023-10-08T12:00:25.679 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.675+0000 7f1309689640 1 -- 172.21.15.62:0/2896654358 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13040b99e0 msgr2=0x7f13041414c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:25.679 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.675+0000 7f1309689640 1 --2- 172.21.15.62:0/2896654358 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13040b99e0 0x7f13041414c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f12f800c4f0 tx=0x7f12f8001e80 comp rx=0 tx=0).stop 2023-10-08T12:00:25.679 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.675+0000 7f1309689640 1 -- 172.21.15.62:0/2896654358 shutdown_connections 2023-10-08T12:00:25.679 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.675+0000 7f1309689640 1 --2- 172.21.15.62:0/2896654358 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f12f00664a0 0x7f12f0068960 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:25.679 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.675+0000 7f1309689640 1 --2- 172.21.15.62:0/2896654358 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1304149910 0x7f130414fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:25.679 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.675+0000 7f1309689640 1 --2- 172.21.15.62:0/2896654358 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13040b99e0 0x7f13041414c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:25.680 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.675+0000 7f1309689640 1 --2- 172.21.15.62:0/2896654358 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f13040b5170 0x7f1304142670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:25.680 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.675+0000 7f1309689640 1 -- 172.21.15.62:0/2896654358 >> 172.21.15.62:0/2896654358 conn(0x7f130409c520 msgr2=0x7f130409ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:25.680 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.675+0000 7f1309689640 1 -- 172.21.15.62:0/2896654358 shutdown_connections 2023-10-08T12:00:25.680 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.675+0000 7f1309689640 1 -- 172.21.15.62:0/2896654358 wait complete. 2023-10-08T12:00:25.695 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":5,"active_gid":4111,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":826384843},{"type":"v1","addr":"172.21.15.130:6833","nonce":826384843}]},"active_addr":"172.21.15.130:6833/826384843","active_change":"2023-10-08T11:59:59.098476+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4151,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.130:0","nonce":3809682012}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.130:0","nonce":1551236446}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.130:0","nonce":3190998274}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.130:0","nonce":783816308}]}]} 2023-10-08T12:00:25.699 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-08T12:00:25.699 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-08T12:00:25.700 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:00:25.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.823+0000 7f62386e8640 1 -- 172.21.15.62:0/2388650427 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6230148010 msgr2=0x7f623006a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:25.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.823+0000 7f62386e8640 1 --2- 172.21.15.62:0/2388650427 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6230148010 0x7f623006a930 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6230071bb0 tx=0x7f622801d2c0 comp rx=0 tx=0).stop 2023-10-08T12:00:25.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.823+0000 7f62386e8640 1 -- 172.21.15.62:0/2388650427 shutdown_connections 2023-10-08T12:00:25.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.823+0000 7f62386e8640 1 --2- 172.21.15.62:0/2388650427 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6230148620 0x7f6230148ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:25.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.823+0000 7f62386e8640 1 --2- 172.21.15.62:0/2388650427 >> v2:172.21.15.130:3300/0 conn(0x7f62300b8bc0 0x7f62300b8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:25.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.823+0000 7f62386e8640 1 --2- 172.21.15.62:0/2388650427 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6230148010 0x7f623006a930 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:25.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.823+0000 7f62386e8640 1 -- 172.21.15.62:0/2388650427 >> 172.21.15.62:0/2388650427 conn(0x7f623009c520 msgr2=0x7f623009c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:25.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.823+0000 7f62386e8640 1 -- 172.21.15.62:0/2388650427 shutdown_connections 2023-10-08T12:00:25.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.823+0000 7f62386e8640 1 -- 172.21.15.62:0/2388650427 wait complete. 2023-10-08T12:00:25.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.823+0000 7f62386e8640 1 Processor -- start 2023-10-08T12:00:25.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.823+0000 7f62386e8640 1 -- start start 2023-10-08T12:00:25.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.823+0000 7f62386e8640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f62300b8bc0 0x7f62300b3e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:25.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.823+0000 7f62386e8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6230148010 0x7f623009e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:25.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.823+0000 7f62386e8640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6230148620 0x7f623009ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:25.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.823+0000 7f62386e8640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6230099a40 con 0x7f62300b8bc0 2023-10-08T12:00:25.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.823+0000 7f62386e8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62300b4340 con 0x7f6230148010 2023-10-08T12:00:25.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.823+0000 7f62386e8640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f623013c5f0 con 0x7f6230148620 2023-10-08T12:00:25.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.823+0000 7f6236484640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f62300b8bc0 0x7f62300b3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:25.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.823+0000 7f6236484640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f62300b8bc0 0x7f62300b3e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:45244/0 (socket says 172.21.15.62:45244) 2023-10-08T12:00:25.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.823+0000 7f6236484640 1 -- 172.21.15.62:0/2658204071 learned_addr learned my addr 172.21.15.62:0/2658204071 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:25.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.823+0000 7f6236c85640 1 --2- 172.21.15.62:0/2658204071 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6230148620 0x7f623009ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:25.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.823+0000 7f6235c83640 1 --2- 172.21.15.62:0/2658204071 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6230148010 0x7f623009e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:25.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.823+0000 7f6236484640 1 -- 172.21.15.62:0/2658204071 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6230148620 msgr2=0x7f623009ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:25.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.823+0000 7f6236484640 1 --2- 172.21.15.62:0/2658204071 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6230148620 0x7f623009ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:25.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.823+0000 7f6236484640 1 -- 172.21.15.62:0/2658204071 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6230148010 msgr2=0x7f623009e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:25.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.823+0000 7f6236484640 1 --2- 172.21.15.62:0/2658204071 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6230148010 0x7f623009e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:25.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.823+0000 7f6236484640 1 -- 172.21.15.62:0/2658204071 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f622800b510 con 0x7f62300b8bc0 2023-10-08T12:00:25.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.823+0000 7f6236484640 1 --2- 172.21.15.62:0/2658204071 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f62300b8bc0 0x7f62300b3e00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6228000f90 tx=0x7f62280ac590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:25.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.823+0000 7f622effd640 1 -- 172.21.15.62:0/2658204071 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62280adcf0 con 0x7f62300b8bc0 2023-10-08T12:00:25.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.823+0000 7f622effd640 1 -- 172.21.15.62:0/2658204071 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6228004a50 con 0x7f62300b8bc0 2023-10-08T12:00:25.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.823+0000 7f622effd640 1 -- 172.21.15.62:0/2658204071 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6228004e60 con 0x7f62300b8bc0 2023-10-08T12:00:25.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.823+0000 7f62386e8640 1 -- 172.21.15.62:0/2658204071 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f623009d920 con 0x7f62300b8bc0 2023-10-08T12:00:25.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.823+0000 7f62386e8640 1 -- 172.21.15.62:0/2658204071 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62301e5670 con 0x7f62300b8bc0 2023-10-08T12:00:25.832 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.827+0000 7f62386e8640 1 -- 172.21.15.62:0/2658204071 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f623004da80 con 0x7f62300b8bc0 2023-10-08T12:00:25.832 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.827+0000 7f622effd640 1 -- 172.21.15.62:0/2658204071 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f62280b3050 con 0x7f62300b8bc0 2023-10-08T12:00:25.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.827+0000 7f622effd640 1 --2- 172.21.15.62:0/2658204071 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f621c066470 0x7f621c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:25.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.827+0000 7f622effd640 1 -- 172.21.15.62:0/2658204071 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f622811ea30 con 0x7f62300b8bc0 2023-10-08T12:00:25.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.827+0000 7f6235c83640 1 --2- 172.21.15.62:0/2658204071 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f621c066470 0x7f621c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:25.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.827+0000 7f6235c83640 1 --2- 172.21.15.62:0/2658204071 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f621c066470 0x7f621c068930 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f62300b4b50 tx=0x7f622400a4e0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:25.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.831+0000 7f622effd640 1 -- 172.21.15.62:0/2658204071 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f62280ebf40 con 0x7f62300b8bc0 2023-10-08T12:00:25.991 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.987+0000 7f62386e8640 1 -- 172.21.15.62:0/2658204071 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f62300009b0 con 0x7f62300b8bc0 2023-10-08T12:00:25.992 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.987+0000 7f622effd640 1 -- 172.21.15.62:0/2658204071 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16481 (secure 0 0 0) 0x7f62280ef560 con 0x7f62300b8bc0 2023-10-08T12:00:25.993 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T12:00:25.993 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":20,"fsid":"3e777930-c2c1-4f2b-a903-c07ee4ca2c52","created":"2023-10-08T11:59:54.510229+0000","modified":"2023-10-08T12:00:21.580704+0000","last_up_change":"2023-10-08T12:00:06.783998+0000","last_in_change":"2023-10-08T11:59:57.847944+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:00:07.189433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:00:17.895548+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T12:00:18.871217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7bc3070a-7240-43d9-9ec3-397b68a37e2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6820","nonce":2227876905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6824","nonce":2227876905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6831","nonce":2227876905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6828","nonce":2227876905}]},"public_addr":"172.21.15.62:6820/2227876905","cluster_addr":"172.21.15.62:6824/2227876905","heartbeat_back_addr":"172.21.15.62:6831/2227876905","heartbeat_front_addr":"172.21.15.62:6828/2227876905","state":["exists","up"]},{"osd":1,"uuid":"5e0fa1f5-9ddc-4882-b460-5578bb571003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6801","nonce":315660906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6803","nonce":315660906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6808","nonce":315660906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6805","nonce":315660906}]},"public_addr":"172.21.15.62:6801/315660906","cluster_addr":"172.21.15.62:6803/315660906","heartbeat_back_addr":"172.21.15.62:6808/315660906","heartbeat_front_addr":"172.21.15.62:6805/315660906","state":["exists","up"]},{"osd":2,"uuid":"262b5ee9-4243-4309-a14f-88ad4e8bf812","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6807","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6809","nonce":3784842938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6811","nonce":3784842938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6815","nonce":3784842938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6813","nonce":3784842938}]},"public_addr":"172.21.15.62:6809/3784842938","cluster_addr":"172.21.15.62:6811/3784842938","heartbeat_back_addr":"172.21.15.62:6815/3784842938","heartbeat_front_addr":"172.21.15.62:6813/3784842938","state":["exists","up"]},{"osd":3,"uuid":"1770bdb8-c12b-43b1-aaab-1d6b6fd18f4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6817","nonce":3385303160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6821","nonce":3385303160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6827","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6829","nonce":3385303160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6823","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6825","nonce":3385303160}]},"public_addr":"172.21.15.62:6817/3385303160","cluster_addr":"172.21.15.62:6821/3385303160","heartbeat_back_addr":"172.21.15.62:6829/3385303160","heartbeat_front_addr":"172.21.15.62:6825/3385303160","state":["exists","up"]},{"osd":4,"uuid":"74c73631-9351-494a-8246-28ee86e9f862","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6807","nonce":1174056987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6809","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6811","nonce":1174056987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6820","nonce":1174056987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6813","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6816","nonce":1174056987}]},"public_addr":"172.21.15.130:6807/1174056987","cluster_addr":"172.21.15.130:6811/1174056987","heartbeat_back_addr":"172.21.15.130:6820/1174056987","heartbeat_front_addr":"172.21.15.130:6816/1174056987","state":["exists","up"]},{"osd":5,"uuid":"1040f389-272c-41d6-ae76-70c04d09afa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6801","nonce":561928414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6803","nonce":561928414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6815","nonce":561928414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6808","nonce":561928414}]},"public_addr":"172.21.15.130:6801/561928414","cluster_addr":"172.21.15.130:6803/561928414","heartbeat_back_addr":"172.21.15.130:6815/561928414","heartbeat_front_addr":"172.21.15.130:6808/561928414","state":["exists","up"]},{"osd":6,"uuid":"178553eb-03e1-4ab8-9826-4f5997e6da0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6810","nonce":2877303015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6817","nonce":2877303015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6823","nonce":2877303015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6819","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6821","nonce":2877303015}]},"public_addr":"172.21.15.130:6810/2877303015","cluster_addr":"172.21.15.130:6817/2877303015","heartbeat_back_addr":"172.21.15.130:6823/2877303015","heartbeat_front_addr":"172.21.15.130:6821/2877303015","state":["exists","up"]},{"osd":7,"uuid":"b6581c8f-30b1-4dfd-b7b6-94b579128835","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6825","nonce":680009774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6827","nonce":680009774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6831","nonce":680009774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6829","nonce":680009774}]},"public_addr":"172.21.15.130:6825/680009774","cluster_addr":"172.21.15.130:6827/680009774","heartbeat_back_addr":"172.21.15.130:6831/680009774","heartbeat_front_addr":"172.21.15.130:6829/680009774","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.505543+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.394383+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.456652+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.529168+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.235414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.392158+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.347556+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.432039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:00:25.994 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.991+0000 7f62386e8640 1 -- 172.21.15.62:0/2658204071 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f621c066470 msgr2=0x7f621c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:25.995 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.991+0000 7f62386e8640 1 --2- 172.21.15.62:0/2658204071 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f621c066470 0x7f621c068930 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f62300b4b50 tx=0x7f622400a4e0 comp rx=0 tx=0).stop 2023-10-08T12:00:25.995 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.991+0000 7f62386e8640 1 -- 172.21.15.62:0/2658204071 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f62300b8bc0 msgr2=0x7f62300b3e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:25.995 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.991+0000 7f62386e8640 1 --2- 172.21.15.62:0/2658204071 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f62300b8bc0 0x7f62300b3e00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6228000f90 tx=0x7f62280ac590 comp rx=0 tx=0).stop 2023-10-08T12:00:25.995 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.991+0000 7f62386e8640 1 -- 172.21.15.62:0/2658204071 shutdown_connections 2023-10-08T12:00:25.995 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.991+0000 7f62386e8640 1 --2- 172.21.15.62:0/2658204071 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f621c066470 0x7f621c068930 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:25.995 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.991+0000 7f62386e8640 1 --2- 172.21.15.62:0/2658204071 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6230148620 0x7f623009ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:25.995 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.991+0000 7f62386e8640 1 --2- 172.21.15.62:0/2658204071 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6230148010 0x7f623009e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:25.995 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.991+0000 7f62386e8640 1 --2- 172.21.15.62:0/2658204071 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f62300b8bc0 0x7f62300b3e00 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:25.995 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.991+0000 7f62386e8640 1 -- 172.21.15.62:0/2658204071 >> 172.21.15.62:0/2658204071 conn(0x7f623009c520 msgr2=0x7f62301449f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:25.995 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.991+0000 7f62386e8640 1 -- 172.21.15.62:0/2658204071 shutdown_connections 2023-10-08T12:00:25.996 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:25.991+0000 7f62386e8640 1 -- 172.21.15.62:0/2658204071 wait complete. 2023-10-08T12:00:26.011 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-08T12:00:26.011 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:00:26.139 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.135+0000 7f031c3f0640 1 -- 172.21.15.62:0/349672742 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03140bc670 msgr2=0x7f0314069790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:26.139 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.135+0000 7f031c3f0640 1 --2- 172.21.15.62:0/349672742 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03140bc670 0x7f0314069790 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f03140bbbd0 tx=0x7f030401c780 comp rx=0 tx=0).stop 2023-10-08T12:00:26.139 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.135+0000 7f031c3f0640 1 -- 172.21.15.62:0/349672742 shutdown_connections 2023-10-08T12:00:26.139 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.135+0000 7f031c3f0640 1 --2- 172.21.15.62:0/349672742 >> v2:172.21.15.130:3300/0 conn(0x7f03140bdba0 0x7f031414c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.139 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.135+0000 7f031c3f0640 1 --2- 172.21.15.62:0/349672742 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03140bc670 0x7f0314069790 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.139 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.135+0000 7f031c3f0640 1 --2- 172.21.15.62:0/349672742 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f031406a520 0x7f0314149be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.140 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.135+0000 7f031c3f0640 1 -- 172.21.15.62:0/349672742 >> 172.21.15.62:0/349672742 conn(0x7f03140a0540 msgr2=0x7f03140a0950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:26.140 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.135+0000 7f031c3f0640 1 -- 172.21.15.62:0/349672742 shutdown_connections 2023-10-08T12:00:26.140 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.135+0000 7f031c3f0640 1 -- 172.21.15.62:0/349672742 wait complete. 2023-10-08T12:00:26.142 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.135+0000 7f031c3f0640 1 Processor -- start 2023-10-08T12:00:26.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.135+0000 7f031c3f0640 1 -- start start 2023-10-08T12:00:26.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.135+0000 7f031c3f0640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f031406a520 0x7f031414bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:26.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.135+0000 7f031c3f0640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f03140bc670 0x7f031413d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:26.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.135+0000 7f031c3f0640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03140bdba0 0x7f031413de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:26.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.135+0000 7f031c3f0640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f031414c190 con 0x7f03140bdba0 2023-10-08T12:00:26.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.135+0000 7f031c3f0640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f031409edc0 con 0x7f03140bc670 2023-10-08T12:00:26.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.135+0000 7f031c3f0640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f031409fd30 con 0x7f031406a520 2023-10-08T12:00:26.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.135+0000 7f031a98d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03140bdba0 0x7f031413de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:26.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.135+0000 7f031a98d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03140bdba0 0x7f031413de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:45268/0 (socket says 172.21.15.62:45268) 2023-10-08T12:00:26.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.135+0000 7f031a98d640 1 -- 172.21.15.62:0/2943169470 learned_addr learned my addr 172.21.15.62:0/2943169470 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:26.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.135+0000 7f031998b640 1 --2- 172.21.15.62:0/2943169470 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f03140bc670 0x7f031413d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:26.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.135+0000 7f031a18c640 1 --2- 172.21.15.62:0/2943169470 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f031406a520 0x7f031414bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:26.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.135+0000 7f031a98d640 1 -- 172.21.15.62:0/2943169470 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f031406a520 msgr2=0x7f031414bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:26.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.135+0000 7f031a98d640 1 --2- 172.21.15.62:0/2943169470 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f031406a520 0x7f031414bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.135+0000 7f031a98d640 1 -- 172.21.15.62:0/2943169470 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f03140bc670 msgr2=0x7f031413d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:26.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.135+0000 7f031a98d640 1 --2- 172.21.15.62:0/2943169470 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f03140bc670 0x7f031413d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.135+0000 7f031a98d640 1 -- 172.21.15.62:0/2943169470 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0304009560 con 0x7f03140bdba0 2023-10-08T12:00:26.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.135+0000 7f031a98d640 1 --2- 172.21.15.62:0/2943169470 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03140bdba0 0x7f031413de10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f030c00cce0 tx=0x7f030c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:26.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.135+0000 7f030affd640 1 -- 172.21.15.62:0/2943169470 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f030c00f450 con 0x7f03140bdba0 2023-10-08T12:00:26.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.135+0000 7f030affd640 1 -- 172.21.15.62:0/2943169470 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f030c00f6c0 con 0x7f03140bdba0 2023-10-08T12:00:26.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.135+0000 7f031c3f0640 1 -- 172.21.15.62:0/2943169470 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f031409f1e0 con 0x7f03140bdba0 2023-10-08T12:00:26.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.139+0000 7f030affd640 1 -- 172.21.15.62:0/2943169470 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f030c00fad0 con 0x7f03140bdba0 2023-10-08T12:00:26.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.139+0000 7f031c3f0640 1 -- 172.21.15.62:0/2943169470 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03140a0250 con 0x7f03140bdba0 2023-10-08T12:00:26.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.139+0000 7f031c3f0640 1 -- 172.21.15.62:0/2943169470 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f031409ff50 con 0x7f03140bdba0 2023-10-08T12:00:26.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.139+0000 7f030affd640 1 -- 172.21.15.62:0/2943169470 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f030c00fc30 con 0x7f03140bdba0 2023-10-08T12:00:26.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.139+0000 7f030affd640 1 --2- 172.21.15.62:0/2943169470 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f02f8066470 0x7f02f8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:26.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.139+0000 7f030affd640 1 -- 172.21.15.62:0/2943169470 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f030c084a70 con 0x7f03140bdba0 2023-10-08T12:00:26.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.139+0000 7f031a18c640 1 --2- 172.21.15.62:0/2943169470 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f02f8066470 0x7f02f8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:26.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.139+0000 7f031a18c640 1 --2- 172.21.15.62:0/2943169470 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f02f8066470 0x7f02f8068930 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0310005fd0 tx=0x7f0310005d80 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:26.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.143+0000 7f030affd640 1 -- 172.21.15.62:0/2943169470 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f030c052030 con 0x7f03140bdba0 2023-10-08T12:00:26.302 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.299+0000 7f031c3f0640 1 -- 172.21.15.62:0/2943169470 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f031409efb0 con 0x7f03140bdba0 2023-10-08T12:00:26.305 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.299+0000 7f030affd640 1 -- 172.21.15.62:0/2943169470 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16481 (secure 0 0 0) 0x7f030c055650 con 0x7f03140bdba0 2023-10-08T12:00:26.306 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T12:00:26.306 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":20,"fsid":"3e777930-c2c1-4f2b-a903-c07ee4ca2c52","created":"2023-10-08T11:59:54.510229+0000","modified":"2023-10-08T12:00:21.580704+0000","last_up_change":"2023-10-08T12:00:06.783998+0000","last_in_change":"2023-10-08T11:59:57.847944+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:00:07.189433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:00:17.895548+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T12:00:18.871217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7bc3070a-7240-43d9-9ec3-397b68a37e2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6820","nonce":2227876905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6824","nonce":2227876905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6831","nonce":2227876905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6828","nonce":2227876905}]},"public_addr":"172.21.15.62:6820/2227876905","cluster_addr":"172.21.15.62:6824/2227876905","heartbeat_back_addr":"172.21.15.62:6831/2227876905","heartbeat_front_addr":"172.21.15.62:6828/2227876905","state":["exists","up"]},{"osd":1,"uuid":"5e0fa1f5-9ddc-4882-b460-5578bb571003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6801","nonce":315660906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6803","nonce":315660906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6808","nonce":315660906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6805","nonce":315660906}]},"public_addr":"172.21.15.62:6801/315660906","cluster_addr":"172.21.15.62:6803/315660906","heartbeat_back_addr":"172.21.15.62:6808/315660906","heartbeat_front_addr":"172.21.15.62:6805/315660906","state":["exists","up"]},{"osd":2,"uuid":"262b5ee9-4243-4309-a14f-88ad4e8bf812","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6807","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6809","nonce":3784842938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6811","nonce":3784842938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6815","nonce":3784842938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6813","nonce":3784842938}]},"public_addr":"172.21.15.62:6809/3784842938","cluster_addr":"172.21.15.62:6811/3784842938","heartbeat_back_addr":"172.21.15.62:6815/3784842938","heartbeat_front_addr":"172.21.15.62:6813/3784842938","state":["exists","up"]},{"osd":3,"uuid":"1770bdb8-c12b-43b1-aaab-1d6b6fd18f4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6817","nonce":3385303160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6821","nonce":3385303160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6827","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6829","nonce":3385303160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6823","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6825","nonce":3385303160}]},"public_addr":"172.21.15.62:6817/3385303160","cluster_addr":"172.21.15.62:6821/3385303160","heartbeat_back_addr":"172.21.15.62:6829/3385303160","heartbeat_front_addr":"172.21.15.62:6825/3385303160","state":["exists","up"]},{"osd":4,"uuid":"74c73631-9351-494a-8246-28ee86e9f862","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6807","nonce":1174056987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6809","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6811","nonce":1174056987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6820","nonce":1174056987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6813","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6816","nonce":1174056987}]},"public_addr":"172.21.15.130:6807/1174056987","cluster_addr":"172.21.15.130:6811/1174056987","heartbeat_back_addr":"172.21.15.130:6820/1174056987","heartbeat_front_addr":"172.21.15.130:6816/1174056987","state":["exists","up"]},{"osd":5,"uuid":"1040f389-272c-41d6-ae76-70c04d09afa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6801","nonce":561928414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6803","nonce":561928414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6815","nonce":561928414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6808","nonce":561928414}]},"public_addr":"172.21.15.130:6801/561928414","cluster_addr":"172.21.15.130:6803/561928414","heartbeat_back_addr":"172.21.15.130:6815/561928414","heartbeat_front_addr":"172.21.15.130:6808/561928414","state":["exists","up"]},{"osd":6,"uuid":"178553eb-03e1-4ab8-9826-4f5997e6da0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6810","nonce":2877303015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6817","nonce":2877303015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6823","nonce":2877303015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6819","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6821","nonce":2877303015}]},"public_addr":"172.21.15.130:6810/2877303015","cluster_addr":"172.21.15.130:6817/2877303015","heartbeat_back_addr":"172.21.15.130:6823/2877303015","heartbeat_front_addr":"172.21.15.130:6821/2877303015","state":["exists","up"]},{"osd":7,"uuid":"b6581c8f-30b1-4dfd-b7b6-94b579128835","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6825","nonce":680009774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6827","nonce":680009774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6831","nonce":680009774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6829","nonce":680009774}]},"public_addr":"172.21.15.130:6825/680009774","cluster_addr":"172.21.15.130:6827/680009774","heartbeat_back_addr":"172.21.15.130:6831/680009774","heartbeat_front_addr":"172.21.15.130:6829/680009774","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.505543+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.394383+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.456652+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.529168+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.235414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.392158+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.347556+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.432039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:00:26.307 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.303+0000 7f031c3f0640 1 -- 172.21.15.62:0/2943169470 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f02f8066470 msgr2=0x7f02f8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:26.307 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.303+0000 7f031c3f0640 1 --2- 172.21.15.62:0/2943169470 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f02f8066470 0x7f02f8068930 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0310005fd0 tx=0x7f0310005d80 comp rx=0 tx=0).stop 2023-10-08T12:00:26.307 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.303+0000 7f031c3f0640 1 -- 172.21.15.62:0/2943169470 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03140bdba0 msgr2=0x7f031413de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:26.308 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.303+0000 7f031c3f0640 1 --2- 172.21.15.62:0/2943169470 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03140bdba0 0x7f031413de10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f030c00cce0 tx=0x7f030c00a620 comp rx=0 tx=0).stop 2023-10-08T12:00:26.308 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.303+0000 7f031c3f0640 1 -- 172.21.15.62:0/2943169470 shutdown_connections 2023-10-08T12:00:26.308 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.303+0000 7f031c3f0640 1 --2- 172.21.15.62:0/2943169470 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f02f8066470 0x7f02f8068930 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.308 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.303+0000 7f031c3f0640 1 --2- 172.21.15.62:0/2943169470 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03140bdba0 0x7f031413de10 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.308 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.303+0000 7f031c3f0640 1 --2- 172.21.15.62:0/2943169470 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f03140bc670 0x7f031413d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.308 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.303+0000 7f031c3f0640 1 --2- 172.21.15.62:0/2943169470 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f031406a520 0x7f031414bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.308 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.303+0000 7f031c3f0640 1 -- 172.21.15.62:0/2943169470 >> 172.21.15.62:0/2943169470 conn(0x7f03140a0540 msgr2=0x7f031413eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:26.308 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.303+0000 7f031c3f0640 1 -- 172.21.15.62:0/2943169470 shutdown_connections 2023-10-08T12:00:26.308 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.303+0000 7f031c3f0640 1 -- 172.21.15.62:0/2943169470 wait complete. 2023-10-08T12:00:26.323 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-08T12:00:26.323 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-08T12:00:26.324 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-08T12:00:26.324 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-08T12:00:26.325 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-10-08T12:00:26.325 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-10-08T12:00:26.325 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-10-08T12:00:26.326 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-10-08T12:00:26.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.503+0000 7fa78937c640 1 -- 172.21.15.62:0/1465136624 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7840b7270 msgr2=0x7fa78406e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:26.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.503+0000 7fa78937c640 1 --2- 172.21.15.62:0/1465136624 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7840b7270 0x7fa78406e6c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa7840b23d0 tx=0x7fa77c01f370 comp rx=0 tx=0).stop 2023-10-08T12:00:26.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.503+0000 7fa78937c640 1 -- 172.21.15.62:0/1465136624 shutdown_connections 2023-10-08T12:00:26.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.503+0000 7fa78937c640 1 --2- 172.21.15.62:0/1465136624 >> v2:172.21.15.130:3300/0 conn(0x7fa78406f720 0x7fa7840b5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.503+0000 7fa78937c640 1 --2- 172.21.15.62:0/1465136624 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7840b7270 0x7fa78406e6c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.503+0000 7fa78937c640 1 -- 172.21.15.62:0/1465136624 >> 172.21.15.62:0/1465136624 conn(0x7fa784069790 msgr2=0x7fa784069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:26.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.507+0000 7fa78937c640 1 -- 172.21.15.62:0/1465136624 shutdown_connections 2023-10-08T12:00:26.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.507+0000 7fa78937c640 1 -- 172.21.15.62:0/1465136624 wait complete. 2023-10-08T12:00:26.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.507+0000 7f02a2e52640 1 -- 172.21.15.62:0/22712791 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f029c0bd430 msgr2=0x7f029c0bd880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:26.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.507+0000 7f02a2e52640 1 --2- 172.21.15.62:0/22712791 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f029c0bd430 0x7f029c0bd880 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f029c089020 tx=0x7f029401f580 comp rx=0 tx=0).stop 2023-10-08T12:00:26.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.507+0000 7f02a2e52640 1 -- 172.21.15.62:0/22712791 shutdown_connections 2023-10-08T12:00:26.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.507+0000 7f02a2e52640 1 --2- 172.21.15.62:0/22712791 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f029c0bd430 0x7f029c0bd880 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.507+0000 7f02a2e52640 1 --2- 172.21.15.62:0/22712791 >> v2:172.21.15.130:3300/0 conn(0x7f029c150cf0 0x7f029c0bac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.507+0000 7f02a2e52640 1 -- 172.21.15.62:0/22712791 >> 172.21.15.62:0/22712791 conn(0x7f029c0be890 msgr2=0x7f029c0beca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:26.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.507+0000 7f02a2e52640 1 -- 172.21.15.62:0/22712791 shutdown_connections 2023-10-08T12:00:26.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.507+0000 7f02a2e52640 1 -- 172.21.15.62:0/22712791 wait complete. 2023-10-08T12:00:26.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.507+0000 7f914bfff640 1 -- 172.21.15.62:0/3619371385 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f914c06c700 msgr2=0x7f914c06ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:26.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.507+0000 7f914bfff640 1 --2- 172.21.15.62:0/3619371385 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f914c06c700 0x7f914c06ade0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9144009c80 tx=0x7f914401cd40 comp rx=0 tx=0).stop 2023-10-08T12:00:26.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.507+0000 7f914bfff640 1 -- 172.21.15.62:0/3619371385 shutdown_connections 2023-10-08T12:00:26.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.507+0000 7f914bfff640 1 --2- 172.21.15.62:0/3619371385 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f914c06c700 0x7f914c06ade0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.507+0000 7f914bfff640 1 --2- 172.21.15.62:0/3619371385 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f914c1463e0 0x7f914c06a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.507+0000 7f914bfff640 1 -- 172.21.15.62:0/3619371385 >> 172.21.15.62:0/3619371385 conn(0x7f914c09d4c0 msgr2=0x7f914c09d8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:26.513 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.507+0000 7fe441c64640 1 -- 172.21.15.62:0/3959564863 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe43c13f400 msgr2=0x7fe43c13f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:26.513 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.507+0000 7fe441c64640 1 --2- 172.21.15.62:0/3959564863 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe43c13f400 0x7fe43c13f890 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe434009bc0 tx=0x7fe43401f2b0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.513 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.507+0000 7fe441c64640 1 -- 172.21.15.62:0/3959564863 shutdown_connections 2023-10-08T12:00:26.513 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.507+0000 7fe441c64640 1 --2- 172.21.15.62:0/3959564863 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe43c13f400 0x7fe43c13f890 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.514 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.507+0000 7fe441c64640 1 -- 172.21.15.62:0/3959564863 >> 172.21.15.62:0/3959564863 conn(0x7fe43c0b8d50 msgr2=0x7fe43c0b9160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:26.514 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.507+0000 7fe441c64640 1 -- 172.21.15.62:0/3959564863 shutdown_connections 2023-10-08T12:00:26.514 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.507+0000 7fe441c64640 1 -- 172.21.15.62:0/3959564863 wait complete. 2023-10-08T12:00:26.514 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.507+0000 7fc7c0939640 1 -- 172.21.15.62:0/1164612017 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7a4003980 msgr2=0x7fc7a4003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:26.514 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.507+0000 7fc7c0939640 1 --2- 172.21.15.62:0/1164612017 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7a4003980 0x7fc7a4003d80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc7b000c390 tx=0x7fc7b001f7c0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.514 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.507+0000 7fc7c0939640 1 -- 172.21.15.62:0/1164612017 shutdown_connections 2023-10-08T12:00:26.514 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.507+0000 7fc7c0939640 1 --2- 172.21.15.62:0/1164612017 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7a4003980 0x7fc7a4003d80 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.514 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.507+0000 7fc7c0939640 1 -- 172.21.15.62:0/1164612017 >> 172.21.15.62:0/1164612017 conn(0x7fc7bc09c600 msgr2=0x7fc7bc09ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:26.515 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.507+0000 7fc7c0939640 1 -- 172.21.15.62:0/1164612017 shutdown_connections 2023-10-08T12:00:26.515 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.507+0000 7fc7c0939640 1 -- 172.21.15.62:0/1164612017 wait complete. 2023-10-08T12:00:26.515 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.507+0000 7f914bfff640 1 -- 172.21.15.62:0/3619371385 shutdown_connections 2023-10-08T12:00:26.515 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.507+0000 7fa78937c640 1 Processor -- start 2023-10-08T12:00:26.516 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.507+0000 7fa78937c640 1 -- start start 2023-10-08T12:00:26.516 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.507+0000 7fa78937c640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa78406f720 0x7fa7841e71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:26.516 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.507+0000 7fa78937c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa7840b7270 0x7fa784144990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:26.516 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.507+0000 7f02a2e52640 1 Processor -- start 2023-10-08T12:00:26.516 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.507+0000 7f02a2e52640 1 -- start start 2023-10-08T12:00:26.516 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.507+0000 7f02a2e52640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f029c0b9210 0x7f029c1e4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:26.516 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.507+0000 7f02a2e52640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f029c0bd430 0x7f029c142b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:26.516 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.507+0000 7f02a2e52640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f029c150cf0 0x7f029c14a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:26.517 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.507+0000 7f02a2e52640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f029c14acd0 con 0x7f029c0b9210 2023-10-08T12:00:26.517 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.507+0000 7f02a2e52640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f029c1e3b90 con 0x7f029c150cf0 2023-10-08T12:00:26.517 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.507+0000 7f02a2e52640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f029c1e3580 con 0x7f029c0bd430 2023-10-08T12:00:26.517 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.507+0000 7fe441c64640 1 Processor -- start 2023-10-08T12:00:26.517 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7fa782ffd640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa78406f720 0x7fa7841e71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:26.517 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7fa782ffd640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa78406f720 0x7fa7841e71b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.62:47948/0 (socket says 172.21.15.62:47948) 2023-10-08T12:00:26.518 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7f029bfff640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f029c0bd430 0x7f029c142b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:26.518 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7f029bfff640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f029c0bd430 0x7f029c142b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.62:47950/0 (socket says 172.21.15.62:47950) 2023-10-08T12:00:26.518 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7f029bfff640 1 -- 172.21.15.62:0/2405363896 learned_addr learned my addr 172.21.15.62:0/2405363896 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:26.518 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7f02a13ef640 1 --2- 172.21.15.62:0/2405363896 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f029c150cf0 0x7f029c14a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:26.518 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7f02a0bee640 1 --2- 172.21.15.62:0/2405363896 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f029c0b9210 0x7f029c1e4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:26.518 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.507+0000 7f914bfff640 1 -- 172.21.15.62:0/3619371385 wait complete. 2023-10-08T12:00:26.519 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7fa782ffd640 1 -- 172.21.15.62:0/3372406 learned_addr learned my addr 172.21.15.62:0/3372406 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:26.519 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7fc7c0939640 1 Processor -- start 2023-10-08T12:00:26.519 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7f914bfff640 1 Processor -- start 2023-10-08T12:00:26.520 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7f02a0bee640 1 -- 172.21.15.62:0/2405363896 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f029c0bd430 msgr2=0x7f029c142b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:26.520 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7f02a0bee640 1 --2- 172.21.15.62:0/2405363896 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f029c0bd430 0x7f029c142b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.520 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7f02a0bee640 1 -- 172.21.15.62:0/2405363896 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f029c150cf0 msgr2=0x7f029c14a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:26.520 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7f02a0bee640 1 --2- 172.21.15.62:0/2405363896 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f029c150cf0 0x7f029c14a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.520 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7f02a0bee640 1 -- 172.21.15.62:0/2405363896 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02940098e0 con 0x7f029c0b9210 2023-10-08T12:00:26.520 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7fa78937c640 1 --2- 172.21.15.62:0/3372406 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa78413fec0 0x7fa7841529a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:26.521 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7fe441c64640 1 -- start start 2023-10-08T12:00:26.521 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7fe441c64640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe43c0afe70 0x7fe43c06c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:26.521 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7fe441c64640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe43c0b08f0 0x7fe43c140690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:26.521 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7fe441c64640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe43c13f400 0x7fe43c1417c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:26.521 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7fe441c64640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe43c06c700 con 0x7fe43c0b08f0 2023-10-08T12:00:26.521 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7fe441c64640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe43c153280 con 0x7fe43c13f400 2023-10-08T12:00:26.521 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7fe441c64640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe43c1412e0 con 0x7fe43c0afe70 2023-10-08T12:00:26.521 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7f02a0bee640 1 --2- 172.21.15.62:0/2405363896 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f029c0b9210 0x7f029c1e4020 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f029000d6d0 tx=0x7f029000db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:26.522 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7fa78937c640 1 -- 172.21.15.62:0/3372406 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa784152ee0 con 0x7fa78413fec0 2023-10-08T12:00:26.522 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7fe440c62640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe43c0afe70 0x7fe43c06c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:26.522 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7fe440c62640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe43c0afe70 0x7fe43c06c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.62:47966/0 (socket says 172.21.15.62:47966) 2023-10-08T12:00:26.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7fe440c62640 1 -- 172.21.15.62:0/1653584629 learned_addr learned my addr 172.21.15.62:0/1653584629 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:26.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7fe43bfff640 1 --2- 172.21.15.62:0/1653584629 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe43c0b08f0 0x7fe43c140690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:26.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7fa78937c640 1 -- 172.21.15.62:0/3372406 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa784143ad0 con 0x7fa7840b7270 2023-10-08T12:00:26.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7fa78937c640 1 -- 172.21.15.62:0/3372406 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa784146860 con 0x7fa78406f720 2023-10-08T12:00:26.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7fe441463640 1 --2- 172.21.15.62:0/1653584629 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe43c13f400 0x7fe43c1417c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:26.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7f75dddaf640 1 -- 172.21.15.62:0/3352473135 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f75d003ffe0 msgr2=0x7f75d0030a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:26.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7f75dddaf640 1 --2- 172.21.15.62:0/3352473135 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f75d003ffe0 0x7f75d0030a50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f75d802caf0 tx=0x7f75d80974d0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.526 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7fc7c0939640 1 -- start start 2023-10-08T12:00:26.526 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7fc7c0939640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc7a4003980 0x7fc7bc1ec3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:26.526 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7fc7c0939640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7bc1db770 0x7fc7bc1d8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:26.526 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7fc7c0939640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc7bc1dcd70 0x7fc7bc09f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:26.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7fc7c0939640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7bc1d8a50 con 0x7fc7bc1db770 2023-10-08T12:00:26.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7fc7c0939640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7bc1e0590 con 0x7fc7bc1dcd70 2023-10-08T12:00:26.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7fc7c0939640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7bc0a08a0 con 0x7fc7a4003980 2023-10-08T12:00:26.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7f914bfff640 1 -- start start 2023-10-08T12:00:26.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7f914bfff640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f914c06c700 0x7f914c0a1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:26.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7f914bfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f914c071990 0x7f914c099d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:26.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7f914bfff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f914c1463e0 0x7f914c098400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:26.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7f914bfff640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f914c0a17c0 con 0x7f914c1463e0 2023-10-08T12:00:26.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7f914bfff640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f914c099480 con 0x7f914c071990 2023-10-08T12:00:26.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7f914bfff640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f914c142830 con 0x7f914c06c700 2023-10-08T12:00:26.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7f02997fa640 1 -- 172.21.15.62:0/2405363896 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0290005220 con 0x7f029c0b9210 2023-10-08T12:00:26.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7fe43bfff640 1 -- 172.21.15.62:0/1653584629 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe43c0afe70 msgr2=0x7fe43c06c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:26.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7fe43bfff640 1 --2- 172.21.15.62:0/1653584629 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe43c0afe70 0x7fe43c06c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7fe43bfff640 1 -- 172.21.15.62:0/1653584629 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe43c13f400 msgr2=0x7fe43c1417c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:26.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7fe43bfff640 1 --2- 172.21.15.62:0/1653584629 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe43c13f400 0x7fe43c1417c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7f9143fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f914c071990 0x7f914c099d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:26.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7fe43bfff640 1 -- 172.21.15.62:0/1653584629 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe434009820 con 0x7fe43c0b08f0 2023-10-08T12:00:26.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7fc7bad9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc7bc1dcd70 0x7fc7bc09f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:26.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7fc7bad9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc7bc1dcd70 0x7fc7bc09f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.62:34716/0 (socket says 172.21.15.62:34716) 2023-10-08T12:00:26.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7fc7bad9d640 1 -- 172.21.15.62:0/2202961685 learned_addr learned my addr 172.21.15.62:0/2202961685 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:26.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7f9143fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f914c071990 0x7f914c099d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.62:34726/0 (socket says 172.21.15.62:34726) 2023-10-08T12:00:26.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7f9143fff640 1 -- 172.21.15.62:0/3138689247 learned_addr learned my addr 172.21.15.62:0/3138689247 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:26.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7f75dddaf640 1 -- 172.21.15.62:0/3352473135 shutdown_connections 2023-10-08T12:00:26.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7f75dddaf640 1 --2- 172.21.15.62:0/3352473135 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f75d003ffe0 0x7f75d0030a50 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7f75dddaf640 1 -- 172.21.15.62:0/3352473135 >> 172.21.15.62:0/3352473135 conn(0x7f75d0006e50 msgr2=0x7f75d0007260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:26.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7fc7ba59c640 1 --2- 172.21.15.62:0/2202961685 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc7a4003980 0x7fc7bc1ec3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:26.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7fe43bfff640 1 --2- 172.21.15.62:0/1653584629 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe43c0b08f0 0x7fe43c140690 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe428000f70 tx=0x7fe42800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:26.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7fc7b9d9b640 1 --2- 172.21.15.62:0/2202961685 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7bc1db770 0x7fc7bc1d8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:26.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7f75dddaf640 1 -- 172.21.15.62:0/3352473135 shutdown_connections 2023-10-08T12:00:26.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7f75dddaf640 1 -- 172.21.15.62:0/3352473135 wait complete. 2023-10-08T12:00:26.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7f914affd640 1 --2- 172.21.15.62:0/3138689247 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f914c06c700 0x7f914c0a1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:26.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7fa7827fc640 1 --2- 172.21.15.62:0/3372406 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa7840b7270 0x7fa784144990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:26.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7fa7837fe640 1 --2- 172.21.15.62:0/3372406 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa78413fec0 0x7fa7841529a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:26.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7fa782ffd640 1 -- 172.21.15.62:0/3372406 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa7840b7270 msgr2=0x7fa784144990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:26.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7fa782ffd640 1 --2- 172.21.15.62:0/3372406 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa7840b7270 0x7fa784144990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7fa782ffd640 1 -- 172.21.15.62:0/3372406 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa78413fec0 msgr2=0x7fa7841529a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:26.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7fa782ffd640 1 --2- 172.21.15.62:0/3372406 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa78413fec0 0x7fa7841529a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7fa782ffd640 1 -- 172.21.15.62:0/3372406 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa77c009820 con 0x7fa78406f720 2023-10-08T12:00:26.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7f02a2e52640 1 -- 172.21.15.62:0/2405363896 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f029c1445e0 con 0x7f029c0b9210 2023-10-08T12:00:26.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7f02a2e52640 1 -- 172.21.15.62:0/2405363896 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f029c0a22a0 con 0x7f029c0b9210 2023-10-08T12:00:26.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7f02a2e52640 1 -- 172.21.15.62:0/2405363896 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f029c1511e0 con 0x7f029c0b9210 2023-10-08T12:00:26.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7f9143fff640 1 -- 172.21.15.62:0/3138689247 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f914c06c700 msgr2=0x7f914c0a1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:26.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7f9143fff640 1 --2- 172.21.15.62:0/3138689247 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f914c06c700 0x7f914c0a1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7f9143fff640 1 -- 172.21.15.62:0/3138689247 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f914c1463e0 msgr2=0x7f914c098400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:26.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7f9143fff640 1 --2- 172.21.15.62:0/3138689247 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f914c1463e0 0x7f914c098400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.536 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7f9143fff640 1 -- 172.21.15.62:0/3138689247 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91440098e0 con 0x7f914c071990 2023-10-08T12:00:26.536 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7fa782ffd640 1 --2- 172.21.15.62:0/3372406 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa78406f720 0x7fa7841e71b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa77400c3d0 tx=0x7fa77400c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:26.536 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7fc7bad9d640 1 -- 172.21.15.62:0/2202961685 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc7a4003980 msgr2=0x7fc7bc1ec3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:26.536 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7fc7bad9d640 1 --2- 172.21.15.62:0/2202961685 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc7a4003980 0x7fc7bc1ec3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.536 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7fc7bad9d640 1 -- 172.21.15.62:0/2202961685 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7bc1db770 msgr2=0x7fc7bc1d8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:26.536 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7fc7bad9d640 1 --2- 172.21.15.62:0/2202961685 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7bc1db770 0x7fc7bc1d8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.536 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.511+0000 7fc7bad9d640 1 -- 172.21.15.62:0/2202961685 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7bc1dbbb0 con 0x7fc7bc1dcd70 2023-10-08T12:00:26.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.515+0000 7fa76b7fe640 1 -- 172.21.15.62:0/3372406 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa774011790 con 0x7fa78406f720 2023-10-08T12:00:26.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.515+0000 7fa76b7fe640 1 -- 172.21.15.62:0/3372406 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa7740119e0 con 0x7fa78406f720 2023-10-08T12:00:26.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.515+0000 7fa76b7fe640 1 -- 172.21.15.62:0/3372406 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa774011e10 con 0x7fa78406f720 2023-10-08T12:00:26.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.515+0000 7fa78937c640 1 -- 172.21.15.62:0/3372406 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa784143d20 con 0x7fa78406f720 2023-10-08T12:00:26.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.515+0000 7fa78937c640 1 -- 172.21.15.62:0/3372406 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7841464f0 con 0x7fa78406f720 2023-10-08T12:00:26.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.515+0000 7f75dddaf640 1 Processor -- start 2023-10-08T12:00:26.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.515+0000 7fe4397fa640 1 -- 172.21.15.62:0/1653584629 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4280052d0 con 0x7fe43c0b08f0 2023-10-08T12:00:26.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.515+0000 7fe4397fa640 1 -- 172.21.15.62:0/1653584629 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe428003600 con 0x7fe43c0b08f0 2023-10-08T12:00:26.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.515+0000 7fe4397fa640 1 -- 172.21.15.62:0/1653584629 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe428003a10 con 0x7fe43c0b08f0 2023-10-08T12:00:26.539 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.515+0000 7fc7bad9d640 1 --2- 172.21.15.62:0/2202961685 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc7bc1dcd70 0x7fc7bc09f6e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc088f30 tx=0x7fc7b400f3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:26.539 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.515+0000 7fe441c64640 1 -- 172.21.15.62:0/1653584629 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe43c1536c0 con 0x7fe43c0b08f0 2023-10-08T12:00:26.539 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.515+0000 7f02997fa640 1 -- 172.21.15.62:0/2405363896 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0290005380 con 0x7f029c0b9210 2023-10-08T12:00:26.539 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.515+0000 7f02997fa640 1 -- 172.21.15.62:0/2405363896 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02900097c0 con 0x7f029c0b9210 2023-10-08T12:00:26.540 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.515+0000 7fa78937c640 1 -- 172.21.15.62:0/3372406 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa78404da80 con 0x7fa78406f720 2023-10-08T12:00:26.540 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.515+0000 7f9143fff640 1 --2- 172.21.15.62:0/3138689247 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f914c071990 0x7f914c099d90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f913c0058d0 tx=0x7f913c00dde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:26.540 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.515+0000 7f71d1218640 1 -- 172.21.15.62:0/158040995 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71c4039dc0 msgr2=0x7f71c40c6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:26.540 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.515+0000 7f71d1218640 1 --2- 172.21.15.62:0/158040995 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71c4039dc0 0x7f71c40c6960 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f71bc009900 tx=0x7f71bc02d8c0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.541 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.515+0000 7f91437fe640 1 -- 172.21.15.62:0/3138689247 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913c009c30 con 0x7f914c071990 2023-10-08T12:00:26.541 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.515+0000 7f914bfff640 1 -- 172.21.15.62:0/3138689247 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f914c098120 con 0x7f914c071990 2023-10-08T12:00:26.541 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.515+0000 7f914bfff640 1 -- 172.21.15.62:0/3138689247 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f914c099800 con 0x7f914c071990 2023-10-08T12:00:26.541 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.515+0000 7f91437fe640 1 -- 172.21.15.62:0/3138689247 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f913c009e80 con 0x7f914c071990 2023-10-08T12:00:26.541 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.515+0000 7f91437fe640 1 -- 172.21.15.62:0/3138689247 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913c0106a0 con 0x7f914c071990 2023-10-08T12:00:26.541 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.515+0000 7f02997fa640 1 -- 172.21.15.62:0/2405363896 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f0290009920 con 0x7f029c0b9210 2023-10-08T12:00:26.542 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.515+0000 7fc7aaffd640 1 -- 172.21.15.62:0/2202961685 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b400fe10 con 0x7fc7bc1dcd70 2023-10-08T12:00:26.542 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.515+0000 7f914bfff640 1 -- 172.21.15.62:0/3138689247 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9130000fd0 con 0x7f914c071990 2023-10-08T12:00:26.542 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.515+0000 7f02997fa640 1 --2- 172.21.15.62:0/2405363896 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f02800664a0 0x7f0280068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:26.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.515+0000 7f75dddaf640 1 -- start start 2023-10-08T12:00:26.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.515+0000 7f75dddaf640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75d003ffe0 0x7f75d004b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:26.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.515+0000 7f02997fa640 1 -- 172.21.15.62:0/2405363896 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0290084430 con 0x7f029c0b9210 2023-10-08T12:00:26.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.515+0000 7f75dddaf640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f75d0044f20 0x7f75d004a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:26.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.515+0000 7f75dddaf640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f75d00d8f50 0x7f75d016c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:26.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.515+0000 7f75dddaf640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d004ba00 con 0x7f75d003ffe0 2023-10-08T12:00:26.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.515+0000 7f75dddaf640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d00d81f0 con 0x7f75d0044f20 2023-10-08T12:00:26.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.515+0000 7f75dddaf640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75d0049770 con 0x7f75d00d8f50 2023-10-08T12:00:26.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.515+0000 7fe441c64640 1 -- 172.21.15.62:0/1653584629 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe43c140bd0 con 0x7fe43c0b08f0 2023-10-08T12:00:26.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.515+0000 7f75d6ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f75d0044f20 0x7f75d004a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:26.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.515+0000 7f75d6ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f75d0044f20 0x7f75d004a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.62:34742/0 (socket says 172.21.15.62:34742) 2023-10-08T12:00:26.545 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.515+0000 7f75d6ffd640 1 -- 172.21.15.62:0/2646092792 learned_addr learned my addr 172.21.15.62:0/2646092792 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:26.545 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.515+0000 7fa76b7fe640 1 -- 172.21.15.62:0/3372406 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa77401c460 con 0x7fa78406f720 2023-10-08T12:00:26.545 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.515+0000 7f02997fa640 1 --2- 172.21.15.62:0/2405363896 >> [v2:172.21.15.130:6806/2877303015,v1:172.21.15.130:6810/2877303015] conn(0x7f028006e640 0x7f0280070a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:26.545 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.515+0000 7f02997fa640 1 -- 172.21.15.62:0/2405363896 --> [v2:172.21.15.130:6806/2877303015,v1:172.21.15.130:6810/2877303015] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0280071110 con 0x7f028006e640 2023-10-08T12:00:26.545 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.515+0000 7f02997fa640 1 -- 172.21.15.62:0/2405363896 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0290084850 con 0x7f029c0b9210 2023-10-08T12:00:26.545 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.515+0000 7f029bfff640 1 --2- 172.21.15.62:0/2405363896 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f02800664a0 0x7f0280068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:26.546 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.515+0000 7f71d1218640 1 -- 172.21.15.62:0/158040995 shutdown_connections 2023-10-08T12:00:26.546 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.515+0000 7f71d1218640 1 --2- 172.21.15.62:0/158040995 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71c4039dc0 0x7f71c40c6960 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.546 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.515+0000 7f71d1218640 1 -- 172.21.15.62:0/158040995 >> 172.21.15.62:0/158040995 conn(0x7f71c4005e70 msgr2=0x7f71c4006280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:26.546 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.515+0000 7f71d1218640 1 -- 172.21.15.62:0/158040995 shutdown_connections 2023-10-08T12:00:26.546 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.515+0000 7fc7aaffd640 1 -- 172.21.15.62:0/2202961685 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc7b4004b30 con 0x7fc7bc1dcd70 2023-10-08T12:00:26.546 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.515+0000 7fc7aaffd640 1 -- 172.21.15.62:0/2202961685 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b4003980 con 0x7fc7bc1dcd70 2023-10-08T12:00:26.547 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.515+0000 7f75d7fff640 1 --2- 172.21.15.62:0/2646092792 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f75d00d8f50 0x7f75d016c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:26.547 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.515+0000 7f02a13ef640 1 --2- 172.21.15.62:0/2405363896 >> [v2:172.21.15.130:6806/2877303015,v1:172.21.15.130:6810/2877303015] conn(0x7f028006e640 0x7f0280070a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:26.547 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.515+0000 7fe441c64640 1 -- 172.21.15.62:0/1653584629 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe41c000fd0 con 0x7fe43c0b08f0 2023-10-08T12:00:26.548 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.515+0000 7f75d6ffd640 1 -- 172.21.15.62:0/2646092792 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f75d00d8f50 msgr2=0x7f75d016c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:26.548 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.515+0000 7f75d6ffd640 1 --2- 172.21.15.62:0/2646092792 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f75d00d8f50 0x7f75d016c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.548 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.515+0000 7f75d6ffd640 1 -- 172.21.15.62:0/2646092792 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75d003ffe0 msgr2=0x7f75d004b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:26.548 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.515+0000 7f75d6ffd640 1 --2- 172.21.15.62:0/2646092792 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75d003ffe0 0x7f75d004b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.548 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.515+0000 7f75d6ffd640 1 -- 172.21.15.62:0/2646092792 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75d804ea10 con 0x7f75d0044f20 2023-10-08T12:00:26.548 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.515+0000 7fa76b7fe640 1 --2- 172.21.15.62:0/3372406 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fa770066470 0x7fa770068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:26.548 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.515+0000 7fa76b7fe640 1 -- 172.21.15.62:0/3372406 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa774084880 con 0x7fa78406f720 2023-10-08T12:00:26.549 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.515+0000 7f71d1218640 1 -- 172.21.15.62:0/158040995 wait complete. 2023-10-08T12:00:26.549 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.515+0000 7fa76b7fe640 1 --2- 172.21.15.62:0/3372406 >> [v2:172.21.15.130:6804/1174056987,v1:172.21.15.130:6807/1174056987] conn(0x7fa77006e610 0x7fa770070a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:26.549 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.515+0000 7fa76b7fe640 1 -- 172.21.15.62:0/3372406 --> [v2:172.21.15.130:6804/1174056987,v1:172.21.15.130:6807/1174056987] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa7700710e0 con 0x7fa77006e610 2023-10-08T12:00:26.549 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.515+0000 7fa76b7fe640 1 -- 172.21.15.62:0/3372406 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa774084cd0 con 0x7fa78406f720 2023-10-08T12:00:26.549 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.519+0000 7f71d1218640 1 Processor -- start 2023-10-08T12:00:26.550 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.519+0000 7fa7827fc640 1 --2- 172.21.15.62:0/3372406 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fa770066470 0x7fa770068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:26.550 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.519+0000 7f75d6ffd640 1 --2- 172.21.15.62:0/2646092792 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f75d0044f20 0x7f75d004a400 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f75cc00c4c0 tx=0x7f75cc00c980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:26.550 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.519+0000 7f029bfff640 1 --2- 172.21.15.62:0/2405363896 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f02800664a0 0x7f0280068960 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f029c0b8c90 tx=0x7f0288009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:26.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.519+0000 7fc7c0939640 1 -- 172.21.15.62:0/2202961685 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7bc1eb950 con 0x7fc7bc1dcd70 2023-10-08T12:00:26.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.519+0000 7fc7c0939640 1 -- 172.21.15.62:0/2202961685 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7bc1ebea0 con 0x7fc7bc1dcd70 2023-10-08T12:00:26.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.519+0000 7f75c3fff640 1 -- 172.21.15.62:0/2646092792 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75cc0052d0 con 0x7f75d0044f20 2023-10-08T12:00:26.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.519+0000 7f75c3fff640 1 -- 172.21.15.62:0/2646092792 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f75cc005430 con 0x7f75d0044f20 2023-10-08T12:00:26.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.519+0000 7f75c3fff640 1 -- 172.21.15.62:0/2646092792 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75cc012890 con 0x7f75d0044f20 2023-10-08T12:00:26.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.519+0000 7f91437fe640 1 -- 172.21.15.62:0/3138689247 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f913c010800 con 0x7f914c071990 2023-10-08T12:00:26.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.519+0000 7f91437fe640 1 --2- 172.21.15.62:0/3138689247 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f912c066470 0x7f912c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:26.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.519+0000 7f71d1218640 1 -- start start 2023-10-08T12:00:26.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.519+0000 7f71d1218640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71c40399e0 0x7f71c40c82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:26.553 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.519+0000 7f75dddaf640 1 -- 172.21.15.62:0/2646092792 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75d0049440 con 0x7f75d0044f20 2023-10-08T12:00:26.553 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.519+0000 7f75dddaf640 1 -- 172.21.15.62:0/2646092792 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75d0049c00 con 0x7f75d0044f20 2023-10-08T12:00:26.553 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.519+0000 7fc7c0939640 1 -- 172.21.15.62:0/2202961685 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc7bc0b5460 con 0x7fc7bc1dcd70 2023-10-08T12:00:26.553 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.519+0000 7f91437fe640 1 -- 172.21.15.62:0/3138689247 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f913c084730 con 0x7f914c071990 2023-10-08T12:00:26.553 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.519+0000 7f91437fe640 1 --2- 172.21.15.62:0/3138689247 >> [v2:172.21.15.62:6816/3385303160,v1:172.21.15.62:6817/3385303160] conn(0x7f912c06e610 0x7f912c070a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:26.554 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.519+0000 7f91437fe640 1 -- 172.21.15.62:0/3138689247 --> [v2:172.21.15.62:6816/3385303160,v1:172.21.15.62:6817/3385303160] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f912c0710e0 con 0x7f912c06e610 2023-10-08T12:00:26.554 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.519+0000 7f91437fe640 1 -- 172.21.15.62:0/3138689247 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f913c084b80 con 0x7f914c071990 2023-10-08T12:00:26.554 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.519+0000 7f914b7fe640 1 --2- 172.21.15.62:0/3138689247 >> [v2:172.21.15.62:6816/3385303160,v1:172.21.15.62:6817/3385303160] conn(0x7f912c06e610 0x7f912c070a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:26.554 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.519+0000 7fe4397fa640 1 -- 172.21.15.62:0/1653584629 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe428003b70 con 0x7fe43c0b08f0 2023-10-08T12:00:26.554 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.519+0000 7f914b7fe640 1 --2- 172.21.15.62:0/3138689247 >> [v2:172.21.15.62:6816/3385303160,v1:172.21.15.62:6817/3385303160] conn(0x7f912c06e610 0x7f912c070a30 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:26.555 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.519+0000 7f75dddaf640 1 -- 172.21.15.62:0/2646092792 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f75d00492a0 con 0x7f75d0044f20 2023-10-08T12:00:26.555 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.519+0000 7f71d1218640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f71c4039dc0 0x7f71c4169970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:26.555 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.519+0000 7f71d1218640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f71c40c6ea0 0x7f71c4169eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:26.555 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.519+0000 7f71d1218640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c40c8810 con 0x7f71c40c6ea0 2023-10-08T12:00:26.556 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.519+0000 7f71d1218640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c40ca750 con 0x7f71c40399e0 2023-10-08T12:00:26.556 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.519+0000 7fe4397fa640 1 --2- 172.21.15.62:0/1653584629 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fe420066540 0x7fe420068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:26.556 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.519+0000 7f71d1218640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71c40c1dc0 con 0x7f71c4039dc0 2023-10-08T12:00:26.556 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.519+0000 7f71cb59e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f71c40c6ea0 0x7f71c4169eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:26.556 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.519+0000 7f71cb59e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f71c40c6ea0 0x7f71c4169eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43722/0 (socket says 172.21.15.62:43722) 2023-10-08T12:00:26.557 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.519+0000 7f71cb59e640 1 -- 172.21.15.62:0/2987032543 learned_addr learned my addr 172.21.15.62:0/2987032543 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:26.557 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.519+0000 7f71ca59c640 1 --2- 172.21.15.62:0/2987032543 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f71c4039dc0 0x7f71c4169970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:26.557 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.519+0000 7fe4397fa640 1 -- 172.21.15.62:0/1653584629 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe428083c20 con 0x7fe43c0b08f0 2023-10-08T12:00:26.557 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.519+0000 7fe4397fa640 1 --2- 172.21.15.62:0/1653584629 >> [v2:172.21.15.62:6800/315660906,v1:172.21.15.62:6801/315660906] conn(0x7fe42006e760 0x7fe420070b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:26.557 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.519+0000 7fe4397fa640 1 -- 172.21.15.62:0/1653584629 --> [v2:172.21.15.62:6800/315660906,v1:172.21.15.62:6801/315660906] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe420071230 con 0x7fe42006e760 2023-10-08T12:00:26.557 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.519+0000 7fe4397fa640 1 -- 172.21.15.62:0/1653584629 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe428083fd0 con 0x7fe43c0b08f0 2023-10-08T12:00:26.558 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.519+0000 7fe441463640 1 --2- 172.21.15.62:0/1653584629 >> [v2:172.21.15.62:6800/315660906,v1:172.21.15.62:6801/315660906] conn(0x7fe42006e760 0x7fe420070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:26.558 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.519+0000 7fa7837fe640 1 --2- 172.21.15.62:0/3372406 >> [v2:172.21.15.130:6804/1174056987,v1:172.21.15.130:6807/1174056987] conn(0x7fa77006e610 0x7fa770070a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:26.558 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.519+0000 7fa7827fc640 1 --2- 172.21.15.62:0/3372406 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fa770066470 0x7fa770068930 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa77c0b1000 tx=0x7fa77c01dbb0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:26.558 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.519+0000 7fa7837fe640 1 --2- 172.21.15.62:0/3372406 >> [v2:172.21.15.130:6804/1174056987,v1:172.21.15.130:6807/1174056987] conn(0x7fa77006e610 0x7fa770070a30 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:26.558 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.519+0000 7f02a13ef640 1 --2- 172.21.15.62:0/2405363896 >> [v2:172.21.15.130:6806/2877303015,v1:172.21.15.130:6810/2877303015] conn(0x7f028006e640 0x7f0280070a60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:26.559 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.519+0000 7f71cb59e640 1 -- 172.21.15.62:0/2987032543 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f71c4039dc0 msgr2=0x7f71c4169970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:26.559 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.519+0000 7f71cb59e640 1 --2- 172.21.15.62:0/2987032543 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f71c4039dc0 0x7f71c4169970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.559 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.519+0000 7f71cb59e640 1 -- 172.21.15.62:0/2987032543 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71c40399e0 msgr2=0x7f71c40c82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:26.559 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.519+0000 7f71cb59e640 1 --2- 172.21.15.62:0/2987032543 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71c40399e0 0x7f71c40c82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.559 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.519+0000 7f914affd640 1 --2- 172.21.15.62:0/3138689247 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f912c066470 0x7f912c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:26.560 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.519+0000 7f71cb59e640 1 -- 172.21.15.62:0/2987032543 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71bc009560 con 0x7f71c40c6ea0 2023-10-08T12:00:26.560 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.519+0000 7fe440c62640 1 --2- 172.21.15.62:0/1653584629 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fe420066540 0x7fe420068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:26.560 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.519+0000 7f71cb59e640 1 --2- 172.21.15.62:0/2987032543 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f71c40c6ea0 0x7f71c4169eb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f71cc072160 tx=0x7f71cc066920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:26.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.519+0000 7f91437fe640 1 -- 172.21.15.62:0/3138689247 <== osd.3 v2:172.21.15.62:6816/3385303160 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f912c0710e0 con 0x7f912c06e610 2023-10-08T12:00:26.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.519+0000 7fe441463640 1 --2- 172.21.15.62:0/1653584629 >> [v2:172.21.15.62:6800/315660906,v1:172.21.15.62:6801/315660906] conn(0x7fe42006e760 0x7fe420070b80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:26.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.519+0000 7fc7aaffd640 1 -- 172.21.15.62:0/2202961685 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc7b4003ae0 con 0x7fc7bc1dcd70 2023-10-08T12:00:26.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.523+0000 7f75c3fff640 1 -- 172.21.15.62:0/2646092792 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f75cc003600 con 0x7f75d0044f20 2023-10-08T12:00:26.562 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.523+0000 7f75c3fff640 1 --2- 172.21.15.62:0/2646092792 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f75bc0664f0 0x7f75bc0689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:26.562 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.523+0000 7f75c3fff640 1 -- 172.21.15.62:0/2646092792 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f75cc0843b0 con 0x7f75d0044f20 2023-10-08T12:00:26.562 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.523+0000 7f75c3fff640 1 --2- 172.21.15.62:0/2646092792 >> [v2:172.21.15.62:6818/2227876905,v1:172.21.15.62:6820/2227876905] conn(0x7f75bc06e710 0x7f75bc070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:26.562 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.523+0000 7f75c3fff640 1 -- 172.21.15.62:0/2646092792 --> [v2:172.21.15.62:6818/2227876905,v1:172.21.15.62:6820/2227876905] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f75bc0711e0 con 0x7f75bc06e710 2023-10-08T12:00:26.562 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.523+0000 7f75c3fff640 1 -- 172.21.15.62:0/2646092792 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f75cc084850 con 0x7f75d0044f20 2023-10-08T12:00:26.562 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.523+0000 7fe440c62640 1 --2- 172.21.15.62:0/1653584629 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fe420066540 0x7fe420068a00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe430001bc0 tx=0x7fe430001b50 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:26.563 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.523+0000 7fc7aaffd640 1 --2- 172.21.15.62:0/2202961685 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fc79c066470 0x7fc79c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:26.563 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.523+0000 7fc7aaffd640 1 -- 172.21.15.62:0/2202961685 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc7b40855c0 con 0x7fc7bc1dcd70 2023-10-08T12:00:26.563 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.523+0000 7fc7aaffd640 1 --2- 172.21.15.62:0/2202961685 >> [v2:172.21.15.62:6807/3784842938,v1:172.21.15.62:6809/3784842938] conn(0x7fc79c06e690 0x7fc79c070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:26.563 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.523+0000 7fc7aaffd640 1 -- 172.21.15.62:0/2202961685 --> [v2:172.21.15.62:6807/3784842938,v1:172.21.15.62:6809/3784842938] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc79c071160 con 0x7fc79c06e690 2023-10-08T12:00:26.563 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.523+0000 7fc7aaffd640 1 -- 172.21.15.62:0/2202961685 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc7b4085970 con 0x7fc7bc1dcd70 2023-10-08T12:00:26.563 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.523+0000 7fc7b9d9b640 1 --2- 172.21.15.62:0/2202961685 >> [v2:172.21.15.62:6807/3784842938,v1:172.21.15.62:6809/3784842938] conn(0x7fc79c06e690 0x7fc79c070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:26.563 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.523+0000 7fc7b9d9b640 1 --2- 172.21.15.62:0/2202961685 >> [v2:172.21.15.62:6807/3784842938,v1:172.21.15.62:6809/3784842938] conn(0x7fc79c06e690 0x7fc79c070ab0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:26.564 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.523+0000 7f914affd640 1 --2- 172.21.15.62:0/3138689247 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f912c066470 0x7f912c068930 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f91340016c0 tx=0x7f9134009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:26.564 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.523+0000 7fa76b7fe640 1 -- 172.21.15.62:0/3372406 <== osd.4 v2:172.21.15.130:6804/1174056987 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fa7700710e0 con 0x7fa77006e610 2023-10-08T12:00:26.564 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.523+0000 7f02997fa640 1 -- 172.21.15.62:0/2405363896 <== osd.6 v2:172.21.15.130:6806/2877303015 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f0280071110 con 0x7f028006e640 2023-10-08T12:00:26.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.523+0000 7fe4397fa640 1 -- 172.21.15.62:0/1653584629 <== osd.1 v2:172.21.15.62:6800/315660906 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fe420071230 con 0x7fe42006e760 2023-10-08T12:00:26.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.527+0000 7f71b37fe640 1 -- 172.21.15.62:0/2987032543 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71cc08f320 con 0x7f71c40c6ea0 2023-10-08T12:00:26.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.527+0000 7f71d1218640 1 -- 172.21.15.62:0/2987032543 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71c40c8a00 con 0x7f71c40c6ea0 2023-10-08T12:00:26.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.527+0000 7f71d1218640 1 -- 172.21.15.62:0/2987032543 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71c40c1ae0 con 0x7f71c40c6ea0 2023-10-08T12:00:26.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.527+0000 7f71b37fe640 1 -- 172.21.15.62:0/2987032543 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f71cc08f590 con 0x7f71c40c6ea0 2023-10-08T12:00:26.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.527+0000 7f71b37fe640 1 -- 172.21.15.62:0/2987032543 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71cc08f9a0 con 0x7f71c40c6ea0 2023-10-08T12:00:26.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.527+0000 7fd6566cf640 1 -- 172.21.15.62:0/627268956 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd650145c60 msgr2=0x7fd6500b7020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:26.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.527+0000 7fd6566cf640 1 --2- 172.21.15.62:0/627268956 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd650145c60 0x7fd6500b7020 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd640009840 tx=0x7fd64001c790 comp rx=0 tx=0).stop 2023-10-08T12:00:26.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.527+0000 7fd6566cf640 1 -- 172.21.15.62:0/627268956 shutdown_connections 2023-10-08T12:00:26.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.527+0000 7fd6566cf640 1 --2- 172.21.15.62:0/627268956 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd650145c60 0x7fd6500b7020 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.527+0000 7fd6566cf640 1 -- 172.21.15.62:0/627268956 >> 172.21.15.62:0/627268956 conn(0x7fd6500b8110 msgr2=0x7fd6500b8520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:26.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.527+0000 7fd6566cf640 1 -- 172.21.15.62:0/627268956 shutdown_connections 2023-10-08T12:00:26.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.527+0000 7fd6566cf640 1 -- 172.21.15.62:0/627268956 wait complete. 2023-10-08T12:00:26.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.527+0000 7fd6566cf640 1 Processor -- start 2023-10-08T12:00:26.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.527+0000 7fd6566cf640 1 -- start start 2023-10-08T12:00:26.569 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.527+0000 7fd6566cf640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd650071b90 0x7fd650138640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:26.569 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.527+0000 7fd6566cf640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd6500b2510 0x7fd65013f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:26.569 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.527+0000 7fd6556cd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd650071b90 0x7fd650138640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:26.569 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.527+0000 7fd6556cd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd650071b90 0x7fd650138640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43734/0 (socket says 172.21.15.62:43734) 2023-10-08T12:00:26.569 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.527+0000 7fd6556cd640 1 -- 172.21.15.62:0/1816162997 learned_addr learned my addr 172.21.15.62:0/1816162997 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:26.569 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.527+0000 7fd6566cf640 1 --2- 172.21.15.62:0/1816162997 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd650145c60 0x7fd65013dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:26.569 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.527+0000 7fd6566cf640 1 -- 172.21.15.62:0/1816162997 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd650138b80 con 0x7fd650071b90 2023-10-08T12:00:26.569 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.527+0000 7fd6566cf640 1 -- 172.21.15.62:0/1816162997 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd65013d7d0 con 0x7fd6500b2510 2023-10-08T12:00:26.569 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.531+0000 7fd6566cf640 1 -- 172.21.15.62:0/1816162997 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd65013e520 con 0x7fd650145c60 2023-10-08T12:00:26.570 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.531+0000 7fc7ba59c640 1 --2- 172.21.15.62:0/2202961685 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fc79c066470 0x7fc79c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:26.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.531+0000 7fd654ecc640 1 --2- 172.21.15.62:0/1816162997 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd6500b2510 0x7fd65013f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:26.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.531+0000 7fd6556cd640 1 -- 172.21.15.62:0/1816162997 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd650145c60 msgr2=0x7fd65013dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:26.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.531+0000 7fd6556cd640 1 --2- 172.21.15.62:0/1816162997 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd650145c60 0x7fd65013dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.531+0000 7fd6556cd640 1 -- 172.21.15.62:0/1816162997 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd6500b2510 msgr2=0x7fd65013f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:26.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.531+0000 7fd6556cd640 1 --2- 172.21.15.62:0/1816162997 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd6500b2510 0x7fd65013f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.531+0000 7fd6556cd640 1 -- 172.21.15.62:0/1816162997 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6400094a0 con 0x7fd650071b90 2023-10-08T12:00:26.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.531+0000 7fd6556cd640 1 --2- 172.21.15.62:0/1816162997 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd650071b90 0x7fd650138640 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd64c00c4b0 tx=0x7fd64c00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:26.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.531+0000 7f75d77fe640 1 --2- 172.21.15.62:0/2646092792 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f75bc0664f0 0x7f75bc0689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:26.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.531+0000 7f71d1218640 1 -- 172.21.15.62:0/2987032543 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f71c40cb770 con 0x7f71c40c6ea0 2023-10-08T12:00:26.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.531+0000 7fc7ba59c640 1 --2- 172.21.15.62:0/2202961685 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fc79c066470 0x7fc79c068930 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc7b00b0000 tx=0x7fc7b0005040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:26.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.531+0000 7f75d77fe640 1 --2- 172.21.15.62:0/2646092792 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f75bc0664f0 0x7f75bc0689b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f75d0048140 tx=0x7f75d8094310 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:26.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.535+0000 7f75d7fff640 1 --2- 172.21.15.62:0/2646092792 >> [v2:172.21.15.62:6818/2227876905,v1:172.21.15.62:6820/2227876905] conn(0x7f75bc06e710 0x7f75bc070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:26.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.535+0000 7f75d7fff640 1 --2- 172.21.15.62:0/2646092792 >> [v2:172.21.15.62:6818/2227876905,v1:172.21.15.62:6820/2227876905] conn(0x7f75bc06e710 0x7f75bc070b30 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:26.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.535+0000 7f75c3fff640 1 -- 172.21.15.62:0/2646092792 <== osd.0 v2:172.21.15.62:6818/2227876905 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f75bc0711e0 con 0x7f75bc06e710 2023-10-08T12:00:26.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.535+0000 7fc7aaffd640 1 -- 172.21.15.62:0/2202961685 <== osd.2 v2:172.21.15.62:6807/3784842938 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fc79c071160 con 0x7fc79c06e690 2023-10-08T12:00:26.574 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.535+0000 7f71b37fe640 1 -- 172.21.15.62:0/2987032543 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f71cc08fb00 con 0x7f71c40c6ea0 2023-10-08T12:00:26.574 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.535+0000 7f71b37fe640 1 --2- 172.21.15.62:0/2987032543 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f71b8066540 0x7f71b8068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:26.574 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.535+0000 7f71b37fe640 1 -- 172.21.15.62:0/2987032543 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f71cc0fc0b0 con 0x7f71c40c6ea0 2023-10-08T12:00:26.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.535+0000 7f71b37fe640 1 --2- 172.21.15.62:0/2987032543 >> [v2:172.21.15.130:6824/680009774,v1:172.21.15.130:6825/680009774] conn(0x7f71b806e760 0x7f71b8070b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:26.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.535+0000 7f71b37fe640 1 -- 172.21.15.62:0/2987032543 --> [v2:172.21.15.130:6824/680009774,v1:172.21.15.130:6825/680009774] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f71b8071230 con 0x7f71b806e760 2023-10-08T12:00:26.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.535+0000 7f71b37fe640 1 -- 172.21.15.62:0/2987032543 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f71cc0fc460 con 0x7f71c40c6ea0 2023-10-08T12:00:26.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.535+0000 7f71cad9d640 1 --2- 172.21.15.62:0/2987032543 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f71b8066540 0x7f71b8068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:26.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.535+0000 7f71cad9d640 1 --2- 172.21.15.62:0/2987032543 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f71b8066540 0x7f71b8068a00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f71c0000f70 tx=0x7f71c00079c0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:26.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.539+0000 7f71ca59c640 1 --2- 172.21.15.62:0/2987032543 >> [v2:172.21.15.130:6824/680009774,v1:172.21.15.130:6825/680009774] conn(0x7f71b806e760 0x7f71b8070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:26.576 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.539+0000 7fd645ffb640 1 -- 172.21.15.62:0/1816162997 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd64c012830 con 0x7fd650071b90 2023-10-08T12:00:26.576 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.539+0000 7fd645ffb640 1 -- 172.21.15.62:0/1816162997 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd64c012a80 con 0x7fd650071b90 2023-10-08T12:00:26.576 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.539+0000 7fd645ffb640 1 -- 172.21.15.62:0/1816162997 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd64c012e50 con 0x7fd650071b90 2023-10-08T12:00:26.576 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.539+0000 7fd6566cf640 1 -- 172.21.15.62:0/1816162997 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd65013e800 con 0x7fd650071b90 2023-10-08T12:00:26.576 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.539+0000 7fd6566cf640 1 -- 172.21.15.62:0/1816162997 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6500701e0 con 0x7fd650071b90 2023-10-08T12:00:26.577 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.539+0000 7fd6337fe640 1 -- 172.21.15.62:0/1816162997 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd62c000fd0 con 0x7fd650071b90 2023-10-08T12:00:26.577 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.539+0000 7fd645ffb640 1 -- 172.21.15.62:0/1816162997 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd64c01a3b0 con 0x7fd650071b90 2023-10-08T12:00:26.577 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.539+0000 7fd645ffb640 1 --2- 172.21.15.62:0/1816162997 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fd6340664f0 0x7fd6340689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:26.577 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.539+0000 7fd645ffb640 1 -- 172.21.15.62:0/1816162997 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd64c083f10 con 0x7fd650071b90 2023-10-08T12:00:26.577 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.539+0000 7fd654ecc640 1 --2- 172.21.15.62:0/1816162997 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fd6340664f0 0x7fd6340689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:26.577 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.539+0000 7fd645ffb640 1 --2- 172.21.15.62:0/1816162997 >> [v2:172.21.15.130:6800/561928414,v1:172.21.15.130:6801/561928414] conn(0x7fd63406e690 0x7fd634070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:26.577 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.539+0000 7fd645ffb640 1 -- 172.21.15.62:0/1816162997 --> [v2:172.21.15.130:6800/561928414,v1:172.21.15.130:6801/561928414] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd634071160 con 0x7fd63406e690 2023-10-08T12:00:26.577 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.543+0000 7fd645ffb640 1 -- 172.21.15.62:0/1816162997 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd64c051400 con 0x7fd650071b90 2023-10-08T12:00:26.577 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.543+0000 7fd655ece640 1 --2- 172.21.15.62:0/1816162997 >> [v2:172.21.15.130:6800/561928414,v1:172.21.15.130:6801/561928414] conn(0x7fd63406e690 0x7fd634070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:26.577 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.543+0000 7f71ca59c640 1 --2- 172.21.15.62:0/2987032543 >> [v2:172.21.15.130:6824/680009774,v1:172.21.15.130:6825/680009774] conn(0x7f71b806e760 0x7f71b8070b80 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:26.578 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.543+0000 7fd654ecc640 1 --2- 172.21.15.62:0/1816162997 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fd6340664f0 0x7fd6340689b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd6400af000 tx=0x7fd64001afd0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:26.578 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.543+0000 7fd655ece640 1 --2- 172.21.15.62:0/1816162997 >> [v2:172.21.15.130:6800/561928414,v1:172.21.15.130:6801/561928414] conn(0x7fd63406e690 0x7fd634070ab0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:26.578 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.543+0000 7f71b37fe640 1 -- 172.21.15.62:0/2987032543 <== osd.7 v2:172.21.15.130:6824/680009774 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f71b8071230 con 0x7f71b806e760 2023-10-08T12:00:26.579 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.543+0000 7f02a2e52640 1 -- 172.21.15.62:0/2405363896 --> [v2:172.21.15.130:6806/2877303015,v1:172.21.15.130:6810/2877303015] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f029c1e3cd0 con 0x7f028006e640 2023-10-08T12:00:26.579 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.543+0000 7fd645ffb640 1 -- 172.21.15.62:0/1816162997 <== osd.5 v2:172.21.15.130:6800/561928414 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fd634071160 con 0x7fd63406e690 2023-10-08T12:00:26.579 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.543+0000 7f02997fa640 1 -- 172.21.15.62:0/2405363896 <== osd.6 v2:172.21.15.130:6806/2877303015 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f02940af3f0 con 0x7f028006e640 2023-10-08T12:00:26.580 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.547+0000 7f02a2e52640 1 -- 172.21.15.62:0/2405363896 >> [v2:172.21.15.130:6806/2877303015,v1:172.21.15.130:6810/2877303015] conn(0x7f028006e640 msgr2=0x7f0280070a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:26.580 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.547+0000 7f02a2e52640 1 --2- 172.21.15.62:0/2405363896 >> [v2:172.21.15.130:6806/2877303015,v1:172.21.15.130:6810/2877303015] conn(0x7f028006e640 0x7f0280070a60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.581 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.547+0000 7f02a2e52640 1 -- 172.21.15.62:0/2405363896 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f02800664a0 msgr2=0x7f0280068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:26.581 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.547+0000 7f02a2e52640 1 --2- 172.21.15.62:0/2405363896 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f02800664a0 0x7f0280068960 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f029c0b8c90 tx=0x7f0288009040 comp rx=0 tx=0).stop 2023-10-08T12:00:26.581 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.547+0000 7f02a2e52640 1 -- 172.21.15.62:0/2405363896 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f029c0b9210 msgr2=0x7f029c1e4020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:26.581 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.547+0000 7f02a2e52640 1 --2- 172.21.15.62:0/2405363896 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f029c0b9210 0x7f029c1e4020 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f029000d6d0 tx=0x7f029000db90 comp rx=0 tx=0).stop 2023-10-08T12:00:26.581 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.547+0000 7f02a13ef640 1 -- 172.21.15.62:0/2405363896 reap_dead start 2023-10-08T12:00:26.581 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.547+0000 7f02a2e52640 1 -- 172.21.15.62:0/2405363896 shutdown_connections 2023-10-08T12:00:26.581 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.547+0000 7f02a2e52640 1 -- 172.21.15.62:0/2405363896 >> 172.21.15.62:0/2405363896 conn(0x7f029c0be890 msgr2=0x7f029c14f090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:26.581 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.547+0000 7f914bfff640 1 -- 172.21.15.62:0/3138689247 --> [v2:172.21.15.62:6816/3385303160,v1:172.21.15.62:6817/3385303160] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9130002cf0 con 0x7f912c06e610 2023-10-08T12:00:26.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.547+0000 7f02a2e52640 1 -- 172.21.15.62:0/2405363896 shutdown_connections 2023-10-08T12:00:26.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.547+0000 7f02a2e52640 1 -- 172.21.15.62:0/2405363896 wait complete. 2023-10-08T12:00:26.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.547+0000 7f91437fe640 1 -- 172.21.15.62:0/3138689247 <== osd.3 v2:172.21.15.62:6816/3385303160 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9130002cf0 con 0x7f912c06e610 2023-10-08T12:00:26.584 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.547+0000 7f914bfff640 1 -- 172.21.15.62:0/3138689247 >> [v2:172.21.15.62:6816/3385303160,v1:172.21.15.62:6817/3385303160] conn(0x7f912c06e610 msgr2=0x7f912c070a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:26.584 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.547+0000 7f914bfff640 1 --2- 172.21.15.62:0/3138689247 >> [v2:172.21.15.62:6816/3385303160,v1:172.21.15.62:6817/3385303160] conn(0x7f912c06e610 0x7f912c070a30 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.584 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.551+0000 7f914bfff640 1 -- 172.21.15.62:0/3138689247 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f912c066470 msgr2=0x7f912c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:26.584 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.551+0000 7f914bfff640 1 --2- 172.21.15.62:0/3138689247 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f912c066470 0x7f912c068930 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f91340016c0 tx=0x7f9134009040 comp rx=0 tx=0).stop 2023-10-08T12:00:26.584 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.551+0000 7f914bfff640 1 -- 172.21.15.62:0/3138689247 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f914c071990 msgr2=0x7f914c099d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:26.584 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.551+0000 7f914bfff640 1 --2- 172.21.15.62:0/3138689247 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f914c071990 0x7f914c099d90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f913c0058d0 tx=0x7f913c00dde0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.584 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.551+0000 7f914b7fe640 1 -- 172.21.15.62:0/3138689247 reap_dead start 2023-10-08T12:00:26.584 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.551+0000 7f914bfff640 1 -- 172.21.15.62:0/3138689247 shutdown_connections 2023-10-08T12:00:26.584 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.551+0000 7f914bfff640 1 -- 172.21.15.62:0/3138689247 >> 172.21.15.62:0/3138689247 conn(0x7f914c09d4c0 msgr2=0x7f914c0b9510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:26.584 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.551+0000 7f914bfff640 1 -- 172.21.15.62:0/3138689247 shutdown_connections 2023-10-08T12:00:26.584 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.551+0000 7f914bfff640 1 -- 172.21.15.62:0/3138689247 wait complete. 2023-10-08T12:00:26.585 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.551+0000 7fa78937c640 1 -- 172.21.15.62:0/3372406 --> [v2:172.21.15.130:6804/1174056987,v1:172.21.15.130:6807/1174056987] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa78404da80 con 0x7fa77006e610 2023-10-08T12:00:26.585 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.551+0000 7fa76b7fe640 1 -- 172.21.15.62:0/3372406 <== osd.4 v2:172.21.15.130:6804/1174056987 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa78404da80 con 0x7fa77006e610 2023-10-08T12:00:26.586 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.551+0000 7fa78937c640 1 -- 172.21.15.62:0/3372406 >> [v2:172.21.15.130:6804/1174056987,v1:172.21.15.130:6807/1174056987] conn(0x7fa77006e610 msgr2=0x7fa770070a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:26.586 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.551+0000 7fa78937c640 1 --2- 172.21.15.62:0/3372406 >> [v2:172.21.15.130:6804/1174056987,v1:172.21.15.130:6807/1174056987] conn(0x7fa77006e610 0x7fa770070a30 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.587 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.551+0000 7fa78937c640 1 -- 172.21.15.62:0/3372406 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fa770066470 msgr2=0x7fa770068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:26.587 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.551+0000 7fa78937c640 1 --2- 172.21.15.62:0/3372406 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fa770066470 0x7fa770068930 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa77c0b1000 tx=0x7fa77c01dbb0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.587 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.551+0000 7fa78937c640 1 -- 172.21.15.62:0/3372406 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa78406f720 msgr2=0x7fa7841e71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:26.587 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.551+0000 7fa78937c640 1 --2- 172.21.15.62:0/3372406 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa78406f720 0x7fa7841e71b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa77400c3d0 tx=0x7fa77400c890 comp rx=0 tx=0).stop 2023-10-08T12:00:26.587 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.551+0000 7fa7837fe640 1 -- 172.21.15.62:0/3372406 reap_dead start 2023-10-08T12:00:26.587 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.551+0000 7fa78937c640 1 -- 172.21.15.62:0/3372406 shutdown_connections 2023-10-08T12:00:26.587 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.551+0000 7fa78937c640 1 -- 172.21.15.62:0/3372406 >> 172.21.15.62:0/3372406 conn(0x7fa784069790 msgr2=0x7fa7840b5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:26.587 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.551+0000 7fa78937c640 1 -- 172.21.15.62:0/3372406 shutdown_connections 2023-10-08T12:00:26.587 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.551+0000 7fa78937c640 1 -- 172.21.15.62:0/3372406 wait complete. 2023-10-08T12:00:26.588 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.559+0000 7fc7c0939640 1 -- 172.21.15.62:0/2202961685 --> [v2:172.21.15.62:6807/3784842938,v1:172.21.15.62:6809/3784842938] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc7bc1ec0c0 con 0x7fc79c06e690 2023-10-08T12:00:26.588 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.559+0000 7fc7aaffd640 1 -- 172.21.15.62:0/2202961685 <== osd.2 v2:172.21.15.62:6807/3784842938 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc7bc1ec0c0 con 0x7fc79c06e690 2023-10-08T12:00:26.588 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.559+0000 7fc7a8ff9640 1 -- 172.21.15.62:0/2202961685 >> [v2:172.21.15.62:6807/3784842938,v1:172.21.15.62:6809/3784842938] conn(0x7fc79c06e690 msgr2=0x7fc79c070ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:26.588 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.559+0000 7fc7a8ff9640 1 --2- 172.21.15.62:0/2202961685 >> [v2:172.21.15.62:6807/3784842938,v1:172.21.15.62:6809/3784842938] conn(0x7fc79c06e690 0x7fc79c070ab0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.589 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.559+0000 7fc7a8ff9640 1 -- 172.21.15.62:0/2202961685 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fc79c066470 msgr2=0x7fc79c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:26.589 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.559+0000 7fc7a8ff9640 1 --2- 172.21.15.62:0/2202961685 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fc79c066470 0x7fc79c068930 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc7b00b0000 tx=0x7fc7b0005040 comp rx=0 tx=0).stop 2023-10-08T12:00:26.589 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.559+0000 7fe441c64640 1 -- 172.21.15.62:0/1653584629 --> [v2:172.21.15.62:6800/315660906,v1:172.21.15.62:6801/315660906] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe41c002cc0 con 0x7fe42006e760 2023-10-08T12:00:26.589 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.559+0000 7fc7a8ff9640 1 -- 172.21.15.62:0/2202961685 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc7bc1dcd70 msgr2=0x7fc7bc09f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:26.590 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.559+0000 7fc7a8ff9640 1 --2- 172.21.15.62:0/2202961685 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc7bc1dcd70 0x7fc7bc09f6e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc088f30 tx=0x7fc7b400f3c0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.590 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.559+0000 7fc7bad9d640 1 -- 172.21.15.62:0/2202961685 reap_dead start 2023-10-08T12:00:26.590 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.559+0000 7fc7a8ff9640 1 -- 172.21.15.62:0/2202961685 shutdown_connections 2023-10-08T12:00:26.590 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.559+0000 7fc7a8ff9640 1 -- 172.21.15.62:0/2202961685 >> 172.21.15.62:0/2202961685 conn(0x7fc7bc09c600 msgr2=0x7fc7bc1e1810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:26.590 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.559+0000 7fc7a8ff9640 1 -- 172.21.15.62:0/2202961685 shutdown_connections 2023-10-08T12:00:26.590 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.559+0000 7fc7a8ff9640 1 -- 172.21.15.62:0/2202961685 wait complete. 2023-10-08T12:00:26.590 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.559+0000 7fe4397fa640 1 -- 172.21.15.62:0/1653584629 <== osd.1 v2:172.21.15.62:6800/315660906 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe41c002cc0 con 0x7fe42006e760 2023-10-08T12:00:26.591 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.559+0000 7fe426ffd640 1 -- 172.21.15.62:0/1653584629 >> [v2:172.21.15.62:6800/315660906,v1:172.21.15.62:6801/315660906] conn(0x7fe42006e760 msgr2=0x7fe420070b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:26.591 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.559+0000 7fe426ffd640 1 --2- 172.21.15.62:0/1653584629 >> [v2:172.21.15.62:6800/315660906,v1:172.21.15.62:6801/315660906] conn(0x7fe42006e760 0x7fe420070b80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.592 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.559+0000 7fe426ffd640 1 -- 172.21.15.62:0/1653584629 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fe420066540 msgr2=0x7fe420068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:26.592 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.559+0000 7fe426ffd640 1 --2- 172.21.15.62:0/1653584629 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fe420066540 0x7fe420068a00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe430001bc0 tx=0x7fe430001b50 comp rx=0 tx=0).stop 2023-10-08T12:00:26.592 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.559+0000 7fe426ffd640 1 -- 172.21.15.62:0/1653584629 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe43c0b08f0 msgr2=0x7fe43c140690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:26.592 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.559+0000 7fe426ffd640 1 --2- 172.21.15.62:0/1653584629 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe43c0b08f0 0x7fe43c140690 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe428000f70 tx=0x7fe42800c890 comp rx=0 tx=0).stop 2023-10-08T12:00:26.592 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.559+0000 7fe441463640 1 -- 172.21.15.62:0/1653584629 reap_dead start 2023-10-08T12:00:26.592 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.559+0000 7fe426ffd640 1 -- 172.21.15.62:0/1653584629 shutdown_connections 2023-10-08T12:00:26.592 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.559+0000 7fe426ffd640 1 -- 172.21.15.62:0/1653584629 >> 172.21.15.62:0/1653584629 conn(0x7fe43c0b8d50 msgr2=0x7fe43c13d630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:26.592 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.563+0000 7f75dddaf640 1 -- 172.21.15.62:0/2646092792 --> [v2:172.21.15.62:6818/2227876905,v1:172.21.15.62:6820/2227876905] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f75d00064b0 con 0x7f75bc06e710 2023-10-08T12:00:26.593 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.563+0000 7f75c3fff640 1 -- 172.21.15.62:0/2646092792 <== osd.0 v2:172.21.15.62:6818/2227876905 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f75d00064b0 con 0x7f75bc06e710 2023-10-08T12:00:26.593 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.563+0000 7f75dddaf640 1 -- 172.21.15.62:0/2646092792 >> [v2:172.21.15.62:6818/2227876905,v1:172.21.15.62:6820/2227876905] conn(0x7f75bc06e710 msgr2=0x7f75bc070b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:26.593 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.563+0000 7f75dddaf640 1 --2- 172.21.15.62:0/2646092792 >> [v2:172.21.15.62:6818/2227876905,v1:172.21.15.62:6820/2227876905] conn(0x7f75bc06e710 0x7f75bc070b30 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.594 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.563+0000 7f75dddaf640 1 -- 172.21.15.62:0/2646092792 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f75bc0664f0 msgr2=0x7f75bc0689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:26.594 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.563+0000 7f75dddaf640 1 --2- 172.21.15.62:0/2646092792 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f75bc0664f0 0x7f75bc0689b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f75d0048140 tx=0x7f75d8094310 comp rx=0 tx=0).stop 2023-10-08T12:00:26.594 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.563+0000 7f75dddaf640 1 -- 172.21.15.62:0/2646092792 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f75d0044f20 msgr2=0x7f75d004a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:26.594 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.563+0000 7f75dddaf640 1 --2- 172.21.15.62:0/2646092792 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f75d0044f20 0x7f75d004a400 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f75cc00c4c0 tx=0x7f75cc00c980 comp rx=0 tx=0).stop 2023-10-08T12:00:26.594 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.563+0000 7f75d7fff640 1 -- 172.21.15.62:0/2646092792 reap_dead start 2023-10-08T12:00:26.594 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.563+0000 7f71d1218640 1 -- 172.21.15.62:0/2987032543 --> [v2:172.21.15.130:6824/680009774,v1:172.21.15.130:6825/680009774] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f71c40cb770 con 0x7f71b806e760 2023-10-08T12:00:26.595 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.567+0000 7f75dddaf640 1 -- 172.21.15.62:0/2646092792 shutdown_connections 2023-10-08T12:00:26.595 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.567+0000 7f75dddaf640 1 -- 172.21.15.62:0/2646092792 >> 172.21.15.62:0/2646092792 conn(0x7f75d0006e50 msgr2=0x7f75d0005b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:26.595 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.567+0000 7f75dddaf640 1 -- 172.21.15.62:0/2646092792 shutdown_connections 2023-10-08T12:00:26.595 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.567+0000 7f75dddaf640 1 -- 172.21.15.62:0/2646092792 wait complete. 2023-10-08T12:00:26.595 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.567+0000 7fe426ffd640 1 -- 172.21.15.62:0/1653584629 shutdown_connections 2023-10-08T12:00:26.595 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.567+0000 7fe426ffd640 1 -- 172.21.15.62:0/1653584629 wait complete. 2023-10-08T12:00:26.596 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.567+0000 7f71b37fe640 1 -- 172.21.15.62:0/2987032543 <== osd.7 v2:172.21.15.130:6824/680009774 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f71bc004040 con 0x7f71b806e760 2023-10-08T12:00:26.597 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.567+0000 7f71d1218640 1 -- 172.21.15.62:0/2987032543 >> [v2:172.21.15.130:6824/680009774,v1:172.21.15.130:6825/680009774] conn(0x7f71b806e760 msgr2=0x7f71b8070b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:26.597 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.567+0000 7f71d1218640 1 --2- 172.21.15.62:0/2987032543 >> [v2:172.21.15.130:6824/680009774,v1:172.21.15.130:6825/680009774] conn(0x7f71b806e760 0x7f71b8070b80 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.597 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.567+0000 7f71d1218640 1 -- 172.21.15.62:0/2987032543 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f71b8066540 msgr2=0x7f71b8068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:26.597 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.567+0000 7f71d1218640 1 --2- 172.21.15.62:0/2987032543 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f71b8066540 0x7f71b8068a00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f71c0000f70 tx=0x7f71c00079c0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.597 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.567+0000 7f71d1218640 1 -- 172.21.15.62:0/2987032543 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f71c40c6ea0 msgr2=0x7f71c4169eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:26.597 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.567+0000 7f71d1218640 1 --2- 172.21.15.62:0/2987032543 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f71c40c6ea0 0x7f71c4169eb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f71cc072160 tx=0x7f71cc066920 comp rx=0 tx=0).stop 2023-10-08T12:00:26.597 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.567+0000 7f71cb59e640 1 -- 172.21.15.62:0/2987032543 reap_dead start 2023-10-08T12:00:26.598 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.567+0000 7f71d1218640 1 -- 172.21.15.62:0/2987032543 shutdown_connections 2023-10-08T12:00:26.598 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.567+0000 7f71d1218640 1 -- 172.21.15.62:0/2987032543 >> 172.21.15.62:0/2987032543 conn(0x7f71c4005e70 msgr2=0x7f71c40c4690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:26.598 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.567+0000 7f71d1218640 1 -- 172.21.15.62:0/2987032543 shutdown_connections 2023-10-08T12:00:26.598 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.567+0000 7f71d1218640 1 -- 172.21.15.62:0/2987032543 wait complete. 2023-10-08T12:00:26.598 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.571+0000 7fd6337fe640 1 -- 172.21.15.62:0/1816162997 --> [v2:172.21.15.130:6800/561928414,v1:172.21.15.130:6801/561928414] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd62c002cc0 con 0x7fd63406e690 2023-10-08T12:00:26.599 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.571+0000 7fd645ffb640 1 -- 172.21.15.62:0/1816162997 <== osd.5 v2:172.21.15.130:6800/561928414 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd62c002cc0 con 0x7fd63406e690 2023-10-08T12:00:26.601 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.571+0000 7fd6337fe640 1 -- 172.21.15.62:0/1816162997 >> [v2:172.21.15.130:6800/561928414,v1:172.21.15.130:6801/561928414] conn(0x7fd63406e690 msgr2=0x7fd634070ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:26.601 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.571+0000 7fd6337fe640 1 --2- 172.21.15.62:0/1816162997 >> [v2:172.21.15.130:6800/561928414,v1:172.21.15.130:6801/561928414] conn(0x7fd63406e690 0x7fd634070ab0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.601 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.571+0000 7fd6337fe640 1 -- 172.21.15.62:0/1816162997 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fd6340664f0 msgr2=0x7fd6340689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:26.601 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.571+0000 7fd6337fe640 1 --2- 172.21.15.62:0/1816162997 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fd6340664f0 0x7fd6340689b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd6400af000 tx=0x7fd64001afd0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.602 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.571+0000 7fd6337fe640 1 -- 172.21.15.62:0/1816162997 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd650071b90 msgr2=0x7fd650138640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:26.602 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.575+0000 7fd6337fe640 1 --2- 172.21.15.62:0/1816162997 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd650071b90 0x7fd650138640 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd64c00c4b0 tx=0x7fd64c00c970 comp rx=0 tx=0).stop 2023-10-08T12:00:26.602 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.575+0000 7fd655ece640 1 -- 172.21.15.62:0/1816162997 reap_dead start 2023-10-08T12:00:26.602 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.575+0000 7fd6337fe640 1 -- 172.21.15.62:0/1816162997 shutdown_connections 2023-10-08T12:00:26.602 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.575+0000 7fd6337fe640 1 -- 172.21.15.62:0/1816162997 >> 172.21.15.62:0/1816162997 conn(0x7fd6500b8110 msgr2=0x7fd6500b0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:26.602 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.575+0000 7fd6337fe640 1 -- 172.21.15.62:0/1816162997 shutdown_connections 2023-10-08T12:00:26.602 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.575+0000 7fd6337fe640 1 -- 172.21.15.62:0/1816162997 wait complete. 2023-10-08T12:00:26.603 INFO:teuthology.orchestra.run.smithi062.stdout:55834574854 2023-10-08T12:00:26.603 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-08T12:00:26.604 INFO:teuthology.orchestra.run.smithi062.stdout:55834574855 2023-10-08T12:00:26.605 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-08T12:00:26.605 INFO:teuthology.orchestra.run.smithi062.stdout:55834574855 2023-10-08T12:00:26.606 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-08T12:00:26.607 INFO:teuthology.orchestra.run.smithi062.stdout:55834574854 2023-10-08T12:00:26.607 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-08T12:00:26.608 INFO:teuthology.orchestra.run.smithi062.stdout:55834574853 2023-10-08T12:00:26.608 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-08T12:00:26.609 INFO:teuthology.orchestra.run.smithi062.stdout:55834574855 2023-10-08T12:00:26.609 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-08T12:00:26.610 INFO:teuthology.orchestra.run.smithi062.stdout:55834574856 2023-10-08T12:00:26.611 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-08T12:00:26.612 INFO:teuthology.orchestra.run.smithi062.stdout:55834574854 2023-10-08T12:00:26.612 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-08T12:00:26.812 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.807+0000 7fcf8cadf640 1 -- 172.21.15.62:0/1381537413 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf880b0040 msgr2=0x7fcf88160270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:26.812 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.807+0000 7fcf8cadf640 1 --2- 172.21.15.62:0/1381537413 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf880b0040 0x7fcf88160270 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcf80009800 tx=0x7fcf8001f4d0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.812 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.807+0000 7fcf8cadf640 1 -- 172.21.15.62:0/1381537413 shutdown_connections 2023-10-08T12:00:26.812 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.807+0000 7fcf8cadf640 1 --2- 172.21.15.62:0/1381537413 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf880b0040 0x7fcf88160270 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.812 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.807+0000 7fcf8cadf640 1 --2- 172.21.15.62:0/1381537413 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcf8806ad90 0x7fcf88155a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.812 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.807+0000 7fcf8cadf640 1 -- 172.21.15.62:0/1381537413 >> 172.21.15.62:0/1381537413 conn(0x7fcf880b7360 msgr2=0x7fcf880b7770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:26.812 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.807+0000 7fcf8cadf640 1 -- 172.21.15.62:0/1381537413 shutdown_connections 2023-10-08T12:00:26.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.807+0000 7fcf8cadf640 1 -- 172.21.15.62:0/1381537413 wait complete. 2023-10-08T12:00:26.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.807+0000 7fcf8cadf640 1 Processor -- start 2023-10-08T12:00:26.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.807+0000 7fcf8cadf640 1 -- start start 2023-10-08T12:00:26.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.811+0000 7fcf8cadf640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf8806ad90 0x7fcf88159670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:26.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.811+0000 7fcf8cadf640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcf880b0040 0x7fcf8809c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:26.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.811+0000 7fcf8cadf640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf8809b490 0x7fcf881f7980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:26.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.811+0000 7fcf8cadf640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf88158950 con 0x7fcf8809b490 2023-10-08T12:00:26.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.811+0000 7fcf8cadf640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf88159bb0 con 0x7fcf8806ad90 2023-10-08T12:00:26.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.811+0000 7fcf8cadf640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8809d0c0 con 0x7fcf880b0040 2023-10-08T12:00:26.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.811+0000 7fcf86d9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf8809b490 0x7fcf881f7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:26.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.811+0000 7fcf86d9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf8809b490 0x7fcf881f7980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43752/0 (socket says 172.21.15.62:43752) 2023-10-08T12:00:26.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.811+0000 7fcf86d9d640 1 -- 172.21.15.62:0/684515496 learned_addr learned my addr 172.21.15.62:0/684515496 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:26.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.811+0000 7fcf85d9b640 1 --2- 172.21.15.62:0/684515496 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcf880b0040 0x7fcf8809c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:26.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.811+0000 7fcf8659c640 1 --2- 172.21.15.62:0/684515496 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf8806ad90 0x7fcf88159670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:26.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.811+0000 7fcf86d9d640 1 -- 172.21.15.62:0/684515496 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcf880b0040 msgr2=0x7fcf8809c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:26.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.811+0000 7fcf86d9d640 1 --2- 172.21.15.62:0/684515496 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcf880b0040 0x7fcf8809c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.811+0000 7fcf86d9d640 1 -- 172.21.15.62:0/684515496 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf8806ad90 msgr2=0x7fcf88159670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:26.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.811+0000 7fcf86d9d640 1 --2- 172.21.15.62:0/684515496 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf8806ad90 0x7fcf88159670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.811+0000 7fcf86d9d640 1 -- 172.21.15.62:0/684515496 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf80009460 con 0x7fcf8809b490 2023-10-08T12:00:26.818 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.811+0000 7fcbdb346640 1 -- 172.21.15.62:0/2430076819 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcbc0004d10 msgr2=0x7fcbc0005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:26.818 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.811+0000 7fcbdb346640 1 --2- 172.21.15.62:0/2430076819 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcbc0004d10 0x7fcbc0005190 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc00c670 tx=0x7fcbcc01d360 comp rx=0 tx=0).stop 2023-10-08T12:00:26.818 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.811+0000 7fcbd98e3640 1 -- 172.21.15.62:0/2430076819 reap_dead start 2023-10-08T12:00:26.818 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.811+0000 7fcbdb346640 1 -- 172.21.15.62:0/2430076819 shutdown_connections 2023-10-08T12:00:26.818 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.811+0000 7fcbdb346640 1 -- 172.21.15.62:0/2430076819 >> 172.21.15.62:0/2430076819 conn(0x7fcbd409c600 msgr2=0x7fcbd409ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:26.818 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.811+0000 7fcbdb346640 1 -- 172.21.15.62:0/2430076819 shutdown_connections 2023-10-08T12:00:26.818 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.811+0000 7fcbdb346640 1 -- 172.21.15.62:0/2430076819 wait complete. 2023-10-08T12:00:26.819 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.811+0000 7fcf86d9d640 1 --2- 172.21.15.62:0/684515496 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf8809b490 0x7fcf881f7980 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fcf80009750 tx=0x7fcf80004680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:26.819 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.811+0000 7fcf76ffd640 1 -- 172.21.15.62:0/684515496 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf800be070 con 0x7fcf8809b490 2023-10-08T12:00:26.819 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.811+0000 7fcf8cadf640 1 -- 172.21.15.62:0/684515496 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf880b0f00 con 0x7fcf8809b490 2023-10-08T12:00:26.819 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.811+0000 7fcf8cadf640 1 -- 172.21.15.62:0/684515496 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf8809af70 con 0x7fcf8809b490 2023-10-08T12:00:26.819 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.811+0000 7fcf76ffd640 1 -- 172.21.15.62:0/684515496 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fcf80003dd0 con 0x7fcf8809b490 2023-10-08T12:00:26.819 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.811+0000 7fcf76ffd640 1 -- 172.21.15.62:0/684515496 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf80004a50 con 0x7fcf8809b490 2023-10-08T12:00:26.820 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.815+0000 7fcbdb346640 1 Processor -- start 2023-10-08T12:00:26.820 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.815+0000 7fcf8cadf640 1 -- 172.21.15.62:0/684515496 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf6c005260 con 0x7fcf8809b490 2023-10-08T12:00:26.820 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.815+0000 7fcbdb346640 1 -- start start 2023-10-08T12:00:26.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.815+0000 7fcf76ffd640 1 -- 172.21.15.62:0/684515496 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fcf800b6070 con 0x7fcf8809b490 2023-10-08T12:00:26.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.815+0000 7fcf76ffd640 1 --2- 172.21.15.62:0/684515496 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fcf68066540 0x7fcf68068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:26.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.815+0000 7fcf76ffd640 1 -- 172.21.15.62:0/684515496 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcf801215c0 con 0x7fcf8809b490 2023-10-08T12:00:26.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.815+0000 7fcbdb346640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcbc0004d10 0x7fcbd409b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:26.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.815+0000 7fcbdb346640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcbd41d0620 0x7fcbd40994b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:26.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.815+0000 7fcbdb346640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcbd4147080 0x7fcbd4147530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:26.822 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.815+0000 7fcbdb346640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd409be90 con 0x7fcbd4147080 2023-10-08T12:00:26.822 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.815+0000 7fcbdb346640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd4146bf0 con 0x7fcbc0004d10 2023-10-08T12:00:26.822 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.815+0000 7fcbdb346640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd4147a70 con 0x7fcbd41d0620 2023-10-08T12:00:26.822 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.815+0000 7fcf8659c640 1 --2- 172.21.15.62:0/684515496 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fcf68066540 0x7fcf68068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:26.823 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.815+0000 7fcbd98e3640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcbd4147080 0x7fcbd4147530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:26.823 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.815+0000 7fcbd98e3640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcbd4147080 0x7fcbd4147530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43768/0 (socket says 172.21.15.62:43768) 2023-10-08T12:00:26.823 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.815+0000 7fcbd98e3640 1 -- 172.21.15.62:0/2626637130 learned_addr learned my addr 172.21.15.62:0/2626637130 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:26.823 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.815+0000 7fcbd90e2640 1 --2- 172.21.15.62:0/2626637130 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcbc0004d10 0x7fcbd409b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:26.823 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.815+0000 7fcbd88e1640 1 --2- 172.21.15.62:0/2626637130 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcbd41d0620 0x7fcbd40994b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:26.823 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.815+0000 7fcbd98e3640 1 -- 172.21.15.62:0/2626637130 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcbd41d0620 msgr2=0x7fcbd40994b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:26.823 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.815+0000 7fcbd98e3640 1 --2- 172.21.15.62:0/2626637130 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcbd41d0620 0x7fcbd40994b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.823 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.815+0000 7fcbd98e3640 1 -- 172.21.15.62:0/2626637130 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcbc0004d10 msgr2=0x7fcbd409b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:26.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.815+0000 7fcbd98e3640 1 --2- 172.21.15.62:0/2626637130 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcbc0004d10 0x7fcbd409b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.815+0000 7fcbd98e3640 1 -- 172.21.15.62:0/2626637130 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbd40b7170 con 0x7fcbd4147080 2023-10-08T12:00:26.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.815+0000 7fcbd98e3640 1 --2- 172.21.15.62:0/2626637130 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcbd4147080 0x7fcbd4147530 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc01dc00 tx=0x7fcbcc0a5f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:26.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.815+0000 7fcf8659c640 1 --2- 172.21.15.62:0/684515496 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fcf68066540 0x7fcf68068a00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcf7800db40 tx=0x7fcf7800f040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:26.826 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.823+0000 7fcf76ffd640 1 -- 172.21.15.62:0/684515496 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fcf800eec70 con 0x7fcf8809b490 2023-10-08T12:00:26.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.823+0000 7fcbc9ffb640 1 -- 172.21.15.62:0/2626637130 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbcc006290 con 0x7fcbd4147080 2023-10-08T12:00:26.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.823+0000 7fcbc9ffb640 1 -- 172.21.15.62:0/2626637130 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fcbcc0b3070 con 0x7fcbd4147080 2023-10-08T12:00:26.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.823+0000 7fcbdb346640 1 -- 172.21.15.62:0/2626637130 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbd41e2750 con 0x7fcbd4147080 2023-10-08T12:00:26.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.823+0000 7fcbdb346640 1 -- 172.21.15.62:0/2626637130 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbd40999f0 con 0x7fcbd4147080 2023-10-08T12:00:26.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.827+0000 7fcbc9ffb640 1 -- 172.21.15.62:0/2626637130 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbcc006610 con 0x7fcbd4147080 2023-10-08T12:00:26.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.827+0000 7fcbdb346640 1 -- 172.21.15.62:0/2626637130 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbd4065f50 con 0x7fcbd4147080 2023-10-08T12:00:26.832 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.827+0000 7ff752e0d640 1 -- 172.21.15.62:0/696297440 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff74403ba40 msgr2=0x7ff7440d9640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:26.832 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.827+0000 7fcbc9ffb640 1 -- 172.21.15.62:0/2626637130 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fcbcc006770 con 0x7fcbd4147080 2023-10-08T12:00:26.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.827+0000 7fcbc9ffb640 1 --2- 172.21.15.62:0/2626637130 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fcbb80664a0 0x7fcbb8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:26.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.827+0000 7fcbc9ffb640 1 -- 172.21.15.62:0/2626637130 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcbcc11e9f0 con 0x7fcbd4147080 2023-10-08T12:00:26.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.827+0000 7ff74b7fe640 1 -- 172.21.15.62:0/696297440 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7380a57f0 con 0x7ff74403ba40 2023-10-08T12:00:26.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.827+0000 7ff752e0d640 1 --2- 172.21.15.62:0/696297440 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff74403ba40 0x7ff7440d9640 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff738009840 tx=0x7ff73801c820 comp rx=0 tx=0).stop 2023-10-08T12:00:26.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.827+0000 7ff752e0d640 1 -- 172.21.15.62:0/696297440 shutdown_connections 2023-10-08T12:00:26.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.827+0000 7ff752e0d640 1 --2- 172.21.15.62:0/696297440 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff74403ba40 0x7ff7440d9640 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.827+0000 7ff752e0d640 1 --2- 172.21.15.62:0/696297440 >> v2:172.21.15.62:3300/0 conn(0x7ff7440cece0 0x7ff74403cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.827+0000 7ff752e0d640 1 -- 172.21.15.62:0/696297440 >> 172.21.15.62:0/696297440 conn(0x7ff744044620 msgr2=0x7ff744044a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:26.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.827+0000 7ff752e0d640 1 -- 172.21.15.62:0/696297440 shutdown_connections 2023-10-08T12:00:26.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.831+0000 7fcbd90e2640 1 --2- 172.21.15.62:0/2626637130 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fcbb80664a0 0x7fcbb8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:26.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.827+0000 7ff752e0d640 1 -- 172.21.15.62:0/696297440 wait complete. 2023-10-08T12:00:26.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.831+0000 7ff752e0d640 1 Processor -- start 2023-10-08T12:00:26.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.831+0000 7fcbd90e2640 1 --2- 172.21.15.62:0/2626637130 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fcbb80664a0 0x7fcbb8068960 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcbc4005790 tx=0x7fcbc400b2e0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:26.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.831+0000 7ff752e0d640 1 -- start start 2023-10-08T12:00:26.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.831+0000 7ff752e0d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff74403ba40 0x7ff744009230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:26.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.831+0000 7ff752e0d640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff7440c5770 0x7ff7440d2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:26.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.831+0000 7ff752e0d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7440cece0 0x7ff7440bd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:26.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.831+0000 7ff752e0d640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff744009770 con 0x7ff74403ba40 2023-10-08T12:00:26.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.831+0000 7ff752e0d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff74417a6f0 con 0x7ff7440cece0 2023-10-08T12:00:26.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.831+0000 7ff752e0d640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff74417a930 con 0x7ff7440c5770 2023-10-08T12:00:26.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.831+0000 7ff750ba9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff74403ba40 0x7ff744009230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:26.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.831+0000 7ff750ba9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff74403ba40 0x7ff744009230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43798/0 (socket says 172.21.15.62:43798) 2023-10-08T12:00:26.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.831+0000 7ff750ba9640 1 -- 172.21.15.62:0/2492577807 learned_addr learned my addr 172.21.15.62:0/2492577807 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:26.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.831+0000 7ff750ba9640 1 -- 172.21.15.62:0/2492577807 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff7440c5770 msgr2=0x7ff7440d2530 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T12:00:26.837 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.831+0000 7ff750ba9640 1 --2- 172.21.15.62:0/2492577807 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff7440c5770 0x7ff7440d2530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.837 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.831+0000 7ff750ba9640 1 -- 172.21.15.62:0/2492577807 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7440cece0 msgr2=0x7ff7440bd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:26.837 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.831+0000 7ff750ba9640 1 --2- 172.21.15.62:0/2492577807 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7440cece0 0x7ff7440bd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.837 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.831+0000 7ff750ba9640 1 -- 172.21.15.62:0/2492577807 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7380094a0 con 0x7ff74403ba40 2023-10-08T12:00:26.837 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.831+0000 7ff750ba9640 1 --2- 172.21.15.62:0/2492577807 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff74403ba40 0x7ff744009230 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff74c062dd0 tx=0x7ff74c0669e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:26.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.835+0000 7f8f34b8e640 1 -- 172.21.15.62:0/191548495 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8f30149270 msgr2=0x7f8f3006a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:26.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.835+0000 7f8f34b8e640 1 --2- 172.21.15.62:0/191548495 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8f30149270 0x7f8f3006a9a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8f24009900 tx=0x7f8f2401c850 comp rx=0 tx=0).stop 2023-10-08T12:00:26.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.835+0000 7f8f34b8e640 1 -- 172.21.15.62:0/191548495 shutdown_connections 2023-10-08T12:00:26.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.835+0000 7f8f34b8e640 1 --2- 172.21.15.62:0/191548495 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8f30149270 0x7f8f3006a9a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.835+0000 7f8f34b8e640 1 -- 172.21.15.62:0/191548495 >> 172.21.15.62:0/191548495 conn(0x7f8f300a0540 msgr2=0x7f8f300a0950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:26.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.835+0000 7f8f34b8e640 1 -- 172.21.15.62:0/191548495 shutdown_connections 2023-10-08T12:00:26.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.835+0000 7f8f34b8e640 1 -- 172.21.15.62:0/191548495 wait complete. 2023-10-08T12:00:26.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.835+0000 7f42e759e640 1 -- 172.21.15.62:0/2277063990 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f42e0007600 msgr2=0x7f42e00e0c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:26.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.835+0000 7f42e759e640 1 --2- 172.21.15.62:0/2277063990 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f42e0007600 0x7f42e00e0c40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f42e8072160 tx=0x7f42e8097510 comp rx=0 tx=0).stop 2023-10-08T12:00:26.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.835+0000 7f42e759e640 1 -- 172.21.15.62:0/2277063990 shutdown_connections 2023-10-08T12:00:26.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.835+0000 7f42e759e640 1 --2- 172.21.15.62:0/2277063990 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f42e0007600 0x7f42e00e0c40 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.835+0000 7f42e759e640 1 -- 172.21.15.62:0/2277063990 >> 172.21.15.62:0/2277063990 conn(0x7f42e0043210 msgr2=0x7f42e0043620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:26.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.835+0000 7f42e759e640 1 -- 172.21.15.62:0/2277063990 shutdown_connections 2023-10-08T12:00:26.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.835+0000 7f42e759e640 1 -- 172.21.15.62:0/2277063990 wait complete. 2023-10-08T12:00:26.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.835+0000 7fcbc9ffb640 1 -- 172.21.15.62:0/2626637130 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fcbcc0ebe00 con 0x7fcbd4147080 2023-10-08T12:00:26.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.835+0000 7f42e759e640 1 Processor -- start 2023-10-08T12:00:26.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.835+0000 7f8f34b8e640 1 Processor -- start 2023-10-08T12:00:26.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.835+0000 7f42e759e640 1 -- start start 2023-10-08T12:00:26.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.835+0000 7f42e759e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f42e0007190 0x7f42e00447d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:26.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.835+0000 7f42e759e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f42e0007600 0x7f42e00cbc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:26.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.835+0000 7f42e759e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42e003d2a0 0x7f42e0045420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:26.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.835+0000 7f42e759e640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e0044d10 con 0x7f42e003d2a0 2023-10-08T12:00:26.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.835+0000 7f42e759e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e00d3810 con 0x7f42e0007600 2023-10-08T12:00:26.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.835+0000 7f42e759e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42e00ce720 con 0x7f42e0007190 2023-10-08T12:00:26.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.835+0000 7f42e659c640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f42e0007190 0x7f42e00447d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:26.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.835+0000 7f42e5d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f42e0007600 0x7f42e00cbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:26.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.835+0000 7f42e659c640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f42e0007190 0x7f42e00447d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.62:48094/0 (socket says 172.21.15.62:48094) 2023-10-08T12:00:26.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.835+0000 7f42e659c640 1 -- 172.21.15.62:0/3341145152 learned_addr learned my addr 172.21.15.62:0/3341145152 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:26.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.839+0000 7f42e6d9d640 1 --2- 172.21.15.62:0/3341145152 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42e003d2a0 0x7f42e0045420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:26.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.835+0000 7f8f34b8e640 1 -- start start 2023-10-08T12:00:26.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.839+0000 7f8f34b8e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f300ba2e0 0x7f8f30141540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:26.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.839+0000 7f8f34b8e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8f3013e7e0 0x7f8f3006cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:26.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.839+0000 7f8f34b8e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8f30149270 0x7f8f301e67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:26.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.839+0000 7f8f34b8e640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f30141a80 con 0x7f8f300ba2e0 2023-10-08T12:00:26.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.839+0000 7f8f34b8e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3006d420 con 0x7f8f30149270 2023-10-08T12:00:26.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.839+0000 7f8f34b8e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f301e9d90 con 0x7f8f3013e7e0 2023-10-08T12:00:26.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.839+0000 7f42e659c640 1 -- 172.21.15.62:0/3341145152 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f42e0007600 msgr2=0x7f42e00cbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:26.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.839+0000 7f42e659c640 1 --2- 172.21.15.62:0/3341145152 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f42e0007600 0x7f42e00cbc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.839+0000 7f42e659c640 1 -- 172.21.15.62:0/3341145152 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42e003d2a0 msgr2=0x7f42e0045420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:26.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.839+0000 7f42e659c640 1 --2- 172.21.15.62:0/3341145152 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42e003d2a0 0x7f42e0045420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.839+0000 7f42e659c640 1 -- 172.21.15.62:0/3341145152 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42e804ea10 con 0x7f42e0007190 2023-10-08T12:00:26.847 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.839+0000 7f8f2e59c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f300ba2e0 0x7f8f30141540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:26.847 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.839+0000 7f8f2e59c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f300ba2e0 0x7f8f30141540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43802/0 (socket says 172.21.15.62:43802) 2023-10-08T12:00:26.847 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.839+0000 7f8f2e59c640 1 -- 172.21.15.62:0/2102046068 learned_addr learned my addr 172.21.15.62:0/2102046068 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:26.847 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.839+0000 7f8f2dd9b640 1 --2- 172.21.15.62:0/2102046068 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8f3013e7e0 0x7f8f3006cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:26.847 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.839+0000 7f42e659c640 1 --2- 172.21.15.62:0/3341145152 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f42e0007190 0x7f42e00447d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f42dc00c3f0 tx=0x7f42dc00c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:26.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.839+0000 7f8f2e59c640 1 -- 172.21.15.62:0/2102046068 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8f3013e7e0 msgr2=0x7f8f3006cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:26.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.839+0000 7f8f2e59c640 1 --2- 172.21.15.62:0/2102046068 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8f3013e7e0 0x7f8f3006cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.839+0000 7f8f2e59c640 1 -- 172.21.15.62:0/2102046068 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8f30149270 msgr2=0x7f8f301e67d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T12:00:26.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.839+0000 7f8f2e59c640 1 --2- 172.21.15.62:0/2102046068 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8f30149270 0x7f8f301e67d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.839+0000 7f8f2e59c640 1 -- 172.21.15.62:0/2102046068 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f24009560 con 0x7f8f300ba2e0 2023-10-08T12:00:26.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.839+0000 7f8f2e59c640 1 --2- 172.21.15.62:0/2102046068 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f300ba2e0 0x7f8f30141540 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8f24019460 tx=0x7f8f240a5710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:26.849 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.839+0000 7f42d6ffd640 1 -- 172.21.15.62:0/3341145152 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42dc0052d0 con 0x7f42e0007190 2023-10-08T12:00:26.849 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.839+0000 7f42d6ffd640 1 -- 172.21.15.62:0/3341145152 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f42dc003600 con 0x7f42e0007190 2023-10-08T12:00:26.849 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.839+0000 7f42d6ffd640 1 -- 172.21.15.62:0/3341145152 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42dc003a10 con 0x7f42e0007190 2023-10-08T12:00:26.849 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.839+0000 7f42e759e640 1 -- 172.21.15.62:0/3341145152 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42e016b6d0 con 0x7f42e0007190 2023-10-08T12:00:26.849 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.839+0000 7f42e759e640 1 -- 172.21.15.62:0/3341145152 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42e0046410 con 0x7f42e0007190 2023-10-08T12:00:26.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.839+0000 7f42e759e640 1 -- 172.21.15.62:0/3341145152 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42e00057c0 con 0x7f42e0007190 2023-10-08T12:00:26.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.843+0000 7f42d6ffd640 1 -- 172.21.15.62:0/3341145152 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f42dc003b70 con 0x7f42e0007190 2023-10-08T12:00:26.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.843+0000 7f42d6ffd640 1 --2- 172.21.15.62:0/3341145152 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f42c8066470 0x7f42c8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:26.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.843+0000 7ff7497fa640 1 -- 172.21.15.62:0/2492577807 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff74c091470 con 0x7ff74403ba40 2023-10-08T12:00:26.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.843+0000 7ff752e0d640 1 -- 172.21.15.62:0/2492577807 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff74417ac10 con 0x7ff74403ba40 2023-10-08T12:00:26.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.843+0000 7ff752e0d640 1 -- 172.21.15.62:0/2492577807 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7440c0a80 con 0x7ff74403ba40 2023-10-08T12:00:26.851 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.843+0000 7f8f1effd640 1 -- 172.21.15.62:0/2102046068 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f24003800 con 0x7f8f300ba2e0 2023-10-08T12:00:26.851 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.843+0000 7f42d6ffd640 1 -- 172.21.15.62:0/3341145152 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f42dc083aa0 con 0x7f42e0007190 2023-10-08T12:00:26.851 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.843+0000 7f42e5d9b640 1 --2- 172.21.15.62:0/3341145152 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f42c8066470 0x7f42c8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:26.851 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.843+0000 7ff752e0d640 1 -- 172.21.15.62:0/2492577807 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff74417b0c0 con 0x7ff74403ba40 2023-10-08T12:00:26.851 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.843+0000 7ff7497fa640 1 -- 172.21.15.62:0/2492577807 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff74c066a50 con 0x7ff74403ba40 2023-10-08T12:00:26.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.843+0000 7ff7497fa640 1 -- 172.21.15.62:0/2492577807 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff74c0917d0 con 0x7ff74403ba40 2023-10-08T12:00:26.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.843+0000 7f8f34b8e640 1 -- 172.21.15.62:0/2102046068 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f301ea270 con 0x7f8f300ba2e0 2023-10-08T12:00:26.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.843+0000 7f8f34b8e640 1 -- 172.21.15.62:0/2102046068 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f301ea830 con 0x7f8f300ba2e0 2023-10-08T12:00:26.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.843+0000 7f8f34b8e640 1 -- 172.21.15.62:0/2102046068 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f30142150 con 0x7f8f300ba2e0 2023-10-08T12:00:26.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.843+0000 7f42e5d9b640 1 --2- 172.21.15.62:0/3341145152 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f42c8066470 0x7f42c8068930 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f42e003a8e0 tx=0x7f42d8007ec0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:26.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.843+0000 7ff7497fa640 1 -- 172.21.15.62:0/2492577807 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff74c08e070 con 0x7ff74403ba40 2023-10-08T12:00:26.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.843+0000 7ff7497fa640 1 --2- 172.21.15.62:0/2492577807 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7ff730066470 0x7ff730068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:26.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.847+0000 7ff7497fa640 1 -- 172.21.15.62:0/2492577807 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff74c0fba40 con 0x7ff74403ba40 2023-10-08T12:00:26.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.847+0000 7ff74bfff640 1 --2- 172.21.15.62:0/2492577807 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7ff730066470 0x7ff730068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:26.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.843+0000 7f8f1effd640 1 -- 172.21.15.62:0/2102046068 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8f240a5900 con 0x7f8f300ba2e0 2023-10-08T12:00:26.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.843+0000 7f8f1effd640 1 -- 172.21.15.62:0/2102046068 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f24003b80 con 0x7f8f300ba2e0 2023-10-08T12:00:26.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.843+0000 7f160136e640 1 -- 172.21.15.62:0/1362647881 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f15f40c6d40 msgr2=0x7f15f40c71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:26.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.843+0000 7f160136e640 1 --2- 172.21.15.62:0/1362647881 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f15f40c6d40 0x7f15f40c71b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f15f40d15e0 tx=0x7f15ec01c850 comp rx=0 tx=0).stop 2023-10-08T12:00:26.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.843+0000 7f160136e640 1 -- 172.21.15.62:0/1362647881 shutdown_connections 2023-10-08T12:00:26.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.843+0000 7f160136e640 1 --2- 172.21.15.62:0/1362647881 >> v2:172.21.15.130:3300/0 conn(0x7f15f40d0670 0x7f15f40d0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.843+0000 7f160136e640 1 --2- 172.21.15.62:0/1362647881 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f15f40c6d40 0x7f15f40c71b0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.843+0000 7f160136e640 1 -- 172.21.15.62:0/1362647881 >> 172.21.15.62:0/1362647881 conn(0x7f15f403ee00 msgr2=0x7f15f403f210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:26.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.843+0000 7f160136e640 1 -- 172.21.15.62:0/1362647881 shutdown_connections 2023-10-08T12:00:26.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.847+0000 7ff74bfff640 1 --2- 172.21.15.62:0/2492577807 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7ff730066470 0x7ff730068930 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff744009a70 tx=0x7ff740006b90 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:26.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.847+0000 7f160136e640 1 -- 172.21.15.62:0/1362647881 wait complete. 2023-10-08T12:00:26.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.847+0000 7f160136e640 1 Processor -- start 2023-10-08T12:00:26.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.847+0000 7f8f1effd640 1 -- 172.21.15.62:0/2102046068 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8f240b4040 con 0x7f8f300ba2e0 2023-10-08T12:00:26.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.847+0000 7f8f1effd640 1 --2- 172.21.15.62:0/2102046068 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f8f100664a0 0x7f8f10068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:26.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.847+0000 7f8f2dd9b640 1 --2- 172.21.15.62:0/2102046068 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f8f100664a0 0x7f8f10068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:26.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.847+0000 7f160136e640 1 -- start start 2023-10-08T12:00:26.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.847+0000 7f160136e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f15f40070e0 0x7f15f40c9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:26.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.847+0000 7f160136e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15f40c6d40 0x7f15f4172150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:26.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.847+0000 7f160136e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f15f40d0670 0x7f15f40cb760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:26.857 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.847+0000 7f160136e640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f40ca530 con 0x7f15f40070e0 2023-10-08T12:00:26.857 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.847+0000 7f160136e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f4172690 con 0x7f15f40c6d40 2023-10-08T12:00:26.857 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.847+0000 7f160136e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15f40c9c60 con 0x7f15f40d0670 2023-10-08T12:00:26.857 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.847+0000 7f15faffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f15f40070e0 0x7f15f40c9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:26.857 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.847+0000 7f15faffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f15f40070e0 0x7f15f40c9ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43804/0 (socket says 172.21.15.62:43804) 2023-10-08T12:00:26.857 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.847+0000 7f15faffd640 1 -- 172.21.15.62:0/1776622810 learned_addr learned my addr 172.21.15.62:0/1776622810 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:26.857 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.847+0000 7f15fb7fe640 1 --2- 172.21.15.62:0/1776622810 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f15f40d0670 0x7f15f40cb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:26.857 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.847+0000 7f8f2dd9b640 1 --2- 172.21.15.62:0/2102046068 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f8f100664a0 0x7f8f10068960 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8f300a0370 tx=0x7f8f20007e40 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:26.858 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.847+0000 7f15faffd640 1 -- 172.21.15.62:0/1776622810 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f15f40d0670 msgr2=0x7f15f40cb760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:26.858 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.847+0000 7f15faffd640 1 --2- 172.21.15.62:0/1776622810 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f15f40d0670 0x7f15f40cb760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.858 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.847+0000 7f15faffd640 1 -- 172.21.15.62:0/1776622810 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15f40c6d40 msgr2=0x7f15f4172150 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T12:00:26.858 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.847+0000 7f15faffd640 1 --2- 172.21.15.62:0/1776622810 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15f40c6d40 0x7f15f4172150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.859 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.847+0000 7f15faffd640 1 -- 172.21.15.62:0/1776622810 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15ec009d30 con 0x7f15f40070e0 2023-10-08T12:00:26.859 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.847+0000 7f15faffd640 1 --2- 172.21.15.62:0/1776622810 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f15f40070e0 0x7f15f40c9ff0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f15f000c4b0 tx=0x7f15f000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:26.859 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.851+0000 7ff7497fa640 1 -- 172.21.15.62:0/2492577807 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff74c0c8ed0 con 0x7ff74403ba40 2023-10-08T12:00:26.859 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.851+0000 7f8f1effd640 1 -- 172.21.15.62:0/2102046068 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8f240f0b80 con 0x7f8f300ba2e0 2023-10-08T12:00:26.860 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.855+0000 7f15e37fe640 1 -- 172.21.15.62:0/1776622810 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f0012830 con 0x7f15f40070e0 2023-10-08T12:00:26.860 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.855+0000 7f160136e640 1 -- 172.21.15.62:0/1776622810 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15f40c8ad0 con 0x7f15f40070e0 2023-10-08T12:00:26.860 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.855+0000 7f160136e640 1 -- 172.21.15.62:0/1776622810 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15f40c9070 con 0x7f15f40070e0 2023-10-08T12:00:26.860 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.855+0000 7f160136e640 1 -- 172.21.15.62:0/1776622810 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15f4008180 con 0x7f15f40070e0 2023-10-08T12:00:26.860 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.855+0000 7f42d6ffd640 1 -- 172.21.15.62:0/3341145152 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f42dc050fc0 con 0x7f42e0007190 2023-10-08T12:00:26.861 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.855+0000 7f8f1effd640 1 -- 172.21.15.62:0/2102046068 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8f240ec7c0 con 0x7f8f300ba2e0 2023-10-08T12:00:26.862 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.859+0000 7f15e37fe640 1 -- 172.21.15.62:0/1776622810 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f15f0012a80 con 0x7f15f40070e0 2023-10-08T12:00:26.863 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.859+0000 7f15e37fe640 1 -- 172.21.15.62:0/1776622810 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f0012e70 con 0x7f15f40070e0 2023-10-08T12:00:26.864 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.859+0000 7f15e37fe640 1 -- 172.21.15.62:0/1776622810 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f15f0024430 con 0x7f15f40070e0 2023-10-08T12:00:26.864 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.859+0000 7f15e37fe640 1 --2- 172.21.15.62:0/1776622810 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f15e8066470 0x7f15e8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:26.864 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.859+0000 7f15e37fe640 1 -- 172.21.15.62:0/1776622810 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f15f0084350 con 0x7f15f40070e0 2023-10-08T12:00:26.866 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.863+0000 7f15fa7fc640 1 --2- 172.21.15.62:0/1776622810 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f15e8066470 0x7f15e8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:26.866 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.863+0000 7f15fa7fc640 1 --2- 172.21.15.62:0/1776622810 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f15e8066470 0x7f15e8068930 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f15ec0af000 tx=0x7f15ec01b090 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:26.869 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.867+0000 7f15e37fe640 1 -- 172.21.15.62:0/1776622810 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f15f0051860 con 0x7f15f40070e0 2023-10-08T12:00:26.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.871+0000 7fedd9a5a640 1 -- 172.21.15.62:0/2294092234 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fedd40b98e0 msgr2=0x7fedd41490f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:26.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.871+0000 7fedd9a5a640 1 --2- 172.21.15.62:0/2294092234 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fedd40b98e0 0x7fedd41490f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fedc8007350 tx=0x7fedc801d420 comp rx=0 tx=0).stop 2023-10-08T12:00:26.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.871+0000 7fedd9a5a640 1 -- 172.21.15.62:0/2294092234 shutdown_connections 2023-10-08T12:00:26.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.871+0000 7fedd9a5a640 1 --2- 172.21.15.62:0/2294092234 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fedd40b98e0 0x7fedd41490f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.871+0000 7fedd9a5a640 1 -- 172.21.15.62:0/2294092234 >> 172.21.15.62:0/2294092234 conn(0x7fedd40ba850 msgr2=0x7fedd40bac60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:26.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.871+0000 7fedd9a5a640 1 -- 172.21.15.62:0/2294092234 shutdown_connections 2023-10-08T12:00:26.875 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.871+0000 7fedd9a5a640 1 -- 172.21.15.62:0/2294092234 wait complete. 2023-10-08T12:00:26.875 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.871+0000 7fedd9a5a640 1 Processor -- start 2023-10-08T12:00:26.877 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.871+0000 7fedd9a5a640 1 -- start start 2023-10-08T12:00:26.877 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.871+0000 7fedd9a5a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fedd406bde0 0x7fedd406ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:26.877 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.871+0000 7fedd9a5a640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fedd40b75b0 0x7fedd41e6a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:26.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.871+0000 7fedd9a5a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fedd40b98e0 0x7fedd41e6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:26.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.871+0000 7fedd9a5a640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd406e4b0 con 0x7fedd406bde0 2023-10-08T12:00:26.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.871+0000 7fedd9a5a640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd413a0f0 con 0x7fedd40b98e0 2023-10-08T12:00:26.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.871+0000 7fedd9a5a640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedd406e840 con 0x7fedd40b75b0 2023-10-08T12:00:26.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.871+0000 7fedd8a58640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fedd406bde0 0x7fedd406ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:26.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.871+0000 7fedd8a58640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fedd406bde0 0x7fedd406ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43820/0 (socket says 172.21.15.62:43820) 2023-10-08T12:00:26.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.871+0000 7fedd8a58640 1 -- 172.21.15.62:0/3468344723 learned_addr learned my addr 172.21.15.62:0/3468344723 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:26.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.871+0000 7fedd3fff640 1 --2- 172.21.15.62:0/3468344723 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fedd40b75b0 0x7fedd41e6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:26.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.871+0000 7fedd9259640 1 --2- 172.21.15.62:0/3468344723 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fedd40b98e0 0x7fedd41e6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:26.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.875+0000 7fedd8a58640 1 -- 172.21.15.62:0/3468344723 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fedd40b75b0 msgr2=0x7fedd41e6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:26.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.875+0000 7fedd8a58640 1 --2- 172.21.15.62:0/3468344723 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fedd40b75b0 0x7fedd41e6a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.879 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.875+0000 7fedd8a58640 1 -- 172.21.15.62:0/3468344723 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fedd40b98e0 msgr2=0x7fedd41e6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:26.879 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.875+0000 7fedd8a58640 1 --2- 172.21.15.62:0/3468344723 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fedd40b98e0 0x7fedd41e6fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.879 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.875+0000 7fedd8a58640 1 -- 172.21.15.62:0/3468344723 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedc800ae40 con 0x7fedd406bde0 2023-10-08T12:00:26.879 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.875+0000 7fedd8a58640 1 --2- 172.21.15.62:0/3468344723 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fedd406bde0 0x7fedd406ff40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fedc400c490 tx=0x7fedc400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:26.880 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.875+0000 7fedd17fa640 1 -- 172.21.15.62:0/3468344723 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc40052d0 con 0x7fedd406bde0 2023-10-08T12:00:26.880 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.875+0000 7fedd17fa640 1 -- 172.21.15.62:0/3468344723 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fedc4005430 con 0x7fedd406bde0 2023-10-08T12:00:26.880 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.875+0000 7fedd17fa640 1 -- 172.21.15.62:0/3468344723 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc4012890 con 0x7fedd406bde0 2023-10-08T12:00:26.880 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.875+0000 7fedd9a5a640 1 -- 172.21.15.62:0/3468344723 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedd406e140 con 0x7fedd406bde0 2023-10-08T12:00:26.880 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.875+0000 7fedd9a5a640 1 -- 172.21.15.62:0/3468344723 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedd413a300 con 0x7fedd406bde0 2023-10-08T12:00:26.880 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.875+0000 7fedd17fa640 1 -- 172.21.15.62:0/3468344723 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fedc4003600 con 0x7fedd406bde0 2023-10-08T12:00:26.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.875+0000 7fedd17fa640 1 --2- 172.21.15.62:0/3468344723 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fedc0066470 0x7fedc0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:26.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.875+0000 7fedd17fa640 1 -- 172.21.15.62:0/3468344723 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fedc4083330 con 0x7fedd406bde0 2023-10-08T12:00:26.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.875+0000 7fedd3fff640 1 --2- 172.21.15.62:0/3468344723 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fedc0066470 0x7fedc0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:26.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.879+0000 7fedd9a5a640 1 -- 172.21.15.62:0/3468344723 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedd404da80 con 0x7fedd406bde0 2023-10-08T12:00:26.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.879+0000 7fedd3fff640 1 --2- 172.21.15.62:0/3468344723 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fedc0066470 0x7fedc0068930 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fedd413d240 tx=0x7fedcc001ac0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:26.891 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.887+0000 7f569a57c640 1 -- 172.21.15.62:0/561977772 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f569406c480 msgr2=0x7f569406b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:26.891 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.887+0000 7f569a57c640 1 --2- 172.21.15.62:0/561977772 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f569406c480 0x7f569406b6a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5684009840 tx=0x7f568401c820 comp rx=0 tx=0).stop 2023-10-08T12:00:26.891 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.887+0000 7f569a57c640 1 -- 172.21.15.62:0/561977772 shutdown_connections 2023-10-08T12:00:26.891 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.887+0000 7f569a57c640 1 --2- 172.21.15.62:0/561977772 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f569406a930 0x7f5694147c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.891 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.887+0000 7f569a57c640 1 --2- 172.21.15.62:0/561977772 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f569406c480 0x7f569406b6a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.891 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.887+0000 7f569a57c640 1 -- 172.21.15.62:0/561977772 >> 172.21.15.62:0/561977772 conn(0x7f569409c520 msgr2=0x7f569409c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:26.891 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.887+0000 7f569a57c640 1 -- 172.21.15.62:0/561977772 shutdown_connections 2023-10-08T12:00:26.891 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.887+0000 7f569a57c640 1 -- 172.21.15.62:0/561977772 wait complete. 2023-10-08T12:00:26.892 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.887+0000 7fedd17fa640 1 -- 172.21.15.62:0/3468344723 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fedc4050720 con 0x7fedd406bde0 2023-10-08T12:00:26.892 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.887+0000 7f569a57c640 1 Processor -- start 2023-10-08T12:00:26.892 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.887+0000 7f569a57c640 1 -- start start 2023-10-08T12:00:26.894 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.891+0000 7f569a57c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f569406a930 0x7f569413ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:26.894 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.891+0000 7f569a57c640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5694148160 0x7f56940a0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:26.894 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.891+0000 7f569a57c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5694070030 0x7f56941de4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:26.894 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.891+0000 7f569a57c640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f569413c6a0 con 0x7f5694070030 2023-10-08T12:00:26.894 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.891+0000 7f569a57c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f569413d650 con 0x7f569406a930 2023-10-08T12:00:26.894 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.891+0000 7f569a57c640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f569413c010 con 0x7f5694148160 2023-10-08T12:00:26.895 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.891+0000 7f5698b19640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5694070030 0x7f56941de4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:26.895 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.891+0000 7f5698b19640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5694070030 0x7f56941de4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43830/0 (socket says 172.21.15.62:43830) 2023-10-08T12:00:26.895 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.891+0000 7f5698b19640 1 -- 172.21.15.62:0/4176587239 learned_addr learned my addr 172.21.15.62:0/4176587239 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:26.895 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.891+0000 7f56937fe640 1 --2- 172.21.15.62:0/4176587239 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5694148160 0x7f56940a0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:26.895 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.891+0000 7f5693fff640 1 --2- 172.21.15.62:0/4176587239 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f569406a930 0x7f569413ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:26.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.891+0000 7f5698b19640 1 -- 172.21.15.62:0/4176587239 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5694148160 msgr2=0x7f56940a0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:26.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.891+0000 7f5698b19640 1 --2- 172.21.15.62:0/4176587239 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5694148160 0x7f56940a0290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.891+0000 7f5698b19640 1 -- 172.21.15.62:0/4176587239 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f569406a930 msgr2=0x7f569413ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:26.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.891+0000 7f5698b19640 1 --2- 172.21.15.62:0/4176587239 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f569406a930 0x7f569413ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:26.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.891+0000 7f5698b19640 1 -- 172.21.15.62:0/4176587239 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5688011cb0 con 0x7f5694070030 2023-10-08T12:00:26.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.891+0000 7f5698b19640 1 --2- 172.21.15.62:0/4176587239 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5694070030 0x7f56941de4e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f568c00cae0 tx=0x7f568c00cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:26.901 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.899+0000 7f5690ff9640 1 -- 172.21.15.62:0/4176587239 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568c003b80 con 0x7f5694070030 2023-10-08T12:00:26.902 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.899+0000 7f569a57c640 1 -- 172.21.15.62:0/4176587239 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56840094a0 con 0x7f5694070030 2023-10-08T12:00:26.902 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.899+0000 7f569a57c640 1 -- 172.21.15.62:0/4176587239 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f569413cb70 con 0x7f5694070030 2023-10-08T12:00:26.902 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.899+0000 7f5690ff9640 1 -- 172.21.15.62:0/4176587239 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f568c003dd0 con 0x7f5694070030 2023-10-08T12:00:26.902 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.899+0000 7f5690ff9640 1 -- 172.21.15.62:0/4176587239 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568c00aab0 con 0x7f5694070030 2023-10-08T12:00:26.904 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.899+0000 7f5690ff9640 1 -- 172.21.15.62:0/4176587239 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f568c00ac10 con 0x7f5694070030 2023-10-08T12:00:26.905 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.899+0000 7f5690ff9640 1 --2- 172.21.15.62:0/4176587239 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f5680066540 0x7f5680068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:26.905 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.899+0000 7f5690ff9640 1 -- 172.21.15.62:0/4176587239 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f568c0843a0 con 0x7f5694070030 2023-10-08T12:00:26.905 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.903+0000 7f5693fff640 1 --2- 172.21.15.62:0/4176587239 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f5680066540 0x7f5680068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:26.906 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.903+0000 7f5693fff640 1 --2- 172.21.15.62:0/4176587239 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f5680066540 0x7f5680068a00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f56840af000 tx=0x7f568401b060 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:26.909 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.907+0000 7f569a57c640 1 -- 172.21.15.62:0/4176587239 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5674005260 con 0x7f5694070030 2023-10-08T12:00:26.918 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:26.915+0000 7f5690ff9640 1 -- 172.21.15.62:0/4176587239 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f568c051890 con 0x7f5694070030 2023-10-08T12:00:27.136 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.131+0000 7fcf8cadf640 1 -- 172.21.15.62:0/684515496 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fcf6c0050d0 con 0x7fcf8809b490 2023-10-08T12:00:27.136 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.131+0000 7fcf76ffd640 1 -- 172.21.15.62:0/684515496 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcf800f2290 con 0x7fcf8809b490 2023-10-08T12:00:27.139 INFO:teuthology.orchestra.run.smithi062.stdout:55834574853 2023-10-08T12:00:27.142 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.139+0000 7fcf74ff9640 1 -- 172.21.15.62:0/684515496 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fcf68066540 msgr2=0x7fcf68068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:27.142 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.139+0000 7fcf74ff9640 1 --2- 172.21.15.62:0/684515496 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fcf68066540 0x7fcf68068a00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcf7800db40 tx=0x7fcf7800f040 comp rx=0 tx=0).stop 2023-10-08T12:00:27.142 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.139+0000 7fcf74ff9640 1 -- 172.21.15.62:0/684515496 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf8809b490 msgr2=0x7fcf881f7980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:27.142 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.139+0000 7fcf74ff9640 1 --2- 172.21.15.62:0/684515496 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf8809b490 0x7fcf881f7980 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fcf80009750 tx=0x7fcf80004680 comp rx=0 tx=0).stop 2023-10-08T12:00:27.142 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.139+0000 7fcf74ff9640 1 -- 172.21.15.62:0/684515496 shutdown_connections 2023-10-08T12:00:27.142 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.139+0000 7fcf74ff9640 1 --2- 172.21.15.62:0/684515496 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fcf68066540 0x7fcf68068a00 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:27.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.139+0000 7fcf74ff9640 1 --2- 172.21.15.62:0/684515496 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcf880b0040 0x7fcf8809c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:27.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.139+0000 7fcf74ff9640 1 --2- 172.21.15.62:0/684515496 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf8809b490 0x7fcf881f7980 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:27.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.139+0000 7fcf74ff9640 1 --2- 172.21.15.62:0/684515496 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf8806ad90 0x7fcf88159670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:27.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.139+0000 7fcf74ff9640 1 -- 172.21.15.62:0/684515496 >> 172.21.15.62:0/684515496 conn(0x7fcf880b7360 msgr2=0x7fcf88154910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:27.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.139+0000 7fcf74ff9640 1 -- 172.21.15.62:0/684515496 shutdown_connections 2023-10-08T12:00:27.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.139+0000 7fcf74ff9640 1 -- 172.21.15.62:0/684515496 wait complete. 2023-10-08T12:00:27.164 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.4 2023-10-08T12:00:27.164 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.159+0000 7fcbdb346640 1 -- 172.21.15.62:0/2626637130 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fcbd4146d60 con 0x7fcbd4147080 2023-10-08T12:00:27.164 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.159+0000 7fcbc9ffb640 1 -- 172.21.15.62:0/2626637130 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcbcc0be020 con 0x7fcbd4147080 2023-10-08T12:00:27.165 INFO:teuthology.orchestra.run.smithi062.stdout:55834574853 2023-10-08T12:00:27.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.163+0000 7fcbdb346640 1 -- 172.21.15.62:0/2626637130 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fcbb80664a0 msgr2=0x7fcbb8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:27.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.163+0000 7fcbdb346640 1 --2- 172.21.15.62:0/2626637130 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fcbb80664a0 0x7fcbb8068960 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcbc4005790 tx=0x7fcbc400b2e0 comp rx=0 tx=0).stop 2023-10-08T12:00:27.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.163+0000 7fcbdb346640 1 -- 172.21.15.62:0/2626637130 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcbd4147080 msgr2=0x7fcbd4147530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:27.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.163+0000 7fcbdb346640 1 --2- 172.21.15.62:0/2626637130 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcbd4147080 0x7fcbd4147530 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc01dc00 tx=0x7fcbcc0a5f70 comp rx=0 tx=0).stop 2023-10-08T12:00:27.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.163+0000 7f160136e640 1 -- 172.21.15.62:0/1776622810 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f15f4005370 con 0x7f15f40070e0 2023-10-08T12:00:27.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.163+0000 7fcbdb346640 1 -- 172.21.15.62:0/2626637130 shutdown_connections 2023-10-08T12:00:27.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.163+0000 7fcbdb346640 1 --2- 172.21.15.62:0/2626637130 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fcbb80664a0 0x7fcbb8068960 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:27.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.163+0000 7fcbdb346640 1 --2- 172.21.15.62:0/2626637130 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcbd41d0620 0x7fcbd40994b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:27.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.163+0000 7f15e37fe640 1 -- 172.21.15.62:0/1776622810 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f15f0054e80 con 0x7f15f40070e0 2023-10-08T12:00:27.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.163+0000 7fcbdb346640 1 --2- 172.21.15.62:0/2626637130 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcbd4147080 0x7fcbd4147530 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:27.170 INFO:teuthology.orchestra.run.smithi062.stdout:55834574854 2023-10-08T12:00:27.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.163+0000 7fcbdb346640 1 --2- 172.21.15.62:0/2626637130 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcbc0004d10 0x7fcbd409b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:27.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.163+0000 7fcbdb346640 1 -- 172.21.15.62:0/2626637130 >> 172.21.15.62:0/2626637130 conn(0x7fcbd409c600 msgr2=0x7fcbd409ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:27.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.163+0000 7fcbdb346640 1 -- 172.21.15.62:0/2626637130 shutdown_connections 2023-10-08T12:00:27.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.163+0000 7fcbdb346640 1 -- 172.21.15.62:0/2626637130 wait complete. 2023-10-08T12:00:27.172 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.167+0000 7f160136e640 1 -- 172.21.15.62:0/1776622810 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f15e8066470 msgr2=0x7f15e8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:27.172 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.167+0000 7f160136e640 1 --2- 172.21.15.62:0/1776622810 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f15e8066470 0x7f15e8068930 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f15ec0af000 tx=0x7f15ec01b090 comp rx=0 tx=0).stop 2023-10-08T12:00:27.172 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.167+0000 7f160136e640 1 -- 172.21.15.62:0/1776622810 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f15f40070e0 msgr2=0x7f15f40c9ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:27.172 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.167+0000 7f160136e640 1 --2- 172.21.15.62:0/1776622810 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f15f40070e0 0x7f15f40c9ff0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f15f000c4b0 tx=0x7f15f000c970 comp rx=0 tx=0).stop 2023-10-08T12:00:27.172 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.167+0000 7f160136e640 1 -- 172.21.15.62:0/1776622810 shutdown_connections 2023-10-08T12:00:27.172 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.167+0000 7f160136e640 1 --2- 172.21.15.62:0/1776622810 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f15e8066470 0x7f15e8068930 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:27.173 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.167+0000 7f160136e640 1 --2- 172.21.15.62:0/1776622810 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f15f40d0670 0x7f15f40cb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:27.173 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.167+0000 7f160136e640 1 --2- 172.21.15.62:0/1776622810 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15f40c6d40 0x7f15f4172150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:27.173 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.167+0000 7f160136e640 1 --2- 172.21.15.62:0/1776622810 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f15f40070e0 0x7f15f40c9ff0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:27.173 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.167+0000 7f160136e640 1 -- 172.21.15.62:0/1776622810 >> 172.21.15.62:0/1776622810 conn(0x7f15f403ee00 msgr2=0x7f15f4006500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:27.173 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.167+0000 7f160136e640 1 -- 172.21.15.62:0/1776622810 shutdown_connections 2023-10-08T12:00:27.173 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.167+0000 7f160136e640 1 -- 172.21.15.62:0/1776622810 wait complete. 2023-10-08T12:00:27.173 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.167+0000 7f42e759e640 1 -- 172.21.15.62:0/3341145152 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f42e00cb990 con 0x7f42e0007190 2023-10-08T12:00:27.173 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.167+0000 7f42d6ffd640 1 -- 172.21.15.62:0/3341145152 <== mon.2 v2:172.21.15.130:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f42dc0545e0 con 0x7f42e0007190 2023-10-08T12:00:27.178 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.175+0000 7ff752e0d640 1 -- 172.21.15.62:0/2492577807 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff7440057c0 con 0x7ff74403ba40 2023-10-08T12:00:27.179 INFO:teuthology.orchestra.run.smithi062.stdout:55834574852 2023-10-08T12:00:27.179 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.175+0000 7ff7497fa640 1 -- 172.21.15.62:0/2492577807 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff74c0cc4f0 con 0x7ff74403ba40 2023-10-08T12:00:27.179 INFO:teuthology.orchestra.run.smithi062.stdout:55834574854 2023-10-08T12:00:27.181 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.175+0000 7f42e759e640 1 -- 172.21.15.62:0/3341145152 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f42c8066470 msgr2=0x7f42c8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:27.181 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.175+0000 7f42e759e640 1 --2- 172.21.15.62:0/3341145152 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f42c8066470 0x7f42c8068930 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f42e003a8e0 tx=0x7f42d8007ec0 comp rx=0 tx=0).stop 2023-10-08T12:00:27.181 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.175+0000 7f42e759e640 1 -- 172.21.15.62:0/3341145152 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f42e0007190 msgr2=0x7f42e00447d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:27.181 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.175+0000 7f42e759e640 1 --2- 172.21.15.62:0/3341145152 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f42e0007190 0x7f42e00447d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f42dc00c3f0 tx=0x7f42dc00c8b0 comp rx=0 tx=0).stop 2023-10-08T12:00:27.182 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.175+0000 7f42e759e640 1 -- 172.21.15.62:0/3341145152 shutdown_connections 2023-10-08T12:00:27.182 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.175+0000 7f42e759e640 1 --2- 172.21.15.62:0/3341145152 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f42c8066470 0x7f42c8068930 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:27.182 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.175+0000 7f42e759e640 1 --2- 172.21.15.62:0/3341145152 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42e003d2a0 0x7f42e0045420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:27.182 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.175+0000 7f42e759e640 1 --2- 172.21.15.62:0/3341145152 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f42e0007600 0x7f42e00cbc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:27.182 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.175+0000 7f42e759e640 1 --2- 172.21.15.62:0/3341145152 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f42e0007190 0x7f42e00447d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:27.182 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.175+0000 7f42e759e640 1 -- 172.21.15.62:0/3341145152 >> 172.21.15.62:0/3341145152 conn(0x7f42e0043210 msgr2=0x7f42e0041880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:27.182 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.175+0000 7f42e759e640 1 -- 172.21.15.62:0/3341145152 shutdown_connections 2023-10-08T12:00:27.182 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.175+0000 7f42e759e640 1 -- 172.21.15.62:0/3341145152 wait complete. 2023-10-08T12:00:27.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.179+0000 7f8f34b8e640 1 -- 172.21.15.62:0/2102046068 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8f30142150 con 0x7f8f300ba2e0 2023-10-08T12:00:27.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.183+0000 7f8f1effd640 1 -- 172.21.15.62:0/2102046068 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8f240ba090 con 0x7f8f300ba2e0 2023-10-08T12:00:27.185 INFO:teuthology.orchestra.run.smithi062.stdout:55834574854 2023-10-08T12:00:27.189 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.183+0000 7f8f34b8e640 1 -- 172.21.15.62:0/2102046068 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f8f100664a0 msgr2=0x7f8f10068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:27.189 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.183+0000 7f8f34b8e640 1 --2- 172.21.15.62:0/2102046068 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f8f100664a0 0x7f8f10068960 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8f300a0370 tx=0x7f8f20007e40 comp rx=0 tx=0).stop 2023-10-08T12:00:27.189 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.183+0000 7f8f34b8e640 1 -- 172.21.15.62:0/2102046068 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f300ba2e0 msgr2=0x7f8f30141540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:27.189 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.183+0000 7f8f34b8e640 1 --2- 172.21.15.62:0/2102046068 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f300ba2e0 0x7f8f30141540 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8f24019460 tx=0x7f8f240a5710 comp rx=0 tx=0).stop 2023-10-08T12:00:27.189 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.183+0000 7ff752e0d640 1 -- 172.21.15.62:0/2492577807 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7ff730066470 msgr2=0x7ff730068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:27.189 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.183+0000 7ff752e0d640 1 --2- 172.21.15.62:0/2492577807 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7ff730066470 0x7ff730068930 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff744009a70 tx=0x7ff740006b90 comp rx=0 tx=0).stop 2023-10-08T12:00:27.189 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.183+0000 7ff752e0d640 1 -- 172.21.15.62:0/2492577807 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff74403ba40 msgr2=0x7ff744009230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:27.190 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.183+0000 7ff752e0d640 1 --2- 172.21.15.62:0/2492577807 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff74403ba40 0x7ff744009230 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff74c062dd0 tx=0x7ff74c0669e0 comp rx=0 tx=0).stop 2023-10-08T12:00:27.190 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.183+0000 7ff752e0d640 1 -- 172.21.15.62:0/2492577807 shutdown_connections 2023-10-08T12:00:27.190 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.183+0000 7ff752e0d640 1 --2- 172.21.15.62:0/2492577807 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7ff730066470 0x7ff730068930 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:27.190 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.183+0000 7ff752e0d640 1 --2- 172.21.15.62:0/2492577807 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff7440c5770 0x7ff7440d2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:27.190 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.183+0000 7ff752e0d640 1 --2- 172.21.15.62:0/2492577807 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7440cece0 0x7ff7440bd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:27.190 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.183+0000 7ff752e0d640 1 --2- 172.21.15.62:0/2492577807 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff74403ba40 0x7ff744009230 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:27.190 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.183+0000 7ff752e0d640 1 -- 172.21.15.62:0/2492577807 >> 172.21.15.62:0/2492577807 conn(0x7ff744044620 msgr2=0x7ff744044a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:27.190 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.183+0000 7f8f34b8e640 1 -- 172.21.15.62:0/2102046068 shutdown_connections 2023-10-08T12:00:27.191 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.183+0000 7f8f34b8e640 1 --2- 172.21.15.62:0/2102046068 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f8f100664a0 0x7f8f10068960 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:27.191 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.183+0000 7f8f34b8e640 1 --2- 172.21.15.62:0/2102046068 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8f3013e7e0 0x7f8f3006cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:27.191 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.183+0000 7f8f34b8e640 1 --2- 172.21.15.62:0/2102046068 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8f30149270 0x7f8f301e67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:27.191 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.183+0000 7f8f34b8e640 1 --2- 172.21.15.62:0/2102046068 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f300ba2e0 0x7f8f30141540 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:27.191 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.183+0000 7f8f34b8e640 1 -- 172.21.15.62:0/2102046068 >> 172.21.15.62:0/2102046068 conn(0x7f8f300a0540 msgr2=0x7f8f300bc670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:27.191 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.183+0000 7ff752e0d640 1 -- 172.21.15.62:0/2492577807 shutdown_connections 2023-10-08T12:00:27.191 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.183+0000 7ff752e0d640 1 -- 172.21.15.62:0/2492577807 wait complete. 2023-10-08T12:00:27.192 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.187+0000 7f8f34b8e640 1 -- 172.21.15.62:0/2102046068 shutdown_connections 2023-10-08T12:00:27.192 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.187+0000 7f8f34b8e640 1 -- 172.21.15.62:0/2102046068 wait complete. 2023-10-08T12:00:27.196 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.6 2023-10-08T12:00:27.204 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.199+0000 7fedd9a5a640 1 -- 172.21.15.62:0/3468344723 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fedd4148570 con 0x7fedd406bde0 2023-10-08T12:00:27.205 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.199+0000 7fedd17fa640 1 -- 172.21.15.62:0/3468344723 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fedc4053d40 con 0x7fedd406bde0 2023-10-08T12:00:27.205 INFO:teuthology.orchestra.run.smithi062.stdout:55834574855 2023-10-08T12:00:27.206 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.0 2023-10-08T12:00:27.207 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.3 2023-10-08T12:00:27.208 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.203+0000 7fedd9a5a640 1 -- 172.21.15.62:0/3468344723 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fedc0066470 msgr2=0x7fedc0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:27.209 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.203+0000 7fedd9a5a640 1 --2- 172.21.15.62:0/3468344723 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fedc0066470 0x7fedc0068930 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fedd413d240 tx=0x7fedcc001ac0 comp rx=0 tx=0).stop 2023-10-08T12:00:27.209 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.203+0000 7fedd9a5a640 1 -- 172.21.15.62:0/3468344723 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fedd406bde0 msgr2=0x7fedd406ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:27.209 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.203+0000 7fedd9a5a640 1 --2- 172.21.15.62:0/3468344723 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fedd406bde0 0x7fedd406ff40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fedc400c490 tx=0x7fedc400c950 comp rx=0 tx=0).stop 2023-10-08T12:00:27.209 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.203+0000 7fedd9a5a640 1 -- 172.21.15.62:0/3468344723 shutdown_connections 2023-10-08T12:00:27.209 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.203+0000 7fedd9a5a640 1 --2- 172.21.15.62:0/3468344723 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fedc0066470 0x7fedc0068930 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:27.209 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.203+0000 7fedd9a5a640 1 --2- 172.21.15.62:0/3468344723 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fedd40b75b0 0x7fedd41e6a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:27.209 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.203+0000 7fedd9a5a640 1 --2- 172.21.15.62:0/3468344723 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fedd40b98e0 0x7fedd41e6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:27.209 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.203+0000 7fedd9a5a640 1 --2- 172.21.15.62:0/3468344723 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fedd406bde0 0x7fedd406ff40 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:27.209 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.203+0000 7fedd9a5a640 1 -- 172.21.15.62:0/3468344723 >> 172.21.15.62:0/3468344723 conn(0x7fedd40ba850 msgr2=0x7fedd413fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:27.210 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.203+0000 7fedd9a5a640 1 -- 172.21.15.62:0/3468344723 shutdown_connections 2023-10-08T12:00:27.210 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.203+0000 7fedd9a5a640 1 -- 172.21.15.62:0/3468344723 wait complete. 2023-10-08T12:00:27.218 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.2 2023-10-08T12:00:27.219 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.1 2023-10-08T12:00:27.219 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.215+0000 7f569a57c640 1 -- 172.21.15.62:0/4176587239 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f5674005510 con 0x7f5694070030 2023-10-08T12:00:27.220 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.215+0000 7f5690ff9640 1 -- 172.21.15.62:0/4176587239 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f568c054eb0 con 0x7f5694070030 2023-10-08T12:00:27.220 INFO:teuthology.orchestra.run.smithi062.stdout:55834574853 2023-10-08T12:00:27.222 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.219+0000 7f569a57c640 1 -- 172.21.15.62:0/4176587239 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f5680066540 msgr2=0x7f5680068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:27.222 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.219+0000 7f569a57c640 1 --2- 172.21.15.62:0/4176587239 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f5680066540 0x7f5680068a00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f56840af000 tx=0x7f568401b060 comp rx=0 tx=0).stop 2023-10-08T12:00:27.223 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.219+0000 7f569a57c640 1 -- 172.21.15.62:0/4176587239 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5694070030 msgr2=0x7f56941de4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:27.223 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.219+0000 7f569a57c640 1 --2- 172.21.15.62:0/4176587239 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5694070030 0x7f56941de4e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f568c00cae0 tx=0x7f568c00cbd0 comp rx=0 tx=0).stop 2023-10-08T12:00:27.223 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.219+0000 7f569a57c640 1 -- 172.21.15.62:0/4176587239 shutdown_connections 2023-10-08T12:00:27.223 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.219+0000 7f569a57c640 1 --2- 172.21.15.62:0/4176587239 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f5680066540 0x7f5680068a00 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:27.223 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.219+0000 7f569a57c640 1 --2- 172.21.15.62:0/4176587239 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5694148160 0x7f56940a0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:27.223 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.219+0000 7f569a57c640 1 --2- 172.21.15.62:0/4176587239 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5694070030 0x7f56941de4e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:27.223 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.219+0000 7f569a57c640 1 --2- 172.21.15.62:0/4176587239 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f569406a930 0x7f569413ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:27.223 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.219+0000 7f569a57c640 1 -- 172.21.15.62:0/4176587239 >> 172.21.15.62:0/4176587239 conn(0x7f569409c520 msgr2=0x7f5694098510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:27.223 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.219+0000 7f569a57c640 1 -- 172.21.15.62:0/4176587239 shutdown_connections 2023-10-08T12:00:27.223 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:27.219+0000 7f569a57c640 1 -- 172.21.15.62:0/4176587239 wait complete. 2023-10-08T12:00:27.229 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.7 2023-10-08T12:00:27.237 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.5 2023-10-08T12:00:28.164 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-08T12:00:28.197 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-08T12:00:28.206 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-08T12:00:28.207 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-08T12:00:28.219 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-08T12:00:28.220 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-08T12:00:28.229 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-08T12:00:28.238 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-08T12:00:28.335 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.331+0000 7fc31a4af640 1 -- 172.21.15.62:0/2364634841 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3140b6d40 msgr2=0x7fc314099da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:28.335 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.331+0000 7fc31a4af640 1 --2- 172.21.15.62:0/2364634841 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3140b6d40 0x7fc314099da0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc3140716b0 tx=0x7fc30801c720 comp rx=0 tx=0).stop 2023-10-08T12:00:28.335 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.331+0000 7fc31a4af640 1 -- 172.21.15.62:0/2364634841 shutdown_connections 2023-10-08T12:00:28.335 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.331+0000 7fc31a4af640 1 --2- 172.21.15.62:0/2364634841 >> v2:172.21.15.130:3300/0 conn(0x7fc3140b9a70 0x7fc314148da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:28.335 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.331+0000 7fc31a4af640 1 --2- 172.21.15.62:0/2364634841 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3140b6d40 0x7fc314099da0 secure :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc3140716b0 tx=0x7fc30801c720 comp rx=0 tx=0).stop 2023-10-08T12:00:28.335 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.331+0000 7fc31a4af640 1 -- 172.21.15.62:0/2364634841 >> 172.21.15.62:0/2364634841 conn(0x7fc31409c600 msgr2=0x7fc31409ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:28.337 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.335+0000 7fc31a4af640 1 -- 172.21.15.62:0/2364634841 shutdown_connections 2023-10-08T12:00:28.337 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.335+0000 7fc31a4af640 1 -- 172.21.15.62:0/2364634841 wait complete. 2023-10-08T12:00:28.339 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.335+0000 7fc31a4af640 1 Processor -- start 2023-10-08T12:00:28.339 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.335+0000 7fc31a4af640 1 -- start start 2023-10-08T12:00:28.340 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.335+0000 7fc31a4af640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3140b88b0 0x7fc3141da220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:28.340 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.335+0000 7fc31a4af640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc3140b9a70 0x7fc3140a01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:28.341 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.335+0000 7fc31a4af640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc3141e6cb0 0x7fc3141e7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:28.341 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.335+0000 7fc31a4af640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3141da760 con 0x7fc3140b88b0 2023-10-08T12:00:28.341 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.335+0000 7fc31a4af640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3141e7680 con 0x7fc3140b9a70 2023-10-08T12:00:28.341 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.335+0000 7fc31a4af640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3141e6820 con 0x7fc3141e6cb0 2023-10-08T12:00:28.342 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.335+0000 7fc313fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3140b88b0 0x7fc3141da220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:28.343 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.335+0000 7fc313fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3140b88b0 0x7fc3141da220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43856/0 (socket says 172.21.15.62:43856) 2023-10-08T12:00:28.343 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.335+0000 7fc313fff640 1 -- 172.21.15.62:0/2726000059 learned_addr learned my addr 172.21.15.62:0/2726000059 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:28.343 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.335+0000 7fc3137fe640 1 --2- 172.21.15.62:0/2726000059 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc3140b9a70 0x7fc3140a01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:28.343 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.335+0000 7fc318a4c640 1 --2- 172.21.15.62:0/2726000059 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc3141e6cb0 0x7fc3141e7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:28.343 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.339+0000 7fc313fff640 1 -- 172.21.15.62:0/2726000059 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc3141e6cb0 msgr2=0x7fc3141e7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:28.343 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.339+0000 7fc313fff640 1 --2- 172.21.15.62:0/2726000059 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc3141e6cb0 0x7fc3141e7140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:28.343 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.339+0000 7fc313fff640 1 -- 172.21.15.62:0/2726000059 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc3140b9a70 msgr2=0x7fc3140a01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:28.343 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.339+0000 7fc313fff640 1 --2- 172.21.15.62:0/2726000059 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc3140b9a70 0x7fc3140a01e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:28.343 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.339+0000 7fc313fff640 1 -- 172.21.15.62:0/2726000059 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3080094a0 con 0x7fc3140b88b0 2023-10-08T12:00:28.344 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.339+0000 7fc313fff640 1 --2- 172.21.15.62:0/2726000059 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3140b88b0 0x7fc3141da220 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc30c00e780 tx=0x7fc30c00ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:28.349 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.343+0000 7fc310ff9640 1 -- 172.21.15.62:0/2726000059 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30c00f930 con 0x7fc3140b88b0 2023-10-08T12:00:28.349 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.343+0000 7fc310ff9640 1 -- 172.21.15.62:0/2726000059 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc30c00fb80 con 0x7fc3140b88b0 2023-10-08T12:00:28.349 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.343+0000 7fc310ff9640 1 -- 172.21.15.62:0/2726000059 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30c017440 con 0x7fc3140b88b0 2023-10-08T12:00:28.349 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.343+0000 7fc31a4af640 1 -- 172.21.15.62:0/2726000059 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc31409e040 con 0x7fc3140b88b0 2023-10-08T12:00:28.349 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.343+0000 7fc31a4af640 1 -- 172.21.15.62:0/2726000059 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3140b4c70 con 0x7fc3140b88b0 2023-10-08T12:00:28.351 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.347+0000 7fc310ff9640 1 -- 172.21.15.62:0/2726000059 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc30c01f360 con 0x7fc3140b88b0 2023-10-08T12:00:28.352 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.347+0000 7fc310ff9640 1 --2- 172.21.15.62:0/2726000059 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fc300066570 0x7fc300068a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:28.352 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.347+0000 7fc310ff9640 1 -- 172.21.15.62:0/2726000059 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc30c0868e0 con 0x7fc3140b88b0 2023-10-08T12:00:28.353 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.347+0000 7fc3137fe640 1 --2- 172.21.15.62:0/2726000059 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fc300066570 0x7fc300068a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:28.353 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.347+0000 7fc31a4af640 1 -- 172.21.15.62:0/2726000059 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc31404da80 con 0x7fc3140b88b0 2023-10-08T12:00:28.358 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.355+0000 7fc3137fe640 1 --2- 172.21.15.62:0/2726000059 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fc300066570 0x7fc300068a30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc3080af000 tx=0x7fc30801af60 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:28.362 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.359+0000 7fc310ff9640 1 -- 172.21.15.62:0/2726000059 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc30c053e00 con 0x7fc3140b88b0 2023-10-08T12:00:28.379 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.375+0000 7f9ba4c18640 1 -- 172.21.15.62:0/2667560818 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ba00b9a70 msgr2=0x7f9ba0099da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:28.379 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.375+0000 7f9ba4c18640 1 --2- 172.21.15.62:0/2667560818 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ba00b9a70 0x7f9ba0099da0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9b94009840 tx=0x7f9b9401c720 comp rx=0 tx=0).stop 2023-10-08T12:00:28.379 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.375+0000 7f9ba4c18640 1 -- 172.21.15.62:0/2667560818 shutdown_connections 2023-10-08T12:00:28.379 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.375+0000 7f9ba4c18640 1 --2- 172.21.15.62:0/2667560818 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ba00b9a70 0x7f9ba0099da0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:28.380 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.375+0000 7f9ba4c18640 1 -- 172.21.15.62:0/2667560818 >> 172.21.15.62:0/2667560818 conn(0x7f9ba009c600 msgr2=0x7f9ba009ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:28.380 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.375+0000 7f9ba4c18640 1 -- 172.21.15.62:0/2667560818 shutdown_connections 2023-10-08T12:00:28.380 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.375+0000 7f9ba4c18640 1 -- 172.21.15.62:0/2667560818 wait complete. 2023-10-08T12:00:28.381 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.375+0000 7f9ba4c18640 1 Processor -- start 2023-10-08T12:00:28.381 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.375+0000 7f9ba4c18640 1 -- start start 2023-10-08T12:00:28.382 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.379+0000 7fe2c17c6640 1 -- 172.21.15.62:0/76352159 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe2bc14ae70 msgr2=0x7fe2bc06d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:28.382 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.379+0000 7fe2c17c6640 1 --2- 172.21.15.62:0/76352159 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe2bc14ae70 0x7fe2bc06d4c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac009840 tx=0x7fe2ac01c700 comp rx=0 tx=0).stop 2023-10-08T12:00:28.382 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.379+0000 7f9ba4c18640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9ba00b6d40 0x7f9ba0070a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:28.382 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.379+0000 7f9ba4c18640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9ba00b88b0 0x7f9ba01e3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:28.382 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.379+0000 7f9ba4c18640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ba00b9a70 0x7f9ba006f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:28.383 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.379+0000 7f9ba4c18640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba00afb20 con 0x7f9ba00b9a70 2023-10-08T12:00:28.383 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.379+0000 7f9ba4c18640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba014c0e0 con 0x7f9ba00b88b0 2023-10-08T12:00:28.383 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.379+0000 7f9ba4c18640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba0070080 con 0x7f9ba00b6d40 2023-10-08T12:00:28.383 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.379+0000 7fe2c17c6640 1 -- 172.21.15.62:0/76352159 shutdown_connections 2023-10-08T12:00:28.383 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.379+0000 7fe2c17c6640 1 --2- 172.21.15.62:0/76352159 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe2bc14ae70 0x7fe2bc06d4c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:28.383 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.379+0000 7fe2c17c6640 1 --2- 172.21.15.62:0/76352159 >> v2:172.21.15.130:3300/0 conn(0x7fe2bc06cd10 0x7fe2bc14a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:28.383 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.379+0000 7fe2c17c6640 1 -- 172.21.15.62:0/76352159 >> 172.21.15.62:0/76352159 conn(0x7fe2bc09e620 msgr2=0x7fe2bc09ea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:28.384 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.379+0000 7f9b9ed9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ba00b9a70 0x7f9ba006f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:28.384 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.379+0000 7f9b9ed9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ba00b9a70 0x7f9ba006f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43876/0 (socket says 172.21.15.62:43876) 2023-10-08T12:00:28.384 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.379+0000 7f9b9ed9d640 1 -- 172.21.15.62:0/199545098 learned_addr learned my addr 172.21.15.62:0/199545098 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:28.384 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.379+0000 7f9b9dd9b640 1 --2- 172.21.15.62:0/199545098 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9ba00b88b0 0x7f9ba01e3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:28.384 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.379+0000 7fe2c17c6640 1 -- 172.21.15.62:0/76352159 shutdown_connections 2023-10-08T12:00:28.385 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.379+0000 7f9b9e59c640 1 --2- 172.21.15.62:0/199545098 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9ba00b6d40 0x7f9ba0070a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:28.385 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.379+0000 7fe2c17c6640 1 -- 172.21.15.62:0/76352159 wait complete. 2023-10-08T12:00:28.385 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.379+0000 7fe2c17c6640 1 Processor -- start 2023-10-08T12:00:28.385 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.379+0000 7f9b9ed9d640 1 -- 172.21.15.62:0/199545098 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9ba00b6d40 msgr2=0x7f9ba0070a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:28.385 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.379+0000 7f9b9ed9d640 1 --2- 172.21.15.62:0/199545098 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9ba00b6d40 0x7f9ba0070a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:28.386 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.379+0000 7f9b9ed9d640 1 -- 172.21.15.62:0/199545098 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9ba00b88b0 msgr2=0x7f9ba01e3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:28.386 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.379+0000 7f9b9ed9d640 1 --2- 172.21.15.62:0/199545098 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9ba00b88b0 0x7f9ba01e3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:28.386 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.379+0000 7f9b9ed9d640 1 -- 172.21.15.62:0/199545098 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b940094a0 con 0x7f9ba00b9a70 2023-10-08T12:00:28.386 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.379+0000 7f9b9e59c640 1 --2- 172.21.15.62:0/199545098 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9ba00b6d40 0x7f9ba0070a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:00:28.386 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.379+0000 7f9b9ed9d640 1 --2- 172.21.15.62:0/199545098 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ba00b9a70 0x7f9ba006f660 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9b94009790 tx=0x7f9b94005270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:28.386 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.379+0000 7f9b8effd640 1 -- 172.21.15.62:0/199545098 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b940bb070 con 0x7f9ba00b9a70 2023-10-08T12:00:28.386 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.379+0000 7f9ba4c18640 1 -- 172.21.15.62:0/199545098 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ba00b8db0 con 0x7f9ba00b9a70 2023-10-08T12:00:28.386 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.379+0000 7f9ba4c18640 1 -- 172.21.15.62:0/199545098 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ba01e7390 con 0x7f9ba00b9a70 2023-10-08T12:00:28.386 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.379+0000 7f9b8effd640 1 -- 172.21.15.62:0/199545098 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f9b94005670 con 0x7f9ba00b9a70 2023-10-08T12:00:28.387 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.379+0000 7fe2c17c6640 1 -- start start 2023-10-08T12:00:28.387 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.383+0000 7fe2c17c6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2bc06cd10 0x7fe2bc0a1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:28.387 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.383+0000 7fe2c17c6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe2bc06da00 0x7fe2bc143860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:28.387 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.383+0000 7fe2c17c6640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe2bc14ae70 0x7fe2bc099060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:28.387 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.383+0000 7fe2c17c6640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2bc0a2390 con 0x7fe2bc06cd10 2023-10-08T12:00:28.387 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.383+0000 7fe2c17c6640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2bc09daf0 con 0x7fe2bc06da00 2023-10-08T12:00:28.387 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.383+0000 7fe2c17c6640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2bc1e61d0 con 0x7fe2bc14ae70 2023-10-08T12:00:28.388 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.383+0000 7f9b8effd640 1 -- 172.21.15.62:0/199545098 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b94004230 con 0x7f9ba00b9a70 2023-10-08T12:00:28.389 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.383+0000 7fe2b3fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe2bc06da00 0x7fe2bc143860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:28.389 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.383+0000 7fe2b3fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe2bc06da00 0x7fe2bc143860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.62:34942/0 (socket says 172.21.15.62:34942) 2023-10-08T12:00:28.389 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.383+0000 7fe2b3fff640 1 -- 172.21.15.62:0/4082438370 learned_addr learned my addr 172.21.15.62:0/4082438370 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:28.389 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.383+0000 7fe2bb7fe640 1 --2- 172.21.15.62:0/4082438370 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe2bc14ae70 0x7fe2bc099060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:28.389 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.383+0000 7fe2baffd640 1 --2- 172.21.15.62:0/4082438370 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2bc06cd10 0x7fe2bc0a1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:28.389 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.383+0000 7fe2b3fff640 1 -- 172.21.15.62:0/4082438370 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe2bc14ae70 msgr2=0x7fe2bc099060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:28.389 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.383+0000 7fe2b3fff640 1 --2- 172.21.15.62:0/4082438370 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe2bc14ae70 0x7fe2bc099060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:28.390 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.383+0000 7fe2b3fff640 1 -- 172.21.15.62:0/4082438370 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2bc06cd10 msgr2=0x7fe2bc0a1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:28.390 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.383+0000 7fe2b3fff640 1 --2- 172.21.15.62:0/4082438370 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2bc06cd10 0x7fe2bc0a1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:28.390 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.383+0000 7fe2b3fff640 1 -- 172.21.15.62:0/4082438370 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2ac0094a0 con 0x7fe2bc06da00 2023-10-08T12:00:28.390 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.383+0000 7fe2bb7fe640 1 --2- 172.21.15.62:0/4082438370 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe2bc14ae70 0x7fe2bc099060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:00:28.390 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.383+0000 7fe2baffd640 1 --2- 172.21.15.62:0/4082438370 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2bc06cd10 0x7fe2bc0a1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:00:28.390 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.383+0000 7fe2b3fff640 1 --2- 172.21.15.62:0/4082438370 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe2bc06da00 0x7fe2bc143860 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac009790 tx=0x7fe2ac0a5580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:28.390 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.383+0000 7fe2b37fe640 1 -- 172.21.15.62:0/4082438370 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac004230 con 0x7fe2bc06da00 2023-10-08T12:00:28.390 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.383+0000 7fe2b37fe640 1 -- 172.21.15.62:0/4082438370 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe2ac004480 con 0x7fe2bc06da00 2023-10-08T12:00:28.390 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.383+0000 7f9b8effd640 1 -- 172.21.15.62:0/199545098 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f9b94004390 con 0x7f9ba00b9a70 2023-10-08T12:00:28.391 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.383+0000 7fbcc7fff640 1 -- 172.21.15.62:0/3467189427 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbcb00047d0 msgr2=0x7fbcb0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:28.391 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.383+0000 7fbcc7fff640 1 --2- 172.21.15.62:0/3467189427 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbcb00047d0 0x7fbcb0004c50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbcc000c610 tx=0x7fbcc001fae0 comp rx=0 tx=0).stop 2023-10-08T12:00:28.391 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.383+0000 7f9b8effd640 1 --2- 172.21.15.62:0/199545098 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f9b80066470 0x7f9b80068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:28.391 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.383+0000 7fbcc77fe640 1 -- 172.21.15.62:0/3467189427 reap_dead start 2023-10-08T12:00:28.392 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.383+0000 7fe2b37fe640 1 -- 172.21.15.62:0/4082438370 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac0052d0 con 0x7fe2bc06da00 2023-10-08T12:00:28.392 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.383+0000 7fe2c17c6640 1 -- 172.21.15.62:0/4082438370 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2bc1e64b0 con 0x7fe2bc06da00 2023-10-08T12:00:28.392 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.383+0000 7f9b8effd640 1 -- 172.21.15.62:0/199545098 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9b940f01b0 con 0x7f9ba00b9a70 2023-10-08T12:00:28.392 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.383+0000 7f9b9e59c640 1 --2- 172.21.15.62:0/199545098 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f9b80066470 0x7f9b80068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:28.393 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.383+0000 7fe2c17c6640 1 -- 172.21.15.62:0/4082438370 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2bc1e6a70 con 0x7fe2bc06da00 2023-10-08T12:00:28.393 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.387+0000 7f9ba4c18640 1 -- 172.21.15.62:0/199545098 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b84005260 con 0x7f9ba00b9a70 2023-10-08T12:00:28.393 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.387+0000 7f9b9e59c640 1 --2- 172.21.15.62:0/199545098 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f9b80066470 0x7f9b80068930 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9b90001710 tx=0x7f9b90009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:28.393 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.387+0000 7fe2c17c6640 1 -- 172.21.15.62:0/4082438370 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2bc04da80 con 0x7fe2bc06da00 2023-10-08T12:00:28.394 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.387+0000 7fe2b37fe640 1 -- 172.21.15.62:0/4082438370 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe2ac0b4040 con 0x7fe2bc06da00 2023-10-08T12:00:28.394 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.387+0000 7fbcc7fff640 1 -- 172.21.15.62:0/3467189427 shutdown_connections 2023-10-08T12:00:28.394 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.387+0000 7fbcc7fff640 1 -- 172.21.15.62:0/3467189427 >> 172.21.15.62:0/3467189427 conn(0x7fbcc80b8420 msgr2=0x7fbcc80b8830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:28.395 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.387+0000 7fe2b37fe640 1 --2- 172.21.15.62:0/4082438370 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fe29c066470 0x7fe29c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:28.395 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.387+0000 7fe2b37fe640 1 -- 172.21.15.62:0/4082438370 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe2ac11dc70 con 0x7fe2bc06da00 2023-10-08T12:00:28.395 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.387+0000 7fe2baffd640 1 --2- 172.21.15.62:0/4082438370 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fe29c066470 0x7fe29c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:28.395 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.391+0000 7fe2baffd640 1 --2- 172.21.15.62:0/4082438370 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fe29c066470 0x7fe29c068930 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe2a4009fd0 tx=0x7fe2a40091e0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:28.396 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.391+0000 7fbcc7fff640 1 -- 172.21.15.62:0/3467189427 shutdown_connections 2023-10-08T12:00:28.396 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.391+0000 7fbcc7fff640 1 -- 172.21.15.62:0/3467189427 wait complete. 2023-10-08T12:00:28.396 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.391+0000 7fbcc7fff640 1 Processor -- start 2023-10-08T12:00:28.397 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.391+0000 7fbcc7fff640 1 -- start start 2023-10-08T12:00:28.397 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.391+0000 7fbcc7fff640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbcb00047d0 0x7fbcc8140d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:28.398 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.391+0000 7fbcc7fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbcc813f730 0x7fbcc81e6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:28.398 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.391+0000 7fbcc7fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbcc813feb0 0x7fbcc8140330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:28.398 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.391+0000 7fbcc7fff640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc81412c0 con 0x7fbcc813f730 2023-10-08T12:00:28.398 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.391+0000 7fbcc7fff640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc81e7280 con 0x7fbcc813feb0 2023-10-08T12:00:28.398 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.391+0000 7fbcc7fff640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc81e62f0 con 0x7fbcb00047d0 2023-10-08T12:00:28.398 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.391+0000 7fbcc67fc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbcc813f730 0x7fbcc81e6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:28.399 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.391+0000 7fbcc67fc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbcc813f730 0x7fbcc81e6d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43894/0 (socket says 172.21.15.62:43894) 2023-10-08T12:00:28.399 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.391+0000 7fbcc67fc640 1 -- 172.21.15.62:0/1691978954 learned_addr learned my addr 172.21.15.62:0/1691978954 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:28.399 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.391+0000 7fbcc77fe640 1 --2- 172.21.15.62:0/1691978954 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbcc813feb0 0x7fbcc8140330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:28.399 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.391+0000 7fbcc6ffd640 1 --2- 172.21.15.62:0/1691978954 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbcb00047d0 0x7fbcc8140d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:28.399 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.391+0000 7fbcc67fc640 1 -- 172.21.15.62:0/1691978954 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbcb00047d0 msgr2=0x7fbcc8140d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:28.399 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.391+0000 7fbcc67fc640 1 --2- 172.21.15.62:0/1691978954 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbcb00047d0 0x7fbcc8140d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:28.399 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.391+0000 7fbcc67fc640 1 -- 172.21.15.62:0/1691978954 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbcc813feb0 msgr2=0x7fbcc8140330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:28.400 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.391+0000 7fbcc67fc640 1 --2- 172.21.15.62:0/1691978954 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbcc813feb0 0x7fbcc8140330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:28.400 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.391+0000 7fbcc67fc640 1 -- 172.21.15.62:0/1691978954 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcc80b5070 con 0x7fbcc813f730 2023-10-08T12:00:28.400 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.391+0000 7fbcc67fc640 1 --2- 172.21.15.62:0/1691978954 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbcc813f730 0x7fbcc81e6d40 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fbcc001f910 tx=0x7fbcc00017c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:28.400 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.395+0000 7f9b8effd640 1 -- 172.21.15.62:0/199545098 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9b940b2080 con 0x7f9ba00b9a70 2023-10-08T12:00:28.402 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.395+0000 7fbcaf7fe640 1 -- 172.21.15.62:0/1691978954 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc00b8070 con 0x7fbcc813f730 2023-10-08T12:00:28.402 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.395+0000 7fbcaf7fe640 1 -- 172.21.15.62:0/1691978954 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fbcc00019b0 con 0x7fbcc813f730 2023-10-08T12:00:28.402 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.395+0000 7fbcaf7fe640 1 -- 172.21.15.62:0/1691978954 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc0003be0 con 0x7fbcc813f730 2023-10-08T12:00:28.402 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.395+0000 7fbcc7fff640 1 -- 172.21.15.62:0/1691978954 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcc8142710 con 0x7fbcc813f730 2023-10-08T12:00:28.403 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.395+0000 7fbcc7fff640 1 -- 172.21.15.62:0/1691978954 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcc81e6540 con 0x7fbcc813f730 2023-10-08T12:00:28.403 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.395+0000 7fbcc7fff640 1 -- 172.21.15.62:0/1691978954 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcc804da80 con 0x7fbcc813f730 2023-10-08T12:00:28.403 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.395+0000 7fbcaf7fe640 1 -- 172.21.15.62:0/1691978954 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fbcc0003d40 con 0x7fbcc813f730 2023-10-08T12:00:28.403 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.395+0000 7fbcaf7fe640 1 --2- 172.21.15.62:0/1691978954 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fbcb4066470 0x7fbcb4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:28.403 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.399+0000 7fbcaf7fe640 1 -- 172.21.15.62:0/1691978954 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbcc0120eb0 con 0x7fbcc813f730 2023-10-08T12:00:28.403 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.399+0000 7fbcc6ffd640 1 --2- 172.21.15.62:0/1691978954 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fbcb4066470 0x7fbcb4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:28.403 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.399+0000 7fbcc6ffd640 1 --2- 172.21.15.62:0/1691978954 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fbcb4066470 0x7fbcb4068930 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbcb8005fd0 tx=0x7fbcb8007040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:28.405 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.399+0000 7fe2b37fe640 1 -- 172.21.15.62:0/4082438370 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe2ac0eb230 con 0x7fe2bc06da00 2023-10-08T12:00:28.414 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.411+0000 7fbcaf7fe640 1 -- 172.21.15.62:0/1691978954 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbcc00ee180 con 0x7fbcc813f730 2023-10-08T12:00:28.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.415+0000 7f44d3fff640 1 -- 172.21.15.62:0/3483687997 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f44bc005190 msgr2=0x7f44bc00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:28.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.415+0000 7f44d3fff640 1 --2- 172.21.15.62:0/3483687997 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f44bc005190 0x7f44bc00b990 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f44c4006f20 tx=0x7f44c401cf40 comp rx=0 tx=0).stop 2023-10-08T12:00:28.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.415+0000 7f44d37fe640 1 -- 172.21.15.62:0/3483687997 reap_dead start 2023-10-08T12:00:28.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.415+0000 7f44d3fff640 1 -- 172.21.15.62:0/3483687997 shutdown_connections 2023-10-08T12:00:28.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.415+0000 7f44d3fff640 1 -- 172.21.15.62:0/3483687997 >> 172.21.15.62:0/3483687997 conn(0x7f44d409c600 msgr2=0x7f44d409ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:28.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.415+0000 7f44d3fff640 1 -- 172.21.15.62:0/3483687997 shutdown_connections 2023-10-08T12:00:28.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.419+0000 7f44d3fff640 1 -- 172.21.15.62:0/3483687997 wait complete. 2023-10-08T12:00:28.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.419+0000 7f44d3fff640 1 Processor -- start 2023-10-08T12:00:28.424 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.419+0000 7f44d3fff640 1 -- start start 2023-10-08T12:00:28.425 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.419+0000 7f44d3fff640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f44d4098e50 0x7f44d4143c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:28.425 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.419+0000 7f44d3fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f44d41e2b50 0x7f44d4140840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:28.425 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.419+0000 7f44d3fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f44d4140d80 0x7f44d4141340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:28.425 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.419+0000 7f44d3fff640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44d406e0a0 con 0x7f44d4140d80 2023-10-08T12:00:28.425 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.419+0000 7f44d3fff640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44d406e940 con 0x7f44d41e2b50 2023-10-08T12:00:28.425 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.419+0000 7f44d3fff640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44d406e2f0 con 0x7f44d4098e50 2023-10-08T12:00:28.425 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.419+0000 7f44d2ffd640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f44d4098e50 0x7f44d4143c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:28.425 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.419+0000 7f44d2ffd640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f44d4098e50 0x7f44d4143c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.62:48252/0 (socket says 172.21.15.62:48252) 2023-10-08T12:00:28.425 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.419+0000 7f44d2ffd640 1 -- 172.21.15.62:0/763027512 learned_addr learned my addr 172.21.15.62:0/763027512 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:28.425 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.419+0000 7f44d37fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f44d4140d80 0x7f44d4141340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:28.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.419+0000 7f44d2ffd640 1 -- 172.21.15.62:0/763027512 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f44d41e2b50 msgr2=0x7f44d4140840 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T12:00:28.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.419+0000 7f44d2ffd640 1 --2- 172.21.15.62:0/763027512 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f44d41e2b50 0x7f44d4140840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:28.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.419+0000 7f44d2ffd640 1 -- 172.21.15.62:0/763027512 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f44d4140d80 msgr2=0x7f44d4141340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:28.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.419+0000 7f44d2ffd640 1 --2- 172.21.15.62:0/763027512 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f44d4140d80 0x7f44d4141340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:28.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.419+0000 7f44d2ffd640 1 -- 172.21.15.62:0/763027512 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44d406e5d0 con 0x7f44d4098e50 2023-10-08T12:00:28.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.423+0000 7f44d2ffd640 1 --2- 172.21.15.62:0/763027512 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f44d4098e50 0x7f44d4143c90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f44cc00c7b0 tx=0x7f44cc00cc70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:28.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.423+0000 7f44bb7fe640 1 -- 172.21.15.62:0/763027512 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44cc004b70 con 0x7f44d4098e50 2023-10-08T12:00:28.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.423+0000 7f44d3fff640 1 -- 172.21.15.62:0/763027512 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44d4099230 con 0x7f44d4098e50 2023-10-08T12:00:28.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.423+0000 7f44bb7fe640 1 -- 172.21.15.62:0/763027512 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f44cc004de0 con 0x7f44d4098e50 2023-10-08T12:00:28.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.423+0000 7f44bb7fe640 1 -- 172.21.15.62:0/763027512 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44cc00aa50 con 0x7f44d4098e50 2023-10-08T12:00:28.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.423+0000 7f44d3fff640 1 -- 172.21.15.62:0/763027512 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44d4099940 con 0x7f44d4098e50 2023-10-08T12:00:28.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.423+0000 7f44d3fff640 1 -- 172.21.15.62:0/763027512 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44d4141160 con 0x7f44d4098e50 2023-10-08T12:00:28.431 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.427+0000 7f44bb7fe640 1 -- 172.21.15.62:0/763027512 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f44cc00abb0 con 0x7f44d4098e50 2023-10-08T12:00:28.431 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.427+0000 7f44bb7fe640 1 --2- 172.21.15.62:0/763027512 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f44c00664a0 0x7f44c0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:28.431 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.427+0000 7f44bb7fe640 1 -- 172.21.15.62:0/763027512 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f44cc0848e0 con 0x7f44d4098e50 2023-10-08T12:00:28.431 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.427+0000 7f44d27fc640 1 --2- 172.21.15.62:0/763027512 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f44c00664a0 0x7f44c0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:28.431 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.427+0000 7f44d27fc640 1 --2- 172.21.15.62:0/763027512 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f44c00664a0 0x7f44c0068960 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f44d41e0710 tx=0x7f44c80091e0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:28.437 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.431+0000 7f2c4dec9640 1 -- 172.21.15.62:0/1152350491 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2c38005190 msgr2=0x7f2c3800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:28.437 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.431+0000 7f2c4dec9640 1 --2- 172.21.15.62:0/1152350491 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2c38005190 0x7f2c3800b990 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2c4806f200 tx=0x7f2c4001d5b0 comp rx=0 tx=0).stop 2023-10-08T12:00:28.438 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.435+0000 7f2c4dec9640 1 -- 172.21.15.62:0/1152350491 shutdown_connections 2023-10-08T12:00:28.438 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.435+0000 7f2c4dec9640 1 --2- 172.21.15.62:0/1152350491 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2c38005190 0x7f2c3800b990 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:28.438 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.435+0000 7f2c4dec9640 1 -- 172.21.15.62:0/1152350491 >> 172.21.15.62:0/1152350491 conn(0x7f2c480b95a0 msgr2=0x7f2c480b99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:28.438 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.435+0000 7f2c4dec9640 1 -- 172.21.15.62:0/1152350491 shutdown_connections 2023-10-08T12:00:28.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.435+0000 7f2c4dec9640 1 -- 172.21.15.62:0/1152350491 wait complete. 2023-10-08T12:00:28.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.435+0000 7f2c4dec9640 1 Processor -- start 2023-10-08T12:00:28.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.435+0000 7f2c4dec9640 1 -- start start 2023-10-08T12:00:28.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.435+0000 7f2c4dec9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2c38005190 0x7f2c481ebb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:28.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.435+0000 7f2c4dec9640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2c481e5cb0 0x7f2c4809e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:28.442 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.435+0000 7f2c4dec9640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2c481ef390 0x7f2c481ef810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:28.442 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.435+0000 7f2c4dec9640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c481ecac0 con 0x7f2c38005190 2023-10-08T12:00:28.442 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.435+0000 7f2c4dec9640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c480a1620 con 0x7f2c481ef390 2023-10-08T12:00:28.442 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.435+0000 7f2c4dec9640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c481efd50 con 0x7f2c481e5cb0 2023-10-08T12:00:28.442 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.435+0000 7f2c4cec7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2c38005190 0x7f2c481ebb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:28.445 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.435+0000 7f2c4cec7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2c38005190 0x7f2c481ebb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43934/0 (socket says 172.21.15.62:43934) 2023-10-08T12:00:28.445 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.435+0000 7f2c4cec7640 1 -- 172.21.15.62:0/1121950886 learned_addr learned my addr 172.21.15.62:0/1121950886 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:28.445 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.435+0000 7f2c47fff640 1 --2- 172.21.15.62:0/1121950886 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2c481e5cb0 0x7f2c4809e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:28.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.439+0000 7f2c4cec7640 1 -- 172.21.15.62:0/1121950886 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2c481e5cb0 msgr2=0x7f2c4809e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:28.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.439+0000 7f2c4cec7640 1 --2- 172.21.15.62:0/1121950886 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2c481e5cb0 0x7f2c4809e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:28.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.439+0000 7f2c4cec7640 1 -- 172.21.15.62:0/1121950886 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2c481ef390 msgr2=0x7f2c481ef810 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T12:00:28.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.439+0000 7f2c4cec7640 1 --2- 172.21.15.62:0/1121950886 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2c481ef390 0x7f2c481ef810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:28.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.439+0000 7f2c4cec7640 1 -- 172.21.15.62:0/1121950886 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c481ec190 con 0x7f2c38005190 2023-10-08T12:00:28.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.439+0000 7f2c4cec7640 1 --2- 172.21.15.62:0/1121950886 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2c38005190 0x7f2c481ebb20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2c3400c950 tx=0x7f2c3400ce10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:28.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.439+0000 7f2c457fa640 1 -- 172.21.15.62:0/1121950886 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c34007c70 con 0x7f2c38005190 2023-10-08T12:00:28.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.439+0000 7f2c4dec9640 1 -- 172.21.15.62:0/1121950886 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c481ec470 con 0x7f2c38005190 2023-10-08T12:00:28.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.439+0000 7f2c4dec9640 1 -- 172.21.15.62:0/1121950886 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c480b7d80 con 0x7f2c38005190 2023-10-08T12:00:28.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.439+0000 7f44bb7fe640 1 -- 172.21.15.62:0/763027512 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f44cc051d50 con 0x7f44d4098e50 2023-10-08T12:00:28.448 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.439+0000 7f2c4dec9640 1 -- 172.21.15.62:0/1121950886 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c4804da80 con 0x7f2c38005190 2023-10-08T12:00:28.450 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.439+0000 7f5073fff640 1 -- 172.21.15.62:0/2049812677 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f506c03cdc0 msgr2=0x7f506c0cdeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:28.450 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.439+0000 7f5073fff640 1 --2- 172.21.15.62:0/2049812677 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f506c03cdc0 0x7f506c0cdeb0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5064009900 tx=0x7f506401c8e0 comp rx=0 tx=0).stop 2023-10-08T12:00:28.450 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.439+0000 7f5073fff640 1 -- 172.21.15.62:0/2049812677 shutdown_connections 2023-10-08T12:00:28.450 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.439+0000 7f5073fff640 1 --2- 172.21.15.62:0/2049812677 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f506c03f370 0x7f506c008bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:28.450 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.439+0000 7f5073fff640 1 --2- 172.21.15.62:0/2049812677 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f506c03cdc0 0x7f506c0cdeb0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:28.450 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.439+0000 7f5073fff640 1 -- 172.21.15.62:0/2049812677 >> 172.21.15.62:0/2049812677 conn(0x7f506c00a520 msgr2=0x7f506c00a930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:28.450 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.439+0000 7f5073fff640 1 -- 172.21.15.62:0/2049812677 shutdown_connections 2023-10-08T12:00:28.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.439+0000 7f5073fff640 1 -- 172.21.15.62:0/2049812677 wait complete. 2023-10-08T12:00:28.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.443+0000 7f5073fff640 1 Processor -- start 2023-10-08T12:00:28.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.443+0000 7f5073fff640 1 -- start start 2023-10-08T12:00:28.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.443+0000 7f5073fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f506c03cdc0 0x7f506c0288b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:28.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.443+0000 7f5073fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f506c03f370 0x7f506c0c8320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:28.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.443+0000 7f5073fff640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f506c0d13e0 0x7f506c0c8860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:28.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.443+0000 7f5073fff640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f506c03a060 con 0x7f506c03cdc0 2023-10-08T12:00:28.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.443+0000 7f5073fff640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f506c022170 con 0x7f506c03f370 2023-10-08T12:00:28.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.443+0000 7f5073fff640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f506c028df0 con 0x7f506c0d13e0 2023-10-08T12:00:28.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.443+0000 7f50737fe640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f506c0d13e0 0x7f506c0c8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:28.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.443+0000 7f50727fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f506c03f370 0x7f506c0c8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:28.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.443+0000 7f50727fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f506c03f370 0x7f506c0c8320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.62:34992/0 (socket says 172.21.15.62:34992) 2023-10-08T12:00:28.452 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.443+0000 7f50727fc640 1 -- 172.21.15.62:0/4149776000 learned_addr learned my addr 172.21.15.62:0/4149776000 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:28.452 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.443+0000 7f50727fc640 1 -- 172.21.15.62:0/4149776000 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f506c0d13e0 msgr2=0x7f506c0c8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:28.452 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.443+0000 7f50727fc640 1 --2- 172.21.15.62:0/4149776000 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f506c0d13e0 0x7f506c0c8860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:28.452 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.443+0000 7f50727fc640 1 -- 172.21.15.62:0/4149776000 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f506c03cdc0 msgr2=0x7f506c0288b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:28.452 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.443+0000 7f50727fc640 1 --2- 172.21.15.62:0/4149776000 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f506c03cdc0 0x7f506c0288b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:28.452 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.443+0000 7f50727fc640 1 -- 172.21.15.62:0/4149776000 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5064009560 con 0x7f506c03f370 2023-10-08T12:00:28.452 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.443+0000 7f50727fc640 1 --2- 172.21.15.62:0/4149776000 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f506c03f370 0x7f506c0c8320 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f506800e9f0 tx=0x7f506800edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:28.452 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.443+0000 7f505b7fe640 1 -- 172.21.15.62:0/4149776000 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5068009710 con 0x7f506c03f370 2023-10-08T12:00:28.452 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.443+0000 7f5073fff640 1 -- 172.21.15.62:0/4149776000 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f506c03a250 con 0x7f506c03f370 2023-10-08T12:00:28.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.443+0000 7f5073fff640 1 -- 172.21.15.62:0/4149776000 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f506c029070 con 0x7f506c03f370 2023-10-08T12:00:28.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.443+0000 7f505b7fe640 1 -- 172.21.15.62:0/4149776000 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f506800cdb0 con 0x7f506c03f370 2023-10-08T12:00:28.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.443+0000 7f505b7fe640 1 -- 172.21.15.62:0/4149776000 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5068010690 con 0x7f506c03f370 2023-10-08T12:00:28.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.447+0000 7f5073fff640 1 -- 172.21.15.62:0/4149776000 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5054005260 con 0x7f506c03f370 2023-10-08T12:00:28.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.447+0000 7f505b7fe640 1 -- 172.21.15.62:0/4149776000 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f50680107f0 con 0x7f506c03f370 2023-10-08T12:00:28.454 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.447+0000 7f505b7fe640 1 --2- 172.21.15.62:0/4149776000 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f5060066470 0x7f5060068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:28.454 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.447+0000 7f505b7fe640 1 -- 172.21.15.62:0/4149776000 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5068014070 con 0x7f506c03f370 2023-10-08T12:00:28.454 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.447+0000 7f5072ffd640 1 --2- 172.21.15.62:0/4149776000 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f5060066470 0x7f5060068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:28.454 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.447+0000 7f5072ffd640 1 --2- 172.21.15.62:0/4149776000 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f5060066470 0x7f5060068930 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f50640af000 tx=0x7f5064019680 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:28.455 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.451+0000 7f2c457fa640 1 -- 172.21.15.62:0/1121950886 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2c34004020 con 0x7f2c38005190 2023-10-08T12:00:28.455 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.451+0000 7f2c457fa640 1 -- 172.21.15.62:0/1121950886 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c34004430 con 0x7f2c38005190 2023-10-08T12:00:28.455 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.451+0000 7f2c457fa640 1 -- 172.21.15.62:0/1121950886 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2c34003600 con 0x7f2c38005190 2023-10-08T12:00:28.455 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.451+0000 7f2c457fa640 1 --2- 172.21.15.62:0/1121950886 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f2c3806a510 0x7f2c3806c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:28.455 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.451+0000 7f2c457fa640 1 -- 172.21.15.62:0/1121950886 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2c34013070 con 0x7f2c38005190 2023-10-08T12:00:28.455 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.451+0000 7f2c457fa640 1 -- 172.21.15.62:0/1121950886 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2c34086a50 con 0x7f2c38005190 2023-10-08T12:00:28.455 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.451+0000 7f2c47fff640 1 --2- 172.21.15.62:0/1121950886 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f2c3806a510 0x7f2c3806c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:28.456 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.451+0000 7f2c47fff640 1 --2- 172.21.15.62:0/1121950886 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f2c3806a510 0x7f2c3806c9d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2c4806ca50 tx=0x7f2c3c0017b0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:28.463 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.459+0000 7fd26b68c640 1 -- 172.21.15.62:0/3749680756 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd264097a70 msgr2=0x7fd26406a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:28.463 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.459+0000 7fd26b68c640 1 --2- 172.21.15.62:0/3749680756 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd264097a70 0x7fd26406a930 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd260009900 tx=0x7fd26001c8c0 comp rx=0 tx=0).stop 2023-10-08T12:00:28.463 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.459+0000 7fd26b68c640 1 -- 172.21.15.62:0/3749680756 shutdown_connections 2023-10-08T12:00:28.463 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.459+0000 7fd26b68c640 1 --2- 172.21.15.62:0/3749680756 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd264097a70 0x7fd26406a930 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:28.463 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.459+0000 7fd26b68c640 1 --2- 172.21.15.62:0/3749680756 >> v2:172.21.15.62:3300/0 conn(0x7fd2640b7460 0x7fd2640b5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:28.463 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.459+0000 7fd26b68c640 1 -- 172.21.15.62:0/3749680756 >> 172.21.15.62:0/3749680756 conn(0x7fd2640ba770 msgr2=0x7fd2640bab80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:28.463 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.459+0000 7fd26b68c640 1 -- 172.21.15.62:0/3749680756 shutdown_connections 2023-10-08T12:00:28.463 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.459+0000 7fd26b68c640 1 -- 172.21.15.62:0/3749680756 wait complete. 2023-10-08T12:00:28.464 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.459+0000 7fd26b68c640 1 Processor -- start 2023-10-08T12:00:28.465 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.459+0000 7f505b7fe640 1 -- 172.21.15.62:0/4149776000 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5068050090 con 0x7f506c03f370 2023-10-08T12:00:28.465 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.459+0000 7fd26b68c640 1 -- start start 2023-10-08T12:00:28.465 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.459+0000 7fd26b68c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd264097a70 0x7fd26414e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:28.466 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.459+0000 7fd26b68c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd2640b6c60 0x7fd26414f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:28.466 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.459+0000 7fd26b68c640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd2640b7460 0x7fd26409f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:28.466 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.463+0000 7fd269428640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd264097a70 0x7fd26414e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:28.466 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.463+0000 7fd269428640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd264097a70 0x7fd26414e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43952/0 (socket says 172.21.15.62:43952) 2023-10-08T12:00:28.466 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.463+0000 7fd269428640 1 -- 172.21.15.62:0/3219249381 learned_addr learned my addr 172.21.15.62:0/3219249381 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:28.466 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.463+0000 7fd26b68c640 1 -- 172.21.15.62:0/3219249381 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd26414eb10 con 0x7fd264097a70 2023-10-08T12:00:28.467 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.463+0000 7fd26b68c640 1 -- 172.21.15.62:0/3219249381 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2641486e0 con 0x7fd2640b6c60 2023-10-08T12:00:28.467 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.463+0000 7fd269c29640 1 --2- 172.21.15.62:0/3219249381 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd2640b7460 0x7fd26409f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:28.467 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.463+0000 7fd268c27640 1 --2- 172.21.15.62:0/3219249381 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd2640b6c60 0x7fd26414f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:28.467 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.463+0000 7fd26b68c640 1 -- 172.21.15.62:0/3219249381 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd26414dbe0 con 0x7fd2640b7460 2023-10-08T12:00:28.467 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.463+0000 7fd269428640 1 -- 172.21.15.62:0/3219249381 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd2640b7460 msgr2=0x7fd26409f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:28.467 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.463+0000 7fd269428640 1 --2- 172.21.15.62:0/3219249381 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd2640b7460 0x7fd26409f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:28.468 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.463+0000 7fd269428640 1 -- 172.21.15.62:0/3219249381 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd2640b6c60 msgr2=0x7fd26414f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:28.468 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.463+0000 7fd269428640 1 --2- 172.21.15.62:0/3219249381 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd2640b6c60 0x7fd26414f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:28.468 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.463+0000 7fd269428640 1 -- 172.21.15.62:0/3219249381 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd260009560 con 0x7fd264097a70 2023-10-08T12:00:28.468 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.463+0000 7fd269428640 1 --2- 172.21.15.62:0/3219249381 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd264097a70 0x7fd26414e5d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd25c00ba80 tx=0x7fd25c00bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:28.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.467+0000 7fd259ffb640 1 -- 172.21.15.62:0/3219249381 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd25c00cc90 con 0x7fd264097a70 2023-10-08T12:00:28.470 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.467+0000 7fd26b68c640 1 -- 172.21.15.62:0/3219249381 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd264150920 con 0x7fd264097a70 2023-10-08T12:00:28.470 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.467+0000 7fd26b68c640 1 -- 172.21.15.62:0/3219249381 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd264150090 con 0x7fd264097a70 2023-10-08T12:00:28.473 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.471+0000 7fd259ffb640 1 -- 172.21.15.62:0/3219249381 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd25c014440 con 0x7fd264097a70 2023-10-08T12:00:28.474 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.471+0000 7fd259ffb640 1 -- 172.21.15.62:0/3219249381 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd25c014850 con 0x7fd264097a70 2023-10-08T12:00:28.475 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.471+0000 7fd259ffb640 1 -- 172.21.15.62:0/3219249381 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd25c01d3b0 con 0x7fd264097a70 2023-10-08T12:00:28.475 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.471+0000 7fd259ffb640 1 --2- 172.21.15.62:0/3219249381 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fd2480665c0 0x7fd248068a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:28.476 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.471+0000 7fd259ffb640 1 -- 172.21.15.62:0/3219249381 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd25c0841b0 con 0x7fd264097a70 2023-10-08T12:00:28.476 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.471+0000 7fd268c27640 1 --2- 172.21.15.62:0/3219249381 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fd2480665c0 0x7fd248068a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:28.476 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.471+0000 7fd24f7fe640 1 -- 172.21.15.62:0/3219249381 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd244005260 con 0x7fd264097a70 2023-10-08T12:00:28.477 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.471+0000 7fd268c27640 1 --2- 172.21.15.62:0/3219249381 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fd2480665c0 0x7fd248068a80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd2600af000 tx=0x7fd26001b100 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:28.485 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.479+0000 7fd259ffb640 1 -- 172.21.15.62:0/3219249381 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd25c051750 con 0x7fd264097a70 2023-10-08T12:00:28.706 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.703+0000 7fc31a4af640 1 -- 172.21.15.62:0/2726000059 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fc3140b6640 con 0x7fc3140b88b0 2023-10-08T12:00:28.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.703+0000 7fc310ff9640 1 -- 172.21.15.62:0/2726000059 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc30c01c030 con 0x7fc3140b88b0 2023-10-08T12:00:28.709 INFO:teuthology.orchestra.run.smithi062.stdout:55834574854 2023-10-08T12:00:28.714 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.711+0000 7fc2fa7fc640 1 -- 172.21.15.62:0/2726000059 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fc300066570 msgr2=0x7fc300068a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:28.715 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.711+0000 7fc2fa7fc640 1 --2- 172.21.15.62:0/2726000059 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fc300066570 0x7fc300068a30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc3080af000 tx=0x7fc30801af60 comp rx=0 tx=0).stop 2023-10-08T12:00:28.715 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.711+0000 7fc2fa7fc640 1 -- 172.21.15.62:0/2726000059 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3140b88b0 msgr2=0x7fc3141da220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:28.715 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.711+0000 7fc2fa7fc640 1 --2- 172.21.15.62:0/2726000059 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3140b88b0 0x7fc3141da220 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc30c00e780 tx=0x7fc30c00ec40 comp rx=0 tx=0).stop 2023-10-08T12:00:28.715 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.711+0000 7fc2fa7fc640 1 -- 172.21.15.62:0/2726000059 shutdown_connections 2023-10-08T12:00:28.715 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.711+0000 7fc2fa7fc640 1 --2- 172.21.15.62:0/2726000059 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fc300066570 0x7fc300068a30 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:28.715 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.711+0000 7fc2fa7fc640 1 --2- 172.21.15.62:0/2726000059 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc3141e6cb0 0x7fc3141e7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:28.715 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.711+0000 7fc2fa7fc640 1 --2- 172.21.15.62:0/2726000059 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc3140b9a70 0x7fc3140a01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:28.715 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.711+0000 7fc2fa7fc640 1 --2- 172.21.15.62:0/2726000059 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3140b88b0 0x7fc3141da220 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:28.715 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.711+0000 7f9ba4c18640 1 -- 172.21.15.62:0/199545098 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9b840057e0 con 0x7f9ba00b9a70 2023-10-08T12:00:28.716 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.711+0000 7fc2fa7fc640 1 -- 172.21.15.62:0/2726000059 >> 172.21.15.62:0/2726000059 conn(0x7fc31409c600 msgr2=0x7fc3140b8f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:28.716 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.711+0000 7fc2fa7fc640 1 -- 172.21.15.62:0/2726000059 shutdown_connections 2023-10-08T12:00:28.716 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.711+0000 7fc2fa7fc640 1 -- 172.21.15.62:0/2726000059 wait complete. 2023-10-08T12:00:28.716 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.711+0000 7f9b8effd640 1 -- 172.21.15.62:0/199545098 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9b940ebdf0 con 0x7f9ba00b9a70 2023-10-08T12:00:28.717 INFO:teuthology.orchestra.run.smithi062.stdout:55834574853 2023-10-08T12:00:28.718 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.715+0000 7f9b8cff9640 1 -- 172.21.15.62:0/199545098 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f9b80066470 msgr2=0x7f9b80068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:28.718 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.715+0000 7f9b8cff9640 1 --2- 172.21.15.62:0/199545098 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f9b80066470 0x7f9b80068930 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9b90001710 tx=0x7f9b90009040 comp rx=0 tx=0).stop 2023-10-08T12:00:28.718 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.715+0000 7f9b8cff9640 1 -- 172.21.15.62:0/199545098 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ba00b9a70 msgr2=0x7f9ba006f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:28.719 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.715+0000 7f9b8cff9640 1 --2- 172.21.15.62:0/199545098 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ba00b9a70 0x7f9ba006f660 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9b94009790 tx=0x7f9b94005270 comp rx=0 tx=0).stop 2023-10-08T12:00:28.719 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.715+0000 7f9b8cff9640 1 -- 172.21.15.62:0/199545098 shutdown_connections 2023-10-08T12:00:28.719 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.715+0000 7f9b8cff9640 1 --2- 172.21.15.62:0/199545098 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f9b80066470 0x7f9b80068930 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:28.719 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.715+0000 7f9b8cff9640 1 --2- 172.21.15.62:0/199545098 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ba00b9a70 0x7f9ba006f660 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:28.720 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.715+0000 7f9b8cff9640 1 --2- 172.21.15.62:0/199545098 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9ba00b88b0 0x7f9ba01e3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:28.720 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.715+0000 7f9b8cff9640 1 --2- 172.21.15.62:0/199545098 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9ba00b6d40 0x7f9ba0070a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:28.720 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.715+0000 7f9b8cff9640 1 -- 172.21.15.62:0/199545098 >> 172.21.15.62:0/199545098 conn(0x7f9ba009c600 msgr2=0x7f9ba00b72e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:28.721 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.719+0000 7f9b8cff9640 1 -- 172.21.15.62:0/199545098 shutdown_connections 2023-10-08T12:00:28.721 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.719+0000 7f9b8cff9640 1 -- 172.21.15.62:0/199545098 wait complete. 2023-10-08T12:00:28.730 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.727+0000 7fe2c17c6640 1 -- 172.21.15.62:0/4082438370 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fe2bc158a20 con 0x7fe2bc06da00 2023-10-08T12:00:28.731 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.727+0000 7fe2b37fe640 1 -- 172.21.15.62:0/4082438370 <== mon.1 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe2ac0bb090 con 0x7fe2bc06da00 2023-10-08T12:00:28.732 INFO:teuthology.orchestra.run.smithi062.stdout:55834574854 2023-10-08T12:00:28.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.731+0000 7fbcc7fff640 1 -- 172.21.15.62:0/1691978954 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbcc80b1540 con 0x7fbcc813f730 2023-10-08T12:00:28.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.731+0000 7fe2b17fa640 1 -- 172.21.15.62:0/4082438370 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fe29c066470 msgr2=0x7fe29c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:28.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.731+0000 7fe2b17fa640 1 --2- 172.21.15.62:0/4082438370 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fe29c066470 0x7fe29c068930 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe2a4009fd0 tx=0x7fe2a40091e0 comp rx=0 tx=0).stop 2023-10-08T12:00:28.735 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.731+0000 7fe2b17fa640 1 -- 172.21.15.62:0/4082438370 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe2bc06da00 msgr2=0x7fe2bc143860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:28.735 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.731+0000 7fbcaf7fe640 1 -- 172.21.15.62:0/1691978954 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbcc00f4020 con 0x7fbcc813f730 2023-10-08T12:00:28.735 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.731+0000 7fe2b17fa640 1 --2- 172.21.15.62:0/4082438370 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe2bc06da00 0x7fe2bc143860 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac009790 tx=0x7fe2ac0a5580 comp rx=0 tx=0).stop 2023-10-08T12:00:28.736 INFO:teuthology.orchestra.run.smithi062.stdout:55834574855 2023-10-08T12:00:28.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.731+0000 7fe2b17fa640 1 -- 172.21.15.62:0/4082438370 shutdown_connections 2023-10-08T12:00:28.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.731+0000 7fe2b17fa640 1 --2- 172.21.15.62:0/4082438370 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fe29c066470 0x7fe29c068930 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:28.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.731+0000 7fe2b17fa640 1 --2- 172.21.15.62:0/4082438370 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe2bc14ae70 0x7fe2bc099060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:28.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.731+0000 7fe2b17fa640 1 --2- 172.21.15.62:0/4082438370 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe2bc06da00 0x7fe2bc143860 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:28.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.731+0000 7fe2b17fa640 1 --2- 172.21.15.62:0/4082438370 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2bc06cd10 0x7fe2bc0a1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:28.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.731+0000 7fe2b17fa640 1 -- 172.21.15.62:0/4082438370 >> 172.21.15.62:0/4082438370 conn(0x7fe2bc09e620 msgr2=0x7fe2bc06a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:28.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.731+0000 7fe2b17fa640 1 -- 172.21.15.62:0/4082438370 shutdown_connections 2023-10-08T12:00:28.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.731+0000 7fe2b17fa640 1 -- 172.21.15.62:0/4082438370 wait complete. 2023-10-08T12:00:28.738 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.735+0000 7fbcad7fa640 1 -- 172.21.15.62:0/1691978954 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fbcb4066470 msgr2=0x7fbcb4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:28.738 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.735+0000 7fbcad7fa640 1 --2- 172.21.15.62:0/1691978954 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fbcb4066470 0x7fbcb4068930 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbcb8005fd0 tx=0x7fbcb8007040 comp rx=0 tx=0).stop 2023-10-08T12:00:28.739 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.735+0000 7fbcad7fa640 1 -- 172.21.15.62:0/1691978954 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbcc813f730 msgr2=0x7fbcc81e6d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:28.739 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.735+0000 7fbcad7fa640 1 --2- 172.21.15.62:0/1691978954 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbcc813f730 0x7fbcc81e6d40 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fbcc001f910 tx=0x7fbcc00017c0 comp rx=0 tx=0).stop 2023-10-08T12:00:28.739 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.735+0000 7fbcad7fa640 1 -- 172.21.15.62:0/1691978954 shutdown_connections 2023-10-08T12:00:28.739 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.735+0000 7fbcad7fa640 1 --2- 172.21.15.62:0/1691978954 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fbcb4066470 0x7fbcb4068930 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:28.739 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.735+0000 7fbcad7fa640 1 --2- 172.21.15.62:0/1691978954 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbcc813feb0 0x7fbcc8140330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:28.739 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.735+0000 7fbcad7fa640 1 --2- 172.21.15.62:0/1691978954 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbcc813f730 0x7fbcc81e6d40 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:28.739 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.735+0000 7fbcad7fa640 1 --2- 172.21.15.62:0/1691978954 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbcb00047d0 0x7fbcc8140d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:28.739 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.735+0000 7fbcad7fa640 1 -- 172.21.15.62:0/1691978954 >> 172.21.15.62:0/1691978954 conn(0x7fbcc80b8420 msgr2=0x7fbcc80b8830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:28.739 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.735+0000 7fbcad7fa640 1 -- 172.21.15.62:0/1691978954 shutdown_connections 2023-10-08T12:00:28.739 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.735+0000 7fbcad7fa640 1 -- 172.21.15.62:0/1691978954 wait complete. 2023-10-08T12:00:28.740 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2023-10-08T12:00:28.740 DEBUG:teuthology.parallel:result is None 2023-10-08T12:00:28.749 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.0 2023-10-08T12:00:28.750 DEBUG:teuthology.parallel:result is None 2023-10-08T12:00:28.758 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.3 2023-10-08T12:00:28.758 DEBUG:teuthology.parallel:result is None 2023-10-08T12:00:28.763 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.6 2023-10-08T12:00:28.763 DEBUG:teuthology.parallel:result is None 2023-10-08T12:00:28.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.763+0000 7f44d3fff640 1 -- 172.21.15.62:0/763027512 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f44d406e430 con 0x7f44d4098e50 2023-10-08T12:00:28.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.763+0000 7f44bb7fe640 1 -- 172.21.15.62:0/763027512 <== mon.2 v2:172.21.15.130:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f44d406e430 con 0x7f44d4098e50 2023-10-08T12:00:28.768 INFO:teuthology.orchestra.run.smithi062.stdout:55834574855 2023-10-08T12:00:28.770 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.767+0000 7f44d3fff640 1 -- 172.21.15.62:0/763027512 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f44c00664a0 msgr2=0x7f44c0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:28.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.767+0000 7f44d3fff640 1 --2- 172.21.15.62:0/763027512 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f44c00664a0 0x7f44c0068960 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f44d41e0710 tx=0x7f44c80091e0 comp rx=0 tx=0).stop 2023-10-08T12:00:28.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.767+0000 7f44d3fff640 1 -- 172.21.15.62:0/763027512 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f44d4098e50 msgr2=0x7f44d4143c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:28.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.767+0000 7f44d3fff640 1 --2- 172.21.15.62:0/763027512 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f44d4098e50 0x7f44d4143c90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f44cc00c7b0 tx=0x7f44cc00cc70 comp rx=0 tx=0).stop 2023-10-08T12:00:28.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.767+0000 7f44d3fff640 1 -- 172.21.15.62:0/763027512 shutdown_connections 2023-10-08T12:00:28.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.767+0000 7f44d3fff640 1 --2- 172.21.15.62:0/763027512 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f44c00664a0 0x7f44c0068960 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:28.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.767+0000 7f44d3fff640 1 --2- 172.21.15.62:0/763027512 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f44d4140d80 0x7f44d4141340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:28.772 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.767+0000 7f44d3fff640 1 --2- 172.21.15.62:0/763027512 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f44d41e2b50 0x7f44d4140840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:28.772 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.767+0000 7f44d3fff640 1 --2- 172.21.15.62:0/763027512 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f44d4098e50 0x7f44d4143c90 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:28.772 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.767+0000 7f44d3fff640 1 -- 172.21.15.62:0/763027512 >> 172.21.15.62:0/763027512 conn(0x7f44d409c600 msgr2=0x7f44d409e290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:28.772 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.767+0000 7f44d3fff640 1 -- 172.21.15.62:0/763027512 shutdown_connections 2023-10-08T12:00:28.772 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.767+0000 7f44d3fff640 1 -- 172.21.15.62:0/763027512 wait complete. 2023-10-08T12:00:28.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.767+0000 7f2c4dec9640 1 -- 172.21.15.62:0/1121950886 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f2c48070ec0 con 0x7f2c38005190 2023-10-08T12:00:28.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.767+0000 7f2c457fa640 1 -- 172.21.15.62:0/1121950886 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2c34051be0 con 0x7f2c38005190 2023-10-08T12:00:28.773 INFO:teuthology.orchestra.run.smithi062.stdout:55834574856 2023-10-08T12:00:28.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.771+0000 7f2c4dec9640 1 -- 172.21.15.62:0/1121950886 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f2c3806a510 msgr2=0x7f2c3806c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:28.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.771+0000 7f2c4dec9640 1 --2- 172.21.15.62:0/1121950886 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f2c3806a510 0x7f2c3806c9d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2c4806ca50 tx=0x7f2c3c0017b0 comp rx=0 tx=0).stop 2023-10-08T12:00:28.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.771+0000 7f2c4dec9640 1 -- 172.21.15.62:0/1121950886 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2c38005190 msgr2=0x7f2c481ebb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:28.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.771+0000 7f2c4dec9640 1 --2- 172.21.15.62:0/1121950886 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2c38005190 0x7f2c481ebb20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2c3400c950 tx=0x7f2c3400ce10 comp rx=0 tx=0).stop 2023-10-08T12:00:28.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.771+0000 7f2c4dec9640 1 -- 172.21.15.62:0/1121950886 shutdown_connections 2023-10-08T12:00:28.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.771+0000 7f2c4dec9640 1 --2- 172.21.15.62:0/1121950886 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f2c3806a510 0x7f2c3806c9d0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:28.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.771+0000 7f2c4dec9640 1 --2- 172.21.15.62:0/1121950886 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2c481e5cb0 0x7f2c4809e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:28.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.771+0000 7f2c4dec9640 1 --2- 172.21.15.62:0/1121950886 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2c481ef390 0x7f2c481ef810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:28.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.771+0000 7f2c4dec9640 1 --2- 172.21.15.62:0/1121950886 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2c38005190 0x7f2c481ebb20 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:28.776 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.771+0000 7f2c4dec9640 1 -- 172.21.15.62:0/1121950886 >> 172.21.15.62:0/1121950886 conn(0x7f2c480b95a0 msgr2=0x7f2c480b9980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:28.776 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.771+0000 7f2c4dec9640 1 -- 172.21.15.62:0/1121950886 shutdown_connections 2023-10-08T12:00:28.776 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.771+0000 7f2c4dec9640 1 -- 172.21.15.62:0/1121950886 wait complete. 2023-10-08T12:00:28.776 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.771+0000 7fd24f7fe640 1 -- 172.21.15.62:0/3219249381 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd244005510 con 0x7fd264097a70 2023-10-08T12:00:28.777 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.771+0000 7fd259ffb640 1 -- 172.21.15.62:0/3219249381 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd25c019030 con 0x7fd264097a70 2023-10-08T12:00:28.777 INFO:teuthology.orchestra.run.smithi062.stdout:55834574855 2023-10-08T12:00:28.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.775+0000 7fd24f7fe640 1 -- 172.21.15.62:0/3219249381 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fd2480665c0 msgr2=0x7fd248068a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:28.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.775+0000 7fd24f7fe640 1 --2- 172.21.15.62:0/3219249381 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fd2480665c0 0x7fd248068a80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd2600af000 tx=0x7fd26001b100 comp rx=0 tx=0).stop 2023-10-08T12:00:28.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.775+0000 7fd24f7fe640 1 -- 172.21.15.62:0/3219249381 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd264097a70 msgr2=0x7fd26414e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:28.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.775+0000 7fd24f7fe640 1 --2- 172.21.15.62:0/3219249381 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd264097a70 0x7fd26414e5d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd25c00ba80 tx=0x7fd25c00bf40 comp rx=0 tx=0).stop 2023-10-08T12:00:28.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.775+0000 7fd24f7fe640 1 -- 172.21.15.62:0/3219249381 shutdown_connections 2023-10-08T12:00:28.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.775+0000 7fd24f7fe640 1 --2- 172.21.15.62:0/3219249381 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fd2480665c0 0x7fd248068a80 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:28.779 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.775+0000 7fd24f7fe640 1 --2- 172.21.15.62:0/3219249381 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd2640b7460 0x7fd26409f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:28.779 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.775+0000 7fd24f7fe640 1 --2- 172.21.15.62:0/3219249381 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd2640b6c60 0x7fd26414f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:28.779 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.775+0000 7fd24f7fe640 1 --2- 172.21.15.62:0/3219249381 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd264097a70 0x7fd26414e5d0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:28.779 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.775+0000 7fd24f7fe640 1 -- 172.21.15.62:0/3219249381 >> 172.21.15.62:0/3219249381 conn(0x7fd2640ba770 msgr2=0x7fd26409b610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:28.779 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.775+0000 7fd24f7fe640 1 -- 172.21.15.62:0/3219249381 shutdown_connections 2023-10-08T12:00:28.779 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.775+0000 7fd24f7fe640 1 -- 172.21.15.62:0/3219249381 wait complete. 2023-10-08T12:00:28.785 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.779+0000 7f5073fff640 1 -- 172.21.15.62:0/4149776000 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f50540057e0 con 0x7f506c03f370 2023-10-08T12:00:28.785 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.783+0000 7f505b7fe640 1 -- 172.21.15.62:0/4149776000 <== mon.1 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5068051da0 con 0x7f506c03f370 2023-10-08T12:00:28.786 INFO:teuthology.orchestra.run.smithi062.stdout:55834574854 2023-10-08T12:00:28.789 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.783+0000 7f5073fff640 1 -- 172.21.15.62:0/4149776000 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f5060066470 msgr2=0x7f5060068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:28.789 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.783+0000 7f5073fff640 1 --2- 172.21.15.62:0/4149776000 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f5060066470 0x7f5060068930 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f50640af000 tx=0x7f5064019680 comp rx=0 tx=0).stop 2023-10-08T12:00:28.789 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.783+0000 7f5073fff640 1 -- 172.21.15.62:0/4149776000 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f506c03f370 msgr2=0x7f506c0c8320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:28.789 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.783+0000 7f5073fff640 1 --2- 172.21.15.62:0/4149776000 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f506c03f370 0x7f506c0c8320 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f506800e9f0 tx=0x7f506800edf0 comp rx=0 tx=0).stop 2023-10-08T12:00:28.790 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.783+0000 7f5073fff640 1 -- 172.21.15.62:0/4149776000 shutdown_connections 2023-10-08T12:00:28.790 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.783+0000 7f5073fff640 1 --2- 172.21.15.62:0/4149776000 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f5060066470 0x7f5060068930 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:28.790 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.783+0000 7f5073fff640 1 --2- 172.21.15.62:0/4149776000 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f506c0d13e0 0x7f506c0c8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:28.790 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.783+0000 7f5073fff640 1 --2- 172.21.15.62:0/4149776000 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f506c03f370 0x7f506c0c8320 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:28.790 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.783+0000 7f5073fff640 1 --2- 172.21.15.62:0/4149776000 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f506c03cdc0 0x7f506c0288b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:28.790 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.783+0000 7f5073fff640 1 -- 172.21.15.62:0/4149776000 >> 172.21.15.62:0/4149776000 conn(0x7f506c00a520 msgr2=0x7f506c0cc9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:28.790 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.783+0000 7f5073fff640 1 -- 172.21.15.62:0/4149776000 shutdown_connections 2023-10-08T12:00:28.790 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.783+0000 7f5073fff640 1 -- 172.21.15.62:0/4149776000 wait complete. 2023-10-08T12:00:28.791 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.2 2023-10-08T12:00:28.791 DEBUG:teuthology.parallel:result is None 2023-10-08T12:00:28.797 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.1 2023-10-08T12:00:28.797 DEBUG:teuthology.parallel:result is None 2023-10-08T12:00:28.803 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.7 2023-10-08T12:00:28.803 DEBUG:teuthology.parallel:result is None 2023-10-08T12:00:28.810 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2023-10-08T12:00:28.810 DEBUG:teuthology.parallel:result is None 2023-10-08T12:00:28.810 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-08T12:00:28.811 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T12:00:28.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.959+0000 7efe91fc7640 1 -- 172.21.15.62:0/1110441764 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe8c0718c0 msgr2=0x7efe8c0b5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:28.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.959+0000 7efe91fc7640 1 --2- 172.21.15.62:0/1110441764 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe8c0718c0 0x7efe8c0b5170 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7efe8c071fb0 tx=0x7efe7401c860 comp rx=0 tx=0).stop 2023-10-08T12:00:28.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.959+0000 7efe91fc7640 1 -- 172.21.15.62:0/1110441764 shutdown_connections 2023-10-08T12:00:28.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.959+0000 7efe91fc7640 1 --2- 172.21.15.62:0/1110441764 >> v2:172.21.15.130:3300/0 conn(0x7efe8c0b6a60 0x7efe8c14a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:28.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.959+0000 7efe91fc7640 1 --2- 172.21.15.62:0/1110441764 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe8c0718c0 0x7efe8c0b5170 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:28.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.959+0000 7efe91fc7640 1 -- 172.21.15.62:0/1110441764 >> 172.21.15.62:0/1110441764 conn(0x7efe8c09c520 msgr2=0x7efe8c09c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:28.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.959+0000 7efe91fc7640 1 -- 172.21.15.62:0/1110441764 shutdown_connections 2023-10-08T12:00:28.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.959+0000 7efe91fc7640 1 -- 172.21.15.62:0/1110441764 wait complete. 2023-10-08T12:00:28.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.963+0000 7efe91fc7640 1 Processor -- start 2023-10-08T12:00:28.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.963+0000 7efe91fc7640 1 -- start start 2023-10-08T12:00:28.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.963+0000 7efe91fc7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efe8c0718c0 0x7efe8c06e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:28.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.963+0000 7efe91fc7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe8c0b6a60 0x7efe8c143b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:28.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.963+0000 7efe91fc7640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efe8c14a790 0x7efe8c135480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:28.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.963+0000 7efe91fc7640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe8c06f180 con 0x7efe8c0b6a60 2023-10-08T12:00:28.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.963+0000 7efe91fc7640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe8c1e3c60 con 0x7efe8c0718c0 2023-10-08T12:00:28.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.963+0000 7efe91fc7640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe8c1e3f40 con 0x7efe8c14a790 2023-10-08T12:00:28.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.963+0000 7efe8affd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe8c0b6a60 0x7efe8c143b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:28.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.963+0000 7efe8affd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe8c0b6a60 0x7efe8c143b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43968/0 (socket says 172.21.15.62:43968) 2023-10-08T12:00:28.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.963+0000 7efe8affd640 1 -- 172.21.15.62:0/976320500 learned_addr learned my addr 172.21.15.62:0/976320500 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:28.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.963+0000 7efe8b7fe640 1 --2- 172.21.15.62:0/976320500 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efe8c0718c0 0x7efe8c06e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:28.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.963+0000 7efe8bfff640 1 --2- 172.21.15.62:0/976320500 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efe8c14a790 0x7efe8c135480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:28.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.963+0000 7efe8affd640 1 -- 172.21.15.62:0/976320500 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efe8c14a790 msgr2=0x7efe8c135480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:28.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.963+0000 7efe8affd640 1 --2- 172.21.15.62:0/976320500 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efe8c14a790 0x7efe8c135480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:28.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.963+0000 7efe8affd640 1 -- 172.21.15.62:0/976320500 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efe8c0718c0 msgr2=0x7efe8c06e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:28.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.963+0000 7efe8affd640 1 --2- 172.21.15.62:0/976320500 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efe8c0718c0 0x7efe8c06e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:28.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.963+0000 7efe8affd640 1 -- 172.21.15.62:0/976320500 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe74009560 con 0x7efe8c0b6a60 2023-10-08T12:00:28.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.963+0000 7efe8bfff640 1 --2- 172.21.15.62:0/976320500 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efe8c14a790 0x7efe8c135480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:00:28.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.963+0000 7efe8b7fe640 1 --2- 172.21.15.62:0/976320500 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efe8c0718c0 0x7efe8c06e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:00:28.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.963+0000 7efe8affd640 1 --2- 172.21.15.62:0/976320500 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe8c0b6a60 0x7efe8c143b50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7efe7c00b550 tx=0x7efe7c00ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:28.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.963+0000 7efe83fff640 1 -- 172.21.15.62:0/976320500 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7c010870 con 0x7efe8c0b6a60 2023-10-08T12:00:28.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.963+0000 7efe83fff640 1 -- 172.21.15.62:0/976320500 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7efe7c010ae0 con 0x7efe8c0b6a60 2023-10-08T12:00:28.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.963+0000 7efe91fc7640 1 -- 172.21.15.62:0/976320500 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe8c1e4220 con 0x7efe8c0b6a60 2023-10-08T12:00:28.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.963+0000 7efe83fff640 1 -- 172.21.15.62:0/976320500 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7c00f3c0 con 0x7efe8c0b6a60 2023-10-08T12:00:28.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.963+0000 7efe91fc7640 1 -- 172.21.15.62:0/976320500 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe8c099eb0 con 0x7efe8c0b6a60 2023-10-08T12:00:28.970 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.963+0000 7efe91fc7640 1 -- 172.21.15.62:0/976320500 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe8c04da80 con 0x7efe8c0b6a60 2023-10-08T12:00:28.970 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.963+0000 7efe83fff640 1 -- 172.21.15.62:0/976320500 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7efe7c00f520 con 0x7efe8c0b6a60 2023-10-08T12:00:28.970 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.963+0000 7efe83fff640 1 --2- 172.21.15.62:0/976320500 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7efe6c066470 0x7efe6c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:28.971 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.963+0000 7efe83fff640 1 -- 172.21.15.62:0/976320500 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efe7c0840d0 con 0x7efe8c0b6a60 2023-10-08T12:00:28.971 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.963+0000 7efe8b7fe640 1 --2- 172.21.15.62:0/976320500 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7efe6c066470 0x7efe6c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:28.971 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.967+0000 7efe8b7fe640 1 --2- 172.21.15.62:0/976320500 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7efe6c066470 0x7efe6c068930 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7efe740af000 tx=0x7efe7401b0a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:28.973 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:28.967+0000 7efe83fff640 1 -- 172.21.15.62:0/976320500 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7efe7c0515e0 con 0x7efe8c0b6a60 2023-10-08T12:00:29.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.115+0000 7efe91fc7640 1 -- 172.21.15.62:0/976320500 --> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efe8c09d260 con 0x7efe6c066470 2023-10-08T12:00:29.139 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.139+0000 7efe83fff640 1 -- 172.21.15.62:0/976320500 <== mgr.4111 v2:172.21.15.130:6832/826384843 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264495 (secure 0 0 0) 0x7efe8c09d260 con 0x7efe6c066470 2023-10-08T12:00:29.141 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T12:00:29.143 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2023-10-08T12:00:29.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.139+0000 7efe91fc7640 1 -- 172.21.15.62:0/976320500 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7efe6c066470 msgr2=0x7efe6c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:29.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.139+0000 7efe91fc7640 1 --2- 172.21.15.62:0/976320500 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7efe6c066470 0x7efe6c068930 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7efe740af000 tx=0x7efe7401b0a0 comp rx=0 tx=0).stop 2023-10-08T12:00:29.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.139+0000 7efe91fc7640 1 -- 172.21.15.62:0/976320500 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe8c0b6a60 msgr2=0x7efe8c143b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:29.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.139+0000 7efe91fc7640 1 --2- 172.21.15.62:0/976320500 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe8c0b6a60 0x7efe8c143b50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7efe7c00b550 tx=0x7efe7c00ba10 comp rx=0 tx=0).stop 2023-10-08T12:00:29.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.139+0000 7efe91fc7640 1 -- 172.21.15.62:0/976320500 shutdown_connections 2023-10-08T12:00:29.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.139+0000 7efe91fc7640 1 --2- 172.21.15.62:0/976320500 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7efe6c066470 0x7efe6c068930 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:29.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.139+0000 7efe91fc7640 1 --2- 172.21.15.62:0/976320500 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efe8c14a790 0x7efe8c135480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:29.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.139+0000 7efe91fc7640 1 --2- 172.21.15.62:0/976320500 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe8c0b6a60 0x7efe8c143b50 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:29.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.139+0000 7efe91fc7640 1 --2- 172.21.15.62:0/976320500 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efe8c0718c0 0x7efe8c06e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:29.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.139+0000 7efe91fc7640 1 -- 172.21.15.62:0/976320500 >> 172.21.15.62:0/976320500 conn(0x7efe8c09c520 msgr2=0x7efe8c149290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:29.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.139+0000 7efe91fc7640 1 -- 172.21.15.62:0/976320500 shutdown_connections 2023-10-08T12:00:29.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.139+0000 7efe91fc7640 1 -- 172.21.15.62:0/976320500 wait complete. 2023-10-08T12:00:29.158 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-10-08T12:00:29.113920+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219036,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755684,"statfs":{"total":773094113280,"available":772869820416,"internally_reserved":0,"allocated":2891776,"data_stored":1752740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.555992"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.632466+0000","last_change":"2023-10-08T12:00:20.627789+0000","last_active":"2023-10-08T12:00:21.632466+0000","last_peered":"2023-10-08T12:00:21.632466+0000","last_clean":"2023-10-08T12:00:21.632466+0000","last_became_active":"2023-10-08T12:00:20.624907+0000","last_became_peered":"2023-10-08T12:00:20.624907+0000","last_unstale":"2023-10-08T12:00:21.632466+0000","last_undegraded":"2023-10-08T12:00:21.632466+0000","last_fullsized":"2023-10-08T12:00:21.632466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:43:35.534698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.598994+0000","last_change":"2023-10-08T12:00:20.600909+0000","last_active":"2023-10-08T12:00:21.598994+0000","last_peered":"2023-10-08T12:00:21.598994+0000","last_clean":"2023-10-08T12:00:21.598994+0000","last_became_active":"2023-10-08T12:00:20.600498+0000","last_became_peered":"2023-10-08T12:00:20.600498+0000","last_unstale":"2023-10-08T12:00:21.598994+0000","last_undegraded":"2023-10-08T12:00:21.598994+0000","last_fullsized":"2023-10-08T12:00:21.598994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:54:07.447661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855469+0000","last_change":"2023-10-08T12:00:20.591739+0000","last_active":"2023-10-08T12:00:21.855469+0000","last_peered":"2023-10-08T12:00:21.855469+0000","last_clean":"2023-10-08T12:00:21.855469+0000","last_became_active":"2023-10-08T12:00:20.591277+0000","last_became_peered":"2023-10-08T12:00:20.591277+0000","last_unstale":"2023-10-08T12:00:21.855469+0000","last_undegraded":"2023-10-08T12:00:21.855469+0000","last_fullsized":"2023-10-08T12:00:21.855469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:54:25.498802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.602411+0000","last_change":"2023-10-08T12:00:20.595788+0000","last_active":"2023-10-08T12:00:21.602411+0000","last_peered":"2023-10-08T12:00:21.602411+0000","last_clean":"2023-10-08T12:00:21.602411+0000","last_became_active":"2023-10-08T12:00:20.595025+0000","last_became_peered":"2023-10-08T12:00:20.595025+0000","last_unstale":"2023-10-08T12:00:21.602411+0000","last_undegraded":"2023-10-08T12:00:21.602411+0000","last_fullsized":"2023-10-08T12:00:21.602411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:17:42.290460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.631819+0000","last_change":"2023-10-08T12:00:20.625363+0000","last_active":"2023-10-08T12:00:21.631819+0000","last_peered":"2023-10-08T12:00:21.631819+0000","last_clean":"2023-10-08T12:00:21.631819+0000","last_became_active":"2023-10-08T12:00:20.623270+0000","last_became_peered":"2023-10-08T12:00:20.623270+0000","last_unstale":"2023-10-08T12:00:21.631819+0000","last_undegraded":"2023-10-08T12:00:21.631819+0000","last_fullsized":"2023-10-08T12:00:21.631819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:53:47.853039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.602599+0000","last_change":"2023-10-08T12:00:20.600868+0000","last_active":"2023-10-08T12:00:21.602599+0000","last_peered":"2023-10-08T12:00:21.602599+0000","last_clean":"2023-10-08T12:00:21.602599+0000","last_became_active":"2023-10-08T12:00:20.600160+0000","last_became_peered":"2023-10-08T12:00:20.600160+0000","last_unstale":"2023-10-08T12:00:21.602599+0000","last_undegraded":"2023-10-08T12:00:21.602599+0000","last_fullsized":"2023-10-08T12:00:21.602599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:57:40.359987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.631537+0000","last_change":"2023-10-08T12:00:20.625181+0000","last_active":"2023-10-08T12:00:21.631537+0000","last_peered":"2023-10-08T12:00:21.631537+0000","last_clean":"2023-10-08T12:00:21.631537+0000","last_became_active":"2023-10-08T12:00:20.623344+0000","last_became_peered":"2023-10-08T12:00:20.623344+0000","last_unstale":"2023-10-08T12:00:21.631537+0000","last_undegraded":"2023-10-08T12:00:21.631537+0000","last_fullsized":"2023-10-08T12:00:21.631537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:17:42.290460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855227+0000","last_change":"2023-10-08T12:00:20.594960+0000","last_active":"2023-10-08T12:00:21.855227+0000","last_peered":"2023-10-08T12:00:21.855227+0000","last_clean":"2023-10-08T12:00:21.855227+0000","last_became_active":"2023-10-08T12:00:20.594580+0000","last_became_peered":"2023-10-08T12:00:20.594580+0000","last_unstale":"2023-10-08T12:00:21.855227+0000","last_undegraded":"2023-10-08T12:00:21.855227+0000","last_fullsized":"2023-10-08T12:00:21.855227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:10:09.509770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.632479+0000","last_change":"2023-10-08T12:00:20.625978+0000","last_active":"2023-10-08T12:00:21.632479+0000","last_peered":"2023-10-08T12:00:21.632479+0000","last_clean":"2023-10-08T12:00:21.632479+0000","last_became_active":"2023-10-08T12:00:20.624917+0000","last_became_peered":"2023-10-08T12:00:20.624917+0000","last_unstale":"2023-10-08T12:00:21.632479+0000","last_undegraded":"2023-10-08T12:00:21.632479+0000","last_fullsized":"2023-10-08T12:00:21.632479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:11:56.311548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855967+0000","last_change":"2023-10-08T12:00:20.613419+0000","last_active":"2023-10-08T12:00:21.855967+0000","last_peered":"2023-10-08T12:00:21.855967+0000","last_clean":"2023-10-08T12:00:21.855967+0000","last_became_active":"2023-10-08T12:00:20.612588+0000","last_became_peered":"2023-10-08T12:00:20.612588+0000","last_unstale":"2023-10-08T12:00:21.855967+0000","last_undegraded":"2023-10-08T12:00:21.855967+0000","last_fullsized":"2023-10-08T12:00:21.855967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:54:07.447661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855739+0000","last_change":"2023-10-08T12:00:20.614307+0000","last_active":"2023-10-08T12:00:21.855739+0000","last_peered":"2023-10-08T12:00:21.855739+0000","last_clean":"2023-10-08T12:00:21.855739+0000","last_became_active":"2023-10-08T12:00:20.613632+0000","last_became_peered":"2023-10-08T12:00:20.613632+0000","last_unstale":"2023-10-08T12:00:21.855739+0000","last_undegraded":"2023-10-08T12:00:21.855739+0000","last_fullsized":"2023-10-08T12:00:21.855739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:54:25.498802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.602167+0000","last_change":"2023-10-08T12:00:20.615632+0000","last_active":"2023-10-08T12:00:21.602167+0000","last_peered":"2023-10-08T12:00:21.602167+0000","last_clean":"2023-10-08T12:00:21.602167+0000","last_became_active":"2023-10-08T12:00:20.615011+0000","last_became_peered":"2023-10-08T12:00:20.615011+0000","last_unstale":"2023-10-08T12:00:21.602167+0000","last_undegraded":"2023-10-08T12:00:21.602167+0000","last_fullsized":"2023-10-08T12:00:21.602167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:03:28.440799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.856538+0000","last_change":"2023-10-08T12:00:20.621730+0000","last_active":"2023-10-08T12:00:21.856538+0000","last_peered":"2023-10-08T12:00:21.856538+0000","last_clean":"2023-10-08T12:00:21.856538+0000","last_became_active":"2023-10-08T12:00:20.621145+0000","last_became_peered":"2023-10-08T12:00:20.621145+0000","last_unstale":"2023-10-08T12:00:21.856538+0000","last_undegraded":"2023-10-08T12:00:21.856538+0000","last_fullsized":"2023-10-08T12:00:21.856538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:54:07.447661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.854760+0000","last_change":"2023-10-08T12:00:20.590571+0000","last_active":"2023-10-08T12:00:21.854760+0000","last_peered":"2023-10-08T12:00:21.854760+0000","last_clean":"2023-10-08T12:00:21.854760+0000","last_became_active":"2023-10-08T12:00:20.590216+0000","last_became_peered":"2023-10-08T12:00:20.590216+0000","last_unstale":"2023-10-08T12:00:21.854760+0000","last_undegraded":"2023-10-08T12:00:21.854760+0000","last_fullsized":"2023-10-08T12:00:21.854760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:58:37.629058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.598733+0000","last_change":"2023-10-08T12:00:20.609487+0000","last_active":"2023-10-08T12:00:21.598733+0000","last_peered":"2023-10-08T12:00:21.598733+0000","last_clean":"2023-10-08T12:00:21.598733+0000","last_became_active":"2023-10-08T12:00:20.609198+0000","last_became_peered":"2023-10-08T12:00:20.609198+0000","last_unstale":"2023-10-08T12:00:21.598733+0000","last_undegraded":"2023-10-08T12:00:21.598733+0000","last_fullsized":"2023-10-08T12:00:21.598733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:22:42.527070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.601660+0000","last_change":"2023-10-08T12:00:20.605444+0000","last_active":"2023-10-08T12:00:21.601660+0000","last_peered":"2023-10-08T12:00:21.601660+0000","last_clean":"2023-10-08T12:00:21.601660+0000","last_became_active":"2023-10-08T12:00:20.604696+0000","last_became_peered":"2023-10-08T12:00:20.604696+0000","last_unstale":"2023-10-08T12:00:21.601660+0000","last_undegraded":"2023-10-08T12:00:21.601660+0000","last_fullsized":"2023-10-08T12:00:21.601660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:46:22.522999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.604436+0000","last_change":"2023-10-08T12:00:20.626616+0000","last_active":"2023-10-08T12:00:21.604436+0000","last_peered":"2023-10-08T12:00:21.604436+0000","last_clean":"2023-10-08T12:00:21.604436+0000","last_became_active":"2023-10-08T12:00:20.626042+0000","last_became_peered":"2023-10-08T12:00:20.626042+0000","last_unstale":"2023-10-08T12:00:21.604436+0000","last_undegraded":"2023-10-08T12:00:21.604436+0000","last_fullsized":"2023-10-08T12:00:21.604436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:11:56.311548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.640507+0000","last_change":"2023-10-08T12:00:20.621413+0000","last_active":"2023-10-08T12:00:21.640507+0000","last_peered":"2023-10-08T12:00:21.640507+0000","last_clean":"2023-10-08T12:00:21.640507+0000","last_became_active":"2023-10-08T12:00:20.621169+0000","last_became_peered":"2023-10-08T12:00:20.621169+0000","last_unstale":"2023-10-08T12:00:21.640507+0000","last_undegraded":"2023-10-08T12:00:21.640507+0000","last_fullsized":"2023-10-08T12:00:21.640507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:03:28.440799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.632631+0000","last_change":"2023-10-08T12:00:20.627431+0000","last_active":"2023-10-08T12:00:21.632631+0000","last_peered":"2023-10-08T12:00:21.632631+0000","last_clean":"2023-10-08T12:00:21.632631+0000","last_became_active":"2023-10-08T12:00:20.624730+0000","last_became_peered":"2023-10-08T12:00:20.624730+0000","last_unstale":"2023-10-08T12:00:21.632631+0000","last_undegraded":"2023-10-08T12:00:21.632631+0000","last_fullsized":"2023-10-08T12:00:21.632631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:22:34.137787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855624+0000","last_change":"2023-10-08T12:00:20.620364+0000","last_active":"2023-10-08T12:00:21.855624+0000","last_peered":"2023-10-08T12:00:21.855624+0000","last_clean":"2023-10-08T12:00:21.855624+0000","last_became_active":"2023-10-08T12:00:20.619755+0000","last_became_peered":"2023-10-08T12:00:20.619755+0000","last_unstale":"2023-10-08T12:00:21.855624+0000","last_undegraded":"2023-10-08T12:00:21.855624+0000","last_fullsized":"2023-10-08T12:00:21.855624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:42:54.801760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855087+0000","last_change":"2023-10-08T12:00:20.623340+0000","last_active":"2023-10-08T12:00:21.855087+0000","last_peered":"2023-10-08T12:00:21.855087+0000","last_clean":"2023-10-08T12:00:21.855087+0000","last_became_active":"2023-10-08T12:00:20.623038+0000","last_became_peered":"2023-10-08T12:00:20.623038+0000","last_unstale":"2023-10-08T12:00:21.855087+0000","last_undegraded":"2023-10-08T12:00:21.855087+0000","last_fullsized":"2023-10-08T12:00:21.855087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:06:51.286457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.602856+0000","last_change":"2023-10-08T12:00:20.627019+0000","last_active":"2023-10-08T12:00:21.602856+0000","last_peered":"2023-10-08T12:00:21.602856+0000","last_clean":"2023-10-08T12:00:21.602856+0000","last_became_active":"2023-10-08T12:00:20.626509+0000","last_became_peered":"2023-10-08T12:00:20.626509+0000","last_unstale":"2023-10-08T12:00:21.602856+0000","last_undegraded":"2023-10-08T12:00:21.602856+0000","last_fullsized":"2023-10-08T12:00:21.602856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:30:47.199431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.856085+0000","last_change":"2023-10-08T12:00:20.608919+0000","last_active":"2023-10-08T12:00:21.856085+0000","last_peered":"2023-10-08T12:00:21.856085+0000","last_clean":"2023-10-08T12:00:21.856085+0000","last_became_active":"2023-10-08T12:00:20.608477+0000","last_became_peered":"2023-10-08T12:00:20.608477+0000","last_unstale":"2023-10-08T12:00:21.856085+0000","last_undegraded":"2023-10-08T12:00:21.856085+0000","last_fullsized":"2023-10-08T12:00:21.856085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:42:54.801760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.601997+0000","last_change":"2023-10-08T12:00:20.590431+0000","last_active":"2023-10-08T12:00:21.601997+0000","last_peered":"2023-10-08T12:00:21.601997+0000","last_clean":"2023-10-08T12:00:21.601997+0000","last_became_active":"2023-10-08T12:00:20.589585+0000","last_became_peered":"2023-10-08T12:00:20.589585+0000","last_unstale":"2023-10-08T12:00:21.601997+0000","last_undegraded":"2023-10-08T12:00:21.601997+0000","last_fullsized":"2023-10-08T12:00:21.601997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:55:19.542748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.856733+0000","last_change":"2023-10-08T12:00:20.603260+0000","last_active":"2023-10-08T12:00:21.856733+0000","last_peered":"2023-10-08T12:00:21.856733+0000","last_clean":"2023-10-08T12:00:21.856733+0000","last_became_active":"2023-10-08T12:00:20.602872+0000","last_became_peered":"2023-10-08T12:00:20.602872+0000","last_unstale":"2023-10-08T12:00:21.856733+0000","last_undegraded":"2023-10-08T12:00:21.856733+0000","last_fullsized":"2023-10-08T12:00:21.856733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:17:42.290460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.856070+0000","last_change":"2023-10-08T12:00:20.624667+0000","last_active":"2023-10-08T12:00:21.856070+0000","last_peered":"2023-10-08T12:00:21.856070+0000","last_clean":"2023-10-08T12:00:21.856070+0000","last_became_active":"2023-10-08T12:00:20.624080+0000","last_became_peered":"2023-10-08T12:00:20.624080+0000","last_unstale":"2023-10-08T12:00:21.856070+0000","last_undegraded":"2023-10-08T12:00:21.856070+0000","last_fullsized":"2023-10-08T12:00:21.856070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:46:22.522999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.599492+0000","last_change":"2023-10-08T12:00:20.606784+0000","last_active":"2023-10-08T12:00:21.599492+0000","last_peered":"2023-10-08T12:00:21.599492+0000","last_clean":"2023-10-08T12:00:21.599492+0000","last_became_active":"2023-10-08T12:00:20.606415+0000","last_became_peered":"2023-10-08T12:00:20.606415+0000","last_unstale":"2023-10-08T12:00:21.599492+0000","last_undegraded":"2023-10-08T12:00:21.599492+0000","last_fullsized":"2023-10-08T12:00:21.599492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:55:19.542748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.856912+0000","last_change":"2023-10-08T12:00:20.619158+0000","last_active":"2023-10-08T12:00:21.856912+0000","last_peered":"2023-10-08T12:00:21.856912+0000","last_clean":"2023-10-08T12:00:21.856912+0000","last_became_active":"2023-10-08T12:00:20.618857+0000","last_became_peered":"2023-10-08T12:00:20.618857+0000","last_unstale":"2023-10-08T12:00:21.856912+0000","last_undegraded":"2023-10-08T12:00:21.856912+0000","last_fullsized":"2023-10-08T12:00:21.856912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:57:40.359987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855238+0000","last_change":"2023-10-08T12:00:20.601375+0000","last_active":"2023-10-08T12:00:21.855238+0000","last_peered":"2023-10-08T12:00:21.855238+0000","last_clean":"2023-10-08T12:00:21.855238+0000","last_became_active":"2023-10-08T12:00:20.600980+0000","last_became_peered":"2023-10-08T12:00:20.600980+0000","last_unstale":"2023-10-08T12:00:21.855238+0000","last_undegraded":"2023-10-08T12:00:21.855238+0000","last_fullsized":"2023-10-08T12:00:21.855238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:30:14.921064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.603029+0000","last_change":"2023-10-08T12:00:20.608122+0000","last_active":"2023-10-08T12:00:21.603029+0000","last_peered":"2023-10-08T12:00:21.603029+0000","last_clean":"2023-10-08T12:00:21.603029+0000","last_became_active":"2023-10-08T12:00:20.603444+0000","last_became_peered":"2023-10-08T12:00:20.603444+0000","last_unstale":"2023-10-08T12:00:21.603029+0000","last_undegraded":"2023-10-08T12:00:21.603029+0000","last_fullsized":"2023-10-08T12:00:21.603029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:42:51.152070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.640418+0000","last_change":"2023-10-08T12:00:20.604312+0000","last_active":"2023-10-08T12:00:21.640418+0000","last_peered":"2023-10-08T12:00:21.640418+0000","last_clean":"2023-10-08T12:00:21.640418+0000","last_became_active":"2023-10-08T12:00:20.603285+0000","last_became_peered":"2023-10-08T12:00:20.603285+0000","last_unstale":"2023-10-08T12:00:21.640418+0000","last_undegraded":"2023-10-08T12:00:21.640418+0000","last_fullsized":"2023-10-08T12:00:21.640418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:27:04.539065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855353+0000","last_change":"2023-10-08T12:00:20.604806+0000","last_active":"2023-10-08T12:00:21.855353+0000","last_peered":"2023-10-08T12:00:21.855353+0000","last_clean":"2023-10-08T12:00:21.855353+0000","last_became_active":"2023-10-08T12:00:20.602679+0000","last_became_peered":"2023-10-08T12:00:20.602679+0000","last_unstale":"2023-10-08T12:00:21.855353+0000","last_undegraded":"2023-10-08T12:00:21.855353+0000","last_fullsized":"2023-10-08T12:00:21.855353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:10:09.509770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.601550+0000","last_change":"2023-10-08T12:00:20.587095+0000","last_active":"2023-10-08T12:00:21.601550+0000","last_peered":"2023-10-08T12:00:21.601550+0000","last_clean":"2023-10-08T12:00:21.601550+0000","last_became_active":"2023-10-08T12:00:20.586374+0000","last_became_peered":"2023-10-08T12:00:20.586374+0000","last_unstale":"2023-10-08T12:00:21.601550+0000","last_undegraded":"2023-10-08T12:00:21.601550+0000","last_fullsized":"2023-10-08T12:00:21.601550+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:37:45.357564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.856807+0000","last_change":"2023-10-08T12:00:19.547119+0000","last_active":"2023-10-08T12:00:21.856807+0000","last_peered":"2023-10-08T12:00:21.856807+0000","last_clean":"2023-10-08T12:00:21.856807+0000","last_became_active":"2023-10-08T12:00:19.546721+0000","last_became_peered":"2023-10-08T12:00:19.546721+0000","last_unstale":"2023-10-08T12:00:21.856807+0000","last_undegraded":"2023-10-08T12:00:21.856807+0000","last_fullsized":"2023-10-08T12:00:21.856807+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:58:36.625035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855308+0000","last_change":"2023-10-08T12:00:20.587928+0000","last_active":"2023-10-08T12:00:21.855308+0000","last_peered":"2023-10-08T12:00:21.855308+0000","last_clean":"2023-10-08T12:00:21.855308+0000","last_became_active":"2023-10-08T12:00:20.587195+0000","last_became_peered":"2023-10-08T12:00:20.587195+0000","last_unstale":"2023-10-08T12:00:21.855308+0000","last_undegraded":"2023-10-08T12:00:21.855308+0000","last_fullsized":"2023-10-08T12:00:21.855308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:22:42.527070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855483+0000","last_change":"2023-10-08T12:00:19.544794+0000","last_active":"2023-10-08T12:00:21.855483+0000","last_peered":"2023-10-08T12:00:21.855483+0000","last_clean":"2023-10-08T12:00:21.855483+0000","last_became_active":"2023-10-08T12:00:19.544159+0000","last_became_peered":"2023-10-08T12:00:19.544159+0000","last_unstale":"2023-10-08T12:00:21.855483+0000","last_undegraded":"2023-10-08T12:00:21.855483+0000","last_fullsized":"2023-10-08T12:00:21.855483+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:03:27.436776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.856316+0000","last_change":"2023-10-08T12:00:19.533572+0000","last_active":"2023-10-08T12:00:21.856316+0000","last_peered":"2023-10-08T12:00:21.856316+0000","last_clean":"2023-10-08T12:00:21.856316+0000","last_became_active":"2023-10-08T12:00:19.533122+0000","last_became_peered":"2023-10-08T12:00:19.533122+0000","last_unstale":"2023-10-08T12:00:21.856316+0000","last_undegraded":"2023-10-08T12:00:21.856316+0000","last_fullsized":"2023-10-08T12:00:21.856316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:45:15.530667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855898+0000","last_change":"2023-10-08T12:00:20.600857+0000","last_active":"2023-10-08T12:00:21.855898+0000","last_peered":"2023-10-08T12:00:21.855898+0000","last_clean":"2023-10-08T12:00:21.855898+0000","last_became_active":"2023-10-08T12:00:20.600486+0000","last_became_peered":"2023-10-08T12:00:20.600486+0000","last_unstale":"2023-10-08T12:00:21.855898+0000","last_undegraded":"2023-10-08T12:00:21.855898+0000","last_fullsized":"2023-10-08T12:00:21.855898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:30:14.921064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.602215+0000","last_change":"2023-10-08T12:00:19.537352+0000","last_active":"2023-10-08T12:00:21.602215+0000","last_peered":"2023-10-08T12:00:21.602215+0000","last_clean":"2023-10-08T12:00:21.602215+0000","last_became_active":"2023-10-08T12:00:19.536451+0000","last_became_peered":"2023-10-08T12:00:19.536451+0000","last_unstale":"2023-10-08T12:00:21.602215+0000","last_undegraded":"2023-10-08T12:00:21.602215+0000","last_fullsized":"2023-10-08T12:00:21.602215+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:03:27.436776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.598788+0000","last_change":"2023-10-08T12:00:20.606398+0000","last_active":"2023-10-08T12:00:21.598788+0000","last_peered":"2023-10-08T12:00:21.598788+0000","last_clean":"2023-10-08T12:00:21.598788+0000","last_became_active":"2023-10-08T12:00:20.606065+0000","last_became_peered":"2023-10-08T12:00:20.606065+0000","last_unstale":"2023-10-08T12:00:21.598788+0000","last_undegraded":"2023-10-08T12:00:21.598788+0000","last_fullsized":"2023-10-08T12:00:21.598788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:42:54.801760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855996+0000","last_change":"2023-10-08T12:00:19.549304+0000","last_active":"2023-10-08T12:00:21.855996+0000","last_peered":"2023-10-08T12:00:21.855996+0000","last_clean":"2023-10-08T12:00:21.855996+0000","last_became_active":"2023-10-08T12:00:19.548656+0000","last_became_peered":"2023-10-08T12:00:19.548656+0000","last_unstale":"2023-10-08T12:00:21.855996+0000","last_undegraded":"2023-10-08T12:00:21.855996+0000","last_fullsized":"2023-10-08T12:00:21.855996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:37:27.924905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.603981+0000","last_change":"2023-10-08T12:00:20.626582+0000","last_active":"2023-10-08T12:00:21.603981+0000","last_peered":"2023-10-08T12:00:21.603981+0000","last_clean":"2023-10-08T12:00:21.603981+0000","last_became_active":"2023-10-08T12:00:20.626022+0000","last_became_peered":"2023-10-08T12:00:20.626022+0000","last_unstale":"2023-10-08T12:00:21.603981+0000","last_undegraded":"2023-10-08T12:00:21.603981+0000","last_fullsized":"2023-10-08T12:00:21.603981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:43:35.534698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.604190+0000","last_change":"2023-10-08T12:00:19.541832+0000","last_active":"2023-10-08T12:00:21.604190+0000","last_peered":"2023-10-08T12:00:21.604190+0000","last_clean":"2023-10-08T12:00:21.604190+0000","last_became_active":"2023-10-08T12:00:19.538528+0000","last_became_peered":"2023-10-08T12:00:19.538528+0000","last_unstale":"2023-10-08T12:00:21.604190+0000","last_undegraded":"2023-10-08T12:00:21.604190+0000","last_fullsized":"2023-10-08T12:00:21.604190+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:06:50.282434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855468+0000","last_change":"2023-10-08T12:00:20.586258+0000","last_active":"2023-10-08T12:00:21.855468+0000","last_peered":"2023-10-08T12:00:21.855468+0000","last_clean":"2023-10-08T12:00:21.855468+0000","last_became_active":"2023-10-08T12:00:20.585881+0000","last_became_peered":"2023-10-08T12:00:20.585881+0000","last_unstale":"2023-10-08T12:00:21.855468+0000","last_undegraded":"2023-10-08T12:00:21.855468+0000","last_fullsized":"2023-10-08T12:00:21.855468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:42:54.801760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.599480+0000","last_change":"2023-10-08T12:00:19.534608+0000","last_active":"2023-10-08T12:00:21.599480+0000","last_peered":"2023-10-08T12:00:21.599480+0000","last_clean":"2023-10-08T12:00:21.599480+0000","last_became_active":"2023-10-08T12:00:19.534194+0000","last_became_peered":"2023-10-08T12:00:19.534194+0000","last_unstale":"2023-10-08T12:00:21.599480+0000","last_undegraded":"2023-10-08T12:00:21.599480+0000","last_fullsized":"2023-10-08T12:00:21.599480+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:58:36.625035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.602490+0000","last_change":"2023-10-08T12:00:20.631795+0000","last_active":"2023-10-08T12:00:21.602490+0000","last_peered":"2023-10-08T12:00:21.602490+0000","last_clean":"2023-10-08T12:00:21.602490+0000","last_became_active":"2023-10-08T12:00:20.630218+0000","last_became_peered":"2023-10-08T12:00:20.630218+0000","last_unstale":"2023-10-08T12:00:21.602490+0000","last_undegraded":"2023-10-08T12:00:21.602490+0000","last_fullsized":"2023-10-08T12:00:21.602490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:37:28.928928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855668+0000","last_change":"2023-10-08T12:00:19.531553+0000","last_active":"2023-10-08T12:00:21.855668+0000","last_peered":"2023-10-08T12:00:21.855668+0000","last_clean":"2023-10-08T12:00:21.855668+0000","last_became_active":"2023-10-08T12:00:19.530408+0000","last_became_peered":"2023-10-08T12:00:19.530408+0000","last_unstale":"2023-10-08T12:00:21.855668+0000","last_undegraded":"2023-10-08T12:00:21.855668+0000","last_fullsized":"2023-10-08T12:00:21.855668+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:45:15.530667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.632040+0000","last_change":"2023-10-08T12:00:20.625311+0000","last_active":"2023-10-08T12:00:21.632040+0000","last_peered":"2023-10-08T12:00:21.632040+0000","last_clean":"2023-10-08T12:00:21.632040+0000","last_became_active":"2023-10-08T12:00:20.623142+0000","last_became_peered":"2023-10-08T12:00:20.623142+0000","last_unstale":"2023-10-08T12:00:21.632040+0000","last_undegraded":"2023-10-08T12:00:21.632040+0000","last_fullsized":"2023-10-08T12:00:21.632040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:08:02.997033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855519+0000","last_change":"2023-10-08T12:00:19.536104+0000","last_active":"2023-10-08T12:00:21.855519+0000","last_peered":"2023-10-08T12:00:21.855519+0000","last_clean":"2023-10-08T12:00:21.855519+0000","last_became_active":"2023-10-08T12:00:19.535651+0000","last_became_peered":"2023-10-08T12:00:19.535651+0000","last_unstale":"2023-10-08T12:00:21.855519+0000","last_undegraded":"2023-10-08T12:00:21.855519+0000","last_fullsized":"2023-10-08T12:00:21.855519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:50:34.635731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855128+0000","last_change":"2023-10-08T12:00:20.598434+0000","last_active":"2023-10-08T12:00:21.855128+0000","last_peered":"2023-10-08T12:00:21.855128+0000","last_clean":"2023-10-08T12:00:21.855128+0000","last_became_active":"2023-10-08T12:00:20.598046+0000","last_became_peered":"2023-10-08T12:00:20.598046+0000","last_unstale":"2023-10-08T12:00:21.855128+0000","last_undegraded":"2023-10-08T12:00:21.855128+0000","last_fullsized":"2023-10-08T12:00:21.855128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:10:09.509770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.603141+0000","last_change":"2023-10-08T12:00:19.522917+0000","last_active":"2023-10-08T12:00:21.603141+0000","last_peered":"2023-10-08T12:00:21.603141+0000","last_clean":"2023-10-08T12:00:21.603141+0000","last_became_active":"2023-10-08T12:00:19.522172+0000","last_became_peered":"2023-10-08T12:00:19.522172+0000","last_unstale":"2023-10-08T12:00:21.603141+0000","last_undegraded":"2023-10-08T12:00:21.603141+0000","last_fullsized":"2023-10-08T12:00:21.603141+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:51:26.897821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.632418+0000","last_change":"2023-10-08T12:00:20.626570+0000","last_active":"2023-10-08T12:00:21.632418+0000","last_peered":"2023-10-08T12:00:21.632418+0000","last_clean":"2023-10-08T12:00:21.632418+0000","last_became_active":"2023-10-08T12:00:20.625928+0000","last_became_peered":"2023-10-08T12:00:20.625928+0000","last_unstale":"2023-10-08T12:00:21.632418+0000","last_undegraded":"2023-10-08T12:00:21.632418+0000","last_fullsized":"2023-10-08T12:00:21.632418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:30:47.199431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855385+0000","last_change":"2023-10-08T12:00:19.545158+0000","last_active":"2023-10-08T12:00:21.855385+0000","last_peered":"2023-10-08T12:00:21.855385+0000","last_clean":"2023-10-08T12:00:21.855385+0000","last_became_active":"2023-10-08T12:00:19.544490+0000","last_became_peered":"2023-10-08T12:00:19.544490+0000","last_unstale":"2023-10-08T12:00:21.855385+0000","last_undegraded":"2023-10-08T12:00:21.855385+0000","last_fullsized":"2023-10-08T12:00:21.855385+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:27:03.535042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855412+0000","last_change":"2023-10-08T12:00:20.602776+0000","last_active":"2023-10-08T12:00:21.855412+0000","last_peered":"2023-10-08T12:00:21.855412+0000","last_clean":"2023-10-08T12:00:21.855412+0000","last_became_active":"2023-10-08T12:00:20.601726+0000","last_became_peered":"2023-10-08T12:00:20.601726+0000","last_unstale":"2023-10-08T12:00:21.855412+0000","last_undegraded":"2023-10-08T12:00:21.855412+0000","last_fullsized":"2023-10-08T12:00:21.855412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:30:14.921064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.640174+0000","last_change":"2023-10-08T12:00:19.525010+0000","last_active":"2023-10-08T12:00:21.640174+0000","last_peered":"2023-10-08T12:00:21.640174+0000","last_clean":"2023-10-08T12:00:21.640174+0000","last_became_active":"2023-10-08T12:00:19.524689+0000","last_became_peered":"2023-10-08T12:00:19.524689+0000","last_unstale":"2023-10-08T12:00:21.640174+0000","last_undegraded":"2023-10-08T12:00:21.640174+0000","last_fullsized":"2023-10-08T12:00:21.640174+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:39:17.089135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.631709+0000","last_change":"2023-10-08T12:00:20.624644+0000","last_active":"2023-10-08T12:00:21.631709+0000","last_peered":"2023-10-08T12:00:21.631709+0000","last_clean":"2023-10-08T12:00:21.631709+0000","last_became_active":"2023-10-08T12:00:20.623936+0000","last_became_peered":"2023-10-08T12:00:20.623936+0000","last_unstale":"2023-10-08T12:00:21.631709+0000","last_undegraded":"2023-10-08T12:00:21.631709+0000","last_fullsized":"2023-10-08T12:00:21.631709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:57:40.359987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.602477+0000","last_change":"2023-10-08T12:00:19.525128+0000","last_active":"2023-10-08T12:00:21.602477+0000","last_peered":"2023-10-08T12:00:21.602477+0000","last_clean":"2023-10-08T12:00:21.602477+0000","last_became_active":"2023-10-08T12:00:19.524428+0000","last_became_peered":"2023-10-08T12:00:19.524428+0000","last_unstale":"2023-10-08T12:00:21.602477+0000","last_undegraded":"2023-10-08T12:00:21.602477+0000","last_fullsized":"2023-10-08T12:00:21.602477+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:28:30.235998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.632464+0000","last_change":"2023-10-08T12:00:20.624158+0000","last_active":"2023-10-08T12:00:21.632464+0000","last_peered":"2023-10-08T12:00:21.632464+0000","last_clean":"2023-10-08T12:00:21.632464+0000","last_became_active":"2023-10-08T12:00:20.623663+0000","last_became_peered":"2023-10-08T12:00:20.623663+0000","last_unstale":"2023-10-08T12:00:21.632464+0000","last_undegraded":"2023-10-08T12:00:21.632464+0000","last_fullsized":"2023-10-08T12:00:21.632464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:35:25.862808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.640474+0000","last_change":"2023-10-08T12:00:19.521327+0000","last_active":"2023-10-08T12:00:21.640474+0000","last_peered":"2023-10-08T12:00:21.640474+0000","last_clean":"2023-10-08T12:00:21.640474+0000","last_became_active":"2023-10-08T12:00:19.520907+0000","last_became_peered":"2023-10-08T12:00:19.520907+0000","last_unstale":"2023-10-08T12:00:21.640474+0000","last_undegraded":"2023-10-08T12:00:21.640474+0000","last_fullsized":"2023-10-08T12:00:21.640474+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:17:52.345672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.632767+0000","last_change":"2023-10-08T12:00:20.631419+0000","last_active":"2023-10-08T12:00:21.632767+0000","last_peered":"2023-10-08T12:00:21.632767+0000","last_clean":"2023-10-08T12:00:21.632767+0000","last_became_active":"2023-10-08T12:00:20.630933+0000","last_became_peered":"2023-10-08T12:00:20.630933+0000","last_unstale":"2023-10-08T12:00:21.632767+0000","last_undegraded":"2023-10-08T12:00:21.632767+0000","last_fullsized":"2023-10-08T12:00:21.632767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:23:03.900263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.599639+0000","last_change":"2023-10-08T12:00:19.535778+0000","last_active":"2023-10-08T12:00:21.599639+0000","last_peered":"2023-10-08T12:00:21.599639+0000","last_clean":"2023-10-08T12:00:21.599639+0000","last_became_active":"2023-10-08T12:00:19.535463+0000","last_became_peered":"2023-10-08T12:00:19.535463+0000","last_unstale":"2023-10-08T12:00:21.599639+0000","last_undegraded":"2023-10-08T12:00:21.599639+0000","last_fullsized":"2023-10-08T12:00:21.599639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:06:50.282434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.602845+0000","last_change":"2023-10-08T12:00:20.590511+0000","last_active":"2023-10-08T12:00:21.602845+0000","last_peered":"2023-10-08T12:00:21.602845+0000","last_clean":"2023-10-08T12:00:21.602845+0000","last_became_active":"2023-10-08T12:00:20.589762+0000","last_became_peered":"2023-10-08T12:00:20.589762+0000","last_unstale":"2023-10-08T12:00:21.602845+0000","last_undegraded":"2023-10-08T12:00:21.602845+0000","last_fullsized":"2023-10-08T12:00:21.602845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:08:02.997033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.640487+0000","last_change":"2023-10-08T12:00:19.530223+0000","last_active":"2023-10-08T12:00:21.640487+0000","last_peered":"2023-10-08T12:00:21.640487+0000","last_clean":"2023-10-08T12:00:21.640487+0000","last_became_active":"2023-10-08T12:00:19.529830+0000","last_became_peered":"2023-10-08T12:00:19.529830+0000","last_unstale":"2023-10-08T12:00:21.640487+0000","last_undegraded":"2023-10-08T12:00:21.640487+0000","last_fullsized":"2023-10-08T12:00:21.640487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:47:56.523501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.632457+0000","last_change":"2023-10-08T12:00:20.626826+0000","last_active":"2023-10-08T12:00:21.632457+0000","last_peered":"2023-10-08T12:00:21.632457+0000","last_clean":"2023-10-08T12:00:21.632457+0000","last_became_active":"2023-10-08T12:00:20.624034+0000","last_became_peered":"2023-10-08T12:00:20.624034+0000","last_unstale":"2023-10-08T12:00:21.632457+0000","last_undegraded":"2023-10-08T12:00:21.632457+0000","last_fullsized":"2023-10-08T12:00:21.632457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:42:51.152070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:00:20.587986+0000","last_change":"2023-10-08T12:00:08.887559+0000","last_active":"2023-10-08T12:00:20.587986+0000","last_peered":"2023-10-08T12:00:20.587986+0000","last_clean":"2023-10-08T12:00:20.587986+0000","last_became_active":"2023-10-08T12:00:08.884794+0000","last_became_peered":"2023-10-08T12:00:08.884794+0000","last_unstale":"2023-10-08T12:00:20.587986+0000","last_undegraded":"2023-10-08T12:00:20.587986+0000","last_fullsized":"2023-10-08T12:00:20.587986+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:07.812869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:07.812869+0000","last_clean_scrub_stamp":"2023-10-08T12:00:07.812869+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:58:36.123159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.603377+0000","last_change":"2023-10-08T12:00:19.524401+0000","last_active":"2023-10-08T12:00:21.603377+0000","last_peered":"2023-10-08T12:00:21.603377+0000","last_clean":"2023-10-08T12:00:21.603377+0000","last_became_active":"2023-10-08T12:00:19.523604+0000","last_became_peered":"2023-10-08T12:00:19.523604+0000","last_unstale":"2023-10-08T12:00:21.603377+0000","last_undegraded":"2023-10-08T12:00:21.603377+0000","last_fullsized":"2023-10-08T12:00:21.603377+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:10:08.505747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.856444+0000","last_change":"2023-10-08T12:00:20.605554+0000","last_active":"2023-10-08T12:00:21.856444+0000","last_peered":"2023-10-08T12:00:21.856444+0000","last_clean":"2023-10-08T12:00:21.856444+0000","last_became_active":"2023-10-08T12:00:20.604329+0000","last_became_peered":"2023-10-08T12:00:20.604329+0000","last_unstale":"2023-10-08T12:00:21.856444+0000","last_undegraded":"2023-10-08T12:00:21.856444+0000","last_fullsized":"2023-10-08T12:00:21.856444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:54:25.498802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.631264+0000","last_change":"2023-10-08T12:00:19.552974+0000","last_active":"2023-10-08T12:00:21.631264+0000","last_peered":"2023-10-08T12:00:21.631264+0000","last_clean":"2023-10-08T12:00:21.631264+0000","last_became_active":"2023-10-08T12:00:19.552408+0000","last_became_peered":"2023-10-08T12:00:19.552408+0000","last_unstale":"2023-10-08T12:00:21.631264+0000","last_undegraded":"2023-10-08T12:00:21.631264+0000","last_fullsized":"2023-10-08T12:00:21.631264+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:37:44.353541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.854532+0000","last_change":"2023-10-08T12:00:20.609466+0000","last_active":"2023-10-08T12:00:21.854532+0000","last_peered":"2023-10-08T12:00:21.854532+0000","last_clean":"2023-10-08T12:00:21.854532+0000","last_became_active":"2023-10-08T12:00:20.609116+0000","last_became_peered":"2023-10-08T12:00:20.609116+0000","last_unstale":"2023-10-08T12:00:21.854532+0000","last_undegraded":"2023-10-08T12:00:21.854532+0000","last_fullsized":"2023-10-08T12:00:21.854532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:51:27.901843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.640292+0000","last_change":"2023-10-08T12:00:19.520729+0000","last_active":"2023-10-08T12:00:21.640292+0000","last_peered":"2023-10-08T12:00:21.640292+0000","last_clean":"2023-10-08T12:00:21.640292+0000","last_became_active":"2023-10-08T12:00:19.520254+0000","last_became_peered":"2023-10-08T12:00:19.520254+0000","last_unstale":"2023-10-08T12:00:21.640292+0000","last_undegraded":"2023-10-08T12:00:21.640292+0000","last_fullsized":"2023-10-08T12:00:21.640292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:50:34.635731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.598860+0000","last_change":"2023-10-08T12:00:20.591873+0000","last_active":"2023-10-08T12:00:21.598860+0000","last_peered":"2023-10-08T12:00:21.598860+0000","last_clean":"2023-10-08T12:00:21.598860+0000","last_became_active":"2023-10-08T12:00:20.591431+0000","last_became_peered":"2023-10-08T12:00:20.591431+0000","last_unstale":"2023-10-08T12:00:21.598860+0000","last_undegraded":"2023-10-08T12:00:21.598860+0000","last_fullsized":"2023-10-08T12:00:21.598860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:54:25.498802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.603246+0000","last_change":"2023-10-08T12:00:19.530940+0000","last_active":"2023-10-08T12:00:21.603246+0000","last_peered":"2023-10-08T12:00:21.603246+0000","last_clean":"2023-10-08T12:00:21.603246+0000","last_became_active":"2023-10-08T12:00:19.530216+0000","last_became_peered":"2023-10-08T12:00:19.530216+0000","last_unstale":"2023-10-08T12:00:21.603246+0000","last_undegraded":"2023-10-08T12:00:21.603246+0000","last_fullsized":"2023-10-08T12:00:21.603246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:45:15.530667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.602773+0000","last_change":"2023-10-08T12:00:20.584188+0000","last_active":"2023-10-08T12:00:21.602773+0000","last_peered":"2023-10-08T12:00:21.602773+0000","last_clean":"2023-10-08T12:00:21.602773+0000","last_became_active":"2023-10-08T12:00:20.583209+0000","last_became_peered":"2023-10-08T12:00:20.583209+0000","last_unstale":"2023-10-08T12:00:21.602773+0000","last_undegraded":"2023-10-08T12:00:21.602773+0000","last_fullsized":"2023-10-08T12:00:21.602773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:51:27.901843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.599342+0000","last_change":"2023-10-08T12:00:19.525924+0000","last_active":"2023-10-08T12:00:21.599342+0000","last_peered":"2023-10-08T12:00:21.599342+0000","last_clean":"2023-10-08T12:00:21.599342+0000","last_became_active":"2023-10-08T12:00:19.525508+0000","last_became_peered":"2023-10-08T12:00:19.525508+0000","last_unstale":"2023-10-08T12:00:21.599342+0000","last_undegraded":"2023-10-08T12:00:21.599342+0000","last_fullsized":"2023-10-08T12:00:21.599342+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:51:26.897821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.604521+0000","last_change":"2023-10-08T12:00:20.591551+0000","last_active":"2023-10-08T12:00:21.604521+0000","last_peered":"2023-10-08T12:00:21.604521+0000","last_clean":"2023-10-08T12:00:21.604521+0000","last_became_active":"2023-10-08T12:00:20.589572+0000","last_became_peered":"2023-10-08T12:00:20.589572+0000","last_unstale":"2023-10-08T12:00:21.604521+0000","last_undegraded":"2023-10-08T12:00:21.604521+0000","last_fullsized":"2023-10-08T12:00:21.604521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:22:34.137787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.632679+0000","last_change":"2023-10-08T12:00:19.555017+0000","last_active":"2023-10-08T12:00:21.632679+0000","last_peered":"2023-10-08T12:00:21.632679+0000","last_clean":"2023-10-08T12:00:21.632679+0000","last_became_active":"2023-10-08T12:00:19.554451+0000","last_became_peered":"2023-10-08T12:00:19.554451+0000","last_unstale":"2023-10-08T12:00:21.632679+0000","last_undegraded":"2023-10-08T12:00:21.632679+0000","last_fullsized":"2023-10-08T12:00:21.632679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:54:06.443638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.599236+0000","last_change":"2023-10-08T12:00:20.595603+0000","last_active":"2023-10-08T12:00:21.599236+0000","last_peered":"2023-10-08T12:00:21.599236+0000","last_clean":"2023-10-08T12:00:21.599236+0000","last_became_active":"2023-10-08T12:00:20.595176+0000","last_became_peered":"2023-10-08T12:00:20.595176+0000","last_unstale":"2023-10-08T12:00:21.599236+0000","last_undegraded":"2023-10-08T12:00:21.599236+0000","last_fullsized":"2023-10-08T12:00:21.599236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:46:22.522999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:22.583156+0000","last_change":"2023-10-08T12:00:19.542919+0000","last_active":"2023-10-08T12:00:22.583156+0000","last_peered":"2023-10-08T12:00:22.583156+0000","last_clean":"2023-10-08T12:00:22.583156+0000","last_became_active":"2023-10-08T12:00:19.542518+0000","last_became_peered":"2023-10-08T12:00:19.542518+0000","last_unstale":"2023-10-08T12:00:22.583156+0000","last_undegraded":"2023-10-08T12:00:22.583156+0000","last_fullsized":"2023-10-08T12:00:22.583156+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:10:08.505747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.857089+0000","last_change":"2023-10-08T12:00:20.625910+0000","last_active":"2023-10-08T12:00:21.857089+0000","last_peered":"2023-10-08T12:00:21.857089+0000","last_clean":"2023-10-08T12:00:21.857089+0000","last_became_active":"2023-10-08T12:00:20.625608+0000","last_became_peered":"2023-10-08T12:00:20.625608+0000","last_unstale":"2023-10-08T12:00:21.857089+0000","last_undegraded":"2023-10-08T12:00:21.857089+0000","last_fullsized":"2023-10-08T12:00:21.857089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:53:47.853039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.856048+0000","last_change":"2023-10-08T12:00:19.553242+0000","last_active":"2023-10-08T12:00:21.856048+0000","last_peered":"2023-10-08T12:00:21.856048+0000","last_clean":"2023-10-08T12:00:21.856048+0000","last_became_active":"2023-10-08T12:00:19.552693+0000","last_became_peered":"2023-10-08T12:00:19.552693+0000","last_unstale":"2023-10-08T12:00:21.856048+0000","last_undegraded":"2023-10-08T12:00:21.856048+0000","last_fullsized":"2023-10-08T12:00:21.856048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:51:26.897821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855831+0000","last_change":"2023-10-08T12:00:20.591317+0000","last_active":"2023-10-08T12:00:21.855831+0000","last_peered":"2023-10-08T12:00:21.855831+0000","last_clean":"2023-10-08T12:00:21.855831+0000","last_became_active":"2023-10-08T12:00:20.591008+0000","last_became_peered":"2023-10-08T12:00:20.591008+0000","last_unstale":"2023-10-08T12:00:21.855831+0000","last_undegraded":"2023-10-08T12:00:21.855831+0000","last_fullsized":"2023-10-08T12:00:21.855831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:54:07.447661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.631260+0000","last_change":"2023-10-08T12:00:19.554635+0000","last_active":"2023-10-08T12:00:21.631260+0000","last_peered":"2023-10-08T12:00:21.631260+0000","last_clean":"2023-10-08T12:00:21.631260+0000","last_became_active":"2023-10-08T12:00:19.553990+0000","last_became_peered":"2023-10-08T12:00:19.553990+0000","last_unstale":"2023-10-08T12:00:21.631260+0000","last_undegraded":"2023-10-08T12:00:21.631260+0000","last_fullsized":"2023-10-08T12:00:21.631260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:50:34.635731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.601954+0000","last_change":"2023-10-08T12:00:20.596182+0000","last_active":"2023-10-08T12:00:21.601954+0000","last_peered":"2023-10-08T12:00:21.601954+0000","last_clean":"2023-10-08T12:00:21.601954+0000","last_became_active":"2023-10-08T12:00:20.595333+0000","last_became_peered":"2023-10-08T12:00:20.595333+0000","last_unstale":"2023-10-08T12:00:21.601954+0000","last_undegraded":"2023-10-08T12:00:21.601954+0000","last_fullsized":"2023-10-08T12:00:21.601954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:27:04.539065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.598828+0000","last_change":"2023-10-08T12:00:19.552883+0000","last_active":"2023-10-08T12:00:21.598828+0000","last_peered":"2023-10-08T12:00:21.598828+0000","last_clean":"2023-10-08T12:00:21.598828+0000","last_became_active":"2023-10-08T12:00:19.552343+0000","last_became_peered":"2023-10-08T12:00:19.552343+0000","last_unstale":"2023-10-08T12:00:21.598828+0000","last_undegraded":"2023-10-08T12:00:21.598828+0000","last_fullsized":"2023-10-08T12:00:21.598828+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:37:27.924905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855959+0000","last_change":"2023-10-08T12:00:20.593145+0000","last_active":"2023-10-08T12:00:21.855959+0000","last_peered":"2023-10-08T12:00:21.855959+0000","last_clean":"2023-10-08T12:00:21.855959+0000","last_became_active":"2023-10-08T12:00:20.592778+0000","last_became_peered":"2023-10-08T12:00:20.592778+0000","last_unstale":"2023-10-08T12:00:21.855959+0000","last_undegraded":"2023-10-08T12:00:21.855959+0000","last_fullsized":"2023-10-08T12:00:21.855959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:22:42.527070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.599800+0000","last_change":"2023-10-08T12:00:19.524846+0000","last_active":"2023-10-08T12:00:21.599800+0000","last_peered":"2023-10-08T12:00:21.599800+0000","last_clean":"2023-10-08T12:00:21.599800+0000","last_became_active":"2023-10-08T12:00:19.524431+0000","last_became_peered":"2023-10-08T12:00:19.524431+0000","last_unstale":"2023-10-08T12:00:21.599800+0000","last_undegraded":"2023-10-08T12:00:21.599800+0000","last_fullsized":"2023-10-08T12:00:21.599800+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:45:15.530667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.856621+0000","last_change":"2023-10-08T12:00:20.603921+0000","last_active":"2023-10-08T12:00:21.856621+0000","last_peered":"2023-10-08T12:00:21.856621+0000","last_clean":"2023-10-08T12:00:21.856621+0000","last_became_active":"2023-10-08T12:00:20.601742+0000","last_became_peered":"2023-10-08T12:00:20.601742+0000","last_unstale":"2023-10-08T12:00:21.856621+0000","last_undegraded":"2023-10-08T12:00:21.856621+0000","last_fullsized":"2023-10-08T12:00:21.856621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:55:19.542748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.632096+0000","last_change":"2023-10-08T12:00:19.554323+0000","last_active":"2023-10-08T12:00:21.632096+0000","last_peered":"2023-10-08T12:00:21.632096+0000","last_clean":"2023-10-08T12:00:21.632096+0000","last_became_active":"2023-10-08T12:00:19.553748+0000","last_became_peered":"2023-10-08T12:00:19.553748+0000","last_unstale":"2023-10-08T12:00:21.632096+0000","last_undegraded":"2023-10-08T12:00:21.632096+0000","last_fullsized":"2023-10-08T12:00:21.632096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:51:26.897821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855418+0000","last_change":"2023-10-08T12:00:20.613066+0000","last_active":"2023-10-08T12:00:21.855418+0000","last_peered":"2023-10-08T12:00:21.855418+0000","last_clean":"2023-10-08T12:00:21.855418+0000","last_became_active":"2023-10-08T12:00:20.612422+0000","last_became_peered":"2023-10-08T12:00:20.612422+0000","last_unstale":"2023-10-08T12:00:21.855418+0000","last_undegraded":"2023-10-08T12:00:21.855418+0000","last_fullsized":"2023-10-08T12:00:21.855418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:22:42.527070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.604197+0000","last_change":"2023-10-08T12:00:20.607333+0000","last_active":"2023-10-08T12:00:21.604197+0000","last_peered":"2023-10-08T12:00:21.604197+0000","last_clean":"2023-10-08T12:00:21.604197+0000","last_became_active":"2023-10-08T12:00:20.606634+0000","last_became_peered":"2023-10-08T12:00:20.606634+0000","last_unstale":"2023-10-08T12:00:21.604197+0000","last_undegraded":"2023-10-08T12:00:21.604197+0000","last_fullsized":"2023-10-08T12:00:21.604197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:35:25.862808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.631868+0000","last_change":"2023-10-08T12:00:19.553120+0000","last_active":"2023-10-08T12:00:21.631868+0000","last_peered":"2023-10-08T12:00:21.631868+0000","last_clean":"2023-10-08T12:00:21.631868+0000","last_became_active":"2023-10-08T12:00:19.552479+0000","last_became_peered":"2023-10-08T12:00:19.552479+0000","last_unstale":"2023-10-08T12:00:21.631868+0000","last_undegraded":"2023-10-08T12:00:21.631868+0000","last_fullsized":"2023-10-08T12:00:21.631868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:35:48.346462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.602591+0000","last_change":"2023-10-08T12:00:20.607581+0000","last_active":"2023-10-08T12:00:21.602591+0000","last_peered":"2023-10-08T12:00:21.602591+0000","last_clean":"2023-10-08T12:00:21.602591+0000","last_became_active":"2023-10-08T12:00:20.606887+0000","last_became_peered":"2023-10-08T12:00:20.606887+0000","last_unstale":"2023-10-08T12:00:21.602591+0000","last_undegraded":"2023-10-08T12:00:21.602591+0000","last_fullsized":"2023-10-08T12:00:21.602591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:53:47.853039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.632291+0000","last_change":"2023-10-08T12:00:19.555477+0000","last_active":"2023-10-08T12:00:21.632291+0000","last_peered":"2023-10-08T12:00:21.632291+0000","last_clean":"2023-10-08T12:00:21.632291+0000","last_became_active":"2023-10-08T12:00:19.553643+0000","last_became_peered":"2023-10-08T12:00:19.553643+0000","last_unstale":"2023-10-08T12:00:21.632291+0000","last_undegraded":"2023-10-08T12:00:21.632291+0000","last_fullsized":"2023-10-08T12:00:21.632291+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:30:13.917041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855050+0000","last_change":"2023-10-08T12:00:20.576541+0000","last_active":"2023-10-08T12:00:21.855050+0000","last_peered":"2023-10-08T12:00:21.855050+0000","last_clean":"2023-10-08T12:00:21.855050+0000","last_became_active":"2023-10-08T12:00:20.575715+0000","last_became_peered":"2023-10-08T12:00:20.575715+0000","last_unstale":"2023-10-08T12:00:21.855050+0000","last_undegraded":"2023-10-08T12:00:21.855050+0000","last_fullsized":"2023-10-08T12:00:21.855050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:45:16.534690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.857043+0000","last_change":"2023-10-08T12:00:19.524299+0000","last_active":"2023-10-08T12:00:21.857043+0000","last_peered":"2023-10-08T12:00:21.857043+0000","last_clean":"2023-10-08T12:00:21.857043+0000","last_became_active":"2023-10-08T12:00:19.523979+0000","last_became_peered":"2023-10-08T12:00:19.523979+0000","last_unstale":"2023-10-08T12:00:21.857043+0000","last_undegraded":"2023-10-08T12:00:21.857043+0000","last_fullsized":"2023-10-08T12:00:21.857043+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:06:50.282434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.856602+0000","last_change":"2023-10-08T12:00:20.621615+0000","last_active":"2023-10-08T12:00:21.856602+0000","last_peered":"2023-10-08T12:00:21.856602+0000","last_clean":"2023-10-08T12:00:21.856602+0000","last_became_active":"2023-10-08T12:00:20.621249+0000","last_became_peered":"2023-10-08T12:00:20.621249+0000","last_unstale":"2023-10-08T12:00:21.856602+0000","last_undegraded":"2023-10-08T12:00:21.856602+0000","last_fullsized":"2023-10-08T12:00:21.856602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:46:22.522999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855793+0000","last_change":"2023-10-08T12:00:19.546557+0000","last_active":"2023-10-08T12:00:21.855793+0000","last_peered":"2023-10-08T12:00:21.855793+0000","last_clean":"2023-10-08T12:00:21.855793+0000","last_became_active":"2023-10-08T12:00:19.546297+0000","last_became_peered":"2023-10-08T12:00:19.546297+0000","last_unstale":"2023-10-08T12:00:21.855793+0000","last_undegraded":"2023-10-08T12:00:21.855793+0000","last_fullsized":"2023-10-08T12:00:21.855793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:37:27.924905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":661848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0920000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.052}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.133}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92400000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.351}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":72510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0880000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0549999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":208896,"data_stored":70988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.214}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2749999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4019999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1659999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.103}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.21}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3819999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1559999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1930000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":70898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.085}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.123}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.012}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0640000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.022}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":811008,"data_stored":661904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T12:00:29.165 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T12:00:29.326 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.323+0000 7f790ced4640 1 -- 172.21.15.62:0/4133965648 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79080a08b0 msgr2=0x7f79080b6b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:29.326 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.323+0000 7f790ced4640 1 --2- 172.21.15.62:0/4133965648 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79080a08b0 0x7f79080b6b20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f78f8009840 tx=0x7f78f801c6e0 comp rx=0 tx=0).stop 2023-10-08T12:00:29.327 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.323+0000 7f790ced4640 1 -- 172.21.15.62:0/4133965648 shutdown_connections 2023-10-08T12:00:29.327 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.323+0000 7f790ced4640 1 --2- 172.21.15.62:0/4133965648 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7908065920 0x7f7908150540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:29.327 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.323+0000 7f790ced4640 1 --2- 172.21.15.62:0/4133965648 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79080a08b0 0x7f79080b6b20 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:29.327 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.323+0000 7f790ced4640 1 -- 172.21.15.62:0/4133965648 >> 172.21.15.62:0/4133965648 conn(0x7f79080b7b10 msgr2=0x7f79080b7f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:29.327 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.323+0000 7f790ced4640 1 -- 172.21.15.62:0/4133965648 shutdown_connections 2023-10-08T12:00:29.327 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.323+0000 7f790ced4640 1 -- 172.21.15.62:0/4133965648 wait complete. 2023-10-08T12:00:29.330 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.323+0000 7f790ced4640 1 Processor -- start 2023-10-08T12:00:29.330 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.323+0000 7f790ced4640 1 -- start start 2023-10-08T12:00:29.330 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.323+0000 7f790ced4640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7908065920 0x7f7908145650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:29.330 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.323+0000 7f790ced4640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79080a08b0 0x7f7908139850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:29.330 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.323+0000 7f790ced4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f79080a0c90 0x7f79081e3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:29.330 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.323+0000 7f790ced4640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7908143920 con 0x7f79080a08b0 2023-10-08T12:00:29.330 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.323+0000 7f790ced4640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7908139d90 con 0x7f79080a0c90 2023-10-08T12:00:29.331 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.323+0000 7f790ced4640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7908143ba0 con 0x7f7908065920 2023-10-08T12:00:29.331 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.323+0000 7f7905d9b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79080a08b0 0x7f7908139850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:29.331 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.323+0000 7f7905d9b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79080a08b0 0x7f7908139850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43998/0 (socket says 172.21.15.62:43998) 2023-10-08T12:00:29.331 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.323+0000 7f7905d9b640 1 -- 172.21.15.62:0/286524473 learned_addr learned my addr 172.21.15.62:0/286524473 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:29.331 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.323+0000 7f7905d9b640 1 -- 172.21.15.62:0/286524473 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7908065920 msgr2=0x7f7908145650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:29.331 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.323+0000 7f7905d9b640 1 --2- 172.21.15.62:0/286524473 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7908065920 0x7f7908145650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:29.332 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.323+0000 7f7905d9b640 1 -- 172.21.15.62:0/286524473 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f79080a0c90 msgr2=0x7f79081e3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:29.332 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.323+0000 7f7905d9b640 1 --2- 172.21.15.62:0/286524473 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f79080a0c90 0x7f79081e3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:29.332 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.323+0000 7f7905d9b640 1 -- 172.21.15.62:0/286524473 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78f80094a0 con 0x7f79080a08b0 2023-10-08T12:00:29.332 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.323+0000 7f7905d9b640 1 --2- 172.21.15.62:0/286524473 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79080a08b0 0x7f7908139850 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f78fc00c370 tx=0x7f78fc00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:29.332 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.323+0000 7f78f6ffd640 1 -- 172.21.15.62:0/286524473 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78fc011790 con 0x7f79080a08b0 2023-10-08T12:00:29.332 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.323+0000 7f78f6ffd640 1 -- 172.21.15.62:0/286524473 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f78fc0119e0 con 0x7f79080a08b0 2023-10-08T12:00:29.333 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.323+0000 7f790ced4640 1 -- 172.21.15.62:0/286524473 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7908143e80 con 0x7f79080a08b0 2023-10-08T12:00:29.333 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.323+0000 7f78f6ffd640 1 -- 172.21.15.62:0/286524473 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78fc011dd0 con 0x7f79080a08b0 2023-10-08T12:00:29.333 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.323+0000 7f790ced4640 1 -- 172.21.15.62:0/286524473 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7908144160 con 0x7f79080a08b0 2023-10-08T12:00:29.333 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.323+0000 7f790ced4640 1 -- 172.21.15.62:0/286524473 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79080739e0 con 0x7f79080a08b0 2023-10-08T12:00:29.333 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.327+0000 7f78f6ffd640 1 -- 172.21.15.62:0/286524473 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f78fc01c460 con 0x7f79080a08b0 2023-10-08T12:00:29.335 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.327+0000 7f78f6ffd640 1 --2- 172.21.15.62:0/286524473 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f78e8066470 0x7f78e8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:29.335 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.327+0000 7f78f6ffd640 1 -- 172.21.15.62:0/286524473 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f78fc083fe0 con 0x7f79080a08b0 2023-10-08T12:00:29.335 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.327+0000 7f790659c640 1 --2- 172.21.15.62:0/286524473 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f78e8066470 0x7f78e8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:29.335 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.327+0000 7f790659c640 1 --2- 172.21.15.62:0/286524473 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f78e8066470 0x7f78e8068930 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f78f80ae000 tx=0x7f78f8019480 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:29.335 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.331+0000 7f78f6ffd640 1 -- 172.21.15.62:0/286524473 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f78fc0513d0 con 0x7f79080a08b0 2023-10-08T12:00:29.484 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.479+0000 7f790ced4640 1 -- 172.21.15.62:0/286524473 --> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7908143d10 con 0x7f78e8066470 2023-10-08T12:00:29.504 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.499+0000 7f78f6ffd640 1 -- 172.21.15.62:0/286524473 <== mgr.4111 v2:172.21.15.130:6832/826384843 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264495 (secure 0 0 0) 0x7f7908143d10 con 0x7f78e8066470 2023-10-08T12:00:29.506 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T12:00:29.508 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2023-10-08T12:00:29.509 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.503+0000 7f790ced4640 1 -- 172.21.15.62:0/286524473 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f78e8066470 msgr2=0x7f78e8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:29.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.503+0000 7f790ced4640 1 --2- 172.21.15.62:0/286524473 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f78e8066470 0x7f78e8068930 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f78f80ae000 tx=0x7f78f8019480 comp rx=0 tx=0).stop 2023-10-08T12:00:29.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.503+0000 7f790ced4640 1 -- 172.21.15.62:0/286524473 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79080a08b0 msgr2=0x7f7908139850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:29.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.503+0000 7f790ced4640 1 --2- 172.21.15.62:0/286524473 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79080a08b0 0x7f7908139850 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f78fc00c370 tx=0x7f78fc00c830 comp rx=0 tx=0).stop 2023-10-08T12:00:29.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.503+0000 7f790ced4640 1 -- 172.21.15.62:0/286524473 shutdown_connections 2023-10-08T12:00:29.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.503+0000 7f790ced4640 1 --2- 172.21.15.62:0/286524473 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f78e8066470 0x7f78e8068930 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:29.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.503+0000 7f790ced4640 1 --2- 172.21.15.62:0/286524473 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f79080a0c90 0x7f79081e3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:29.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.503+0000 7f790ced4640 1 --2- 172.21.15.62:0/286524473 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79080a08b0 0x7f7908139850 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:29.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.503+0000 7f790ced4640 1 --2- 172.21.15.62:0/286524473 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7908065920 0x7f7908145650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:29.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.503+0000 7f790ced4640 1 -- 172.21.15.62:0/286524473 >> 172.21.15.62:0/286524473 conn(0x7f79080b7b10 msgr2=0x7f79080b5a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:29.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.503+0000 7f790ced4640 1 -- 172.21.15.62:0/286524473 shutdown_connections 2023-10-08T12:00:29.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.503+0000 7f790ced4640 1 -- 172.21.15.62:0/286524473 wait complete. 2023-10-08T12:00:29.524 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-10-08T12:00:29.113920+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219036,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755684,"statfs":{"total":773094113280,"available":772869820416,"internally_reserved":0,"allocated":2891776,"data_stored":1752740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.555992"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.632466+0000","last_change":"2023-10-08T12:00:20.627789+0000","last_active":"2023-10-08T12:00:21.632466+0000","last_peered":"2023-10-08T12:00:21.632466+0000","last_clean":"2023-10-08T12:00:21.632466+0000","last_became_active":"2023-10-08T12:00:20.624907+0000","last_became_peered":"2023-10-08T12:00:20.624907+0000","last_unstale":"2023-10-08T12:00:21.632466+0000","last_undegraded":"2023-10-08T12:00:21.632466+0000","last_fullsized":"2023-10-08T12:00:21.632466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:43:35.534698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.598994+0000","last_change":"2023-10-08T12:00:20.600909+0000","last_active":"2023-10-08T12:00:21.598994+0000","last_peered":"2023-10-08T12:00:21.598994+0000","last_clean":"2023-10-08T12:00:21.598994+0000","last_became_active":"2023-10-08T12:00:20.600498+0000","last_became_peered":"2023-10-08T12:00:20.600498+0000","last_unstale":"2023-10-08T12:00:21.598994+0000","last_undegraded":"2023-10-08T12:00:21.598994+0000","last_fullsized":"2023-10-08T12:00:21.598994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:54:07.447661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855469+0000","last_change":"2023-10-08T12:00:20.591739+0000","last_active":"2023-10-08T12:00:21.855469+0000","last_peered":"2023-10-08T12:00:21.855469+0000","last_clean":"2023-10-08T12:00:21.855469+0000","last_became_active":"2023-10-08T12:00:20.591277+0000","last_became_peered":"2023-10-08T12:00:20.591277+0000","last_unstale":"2023-10-08T12:00:21.855469+0000","last_undegraded":"2023-10-08T12:00:21.855469+0000","last_fullsized":"2023-10-08T12:00:21.855469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:54:25.498802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.602411+0000","last_change":"2023-10-08T12:00:20.595788+0000","last_active":"2023-10-08T12:00:21.602411+0000","last_peered":"2023-10-08T12:00:21.602411+0000","last_clean":"2023-10-08T12:00:21.602411+0000","last_became_active":"2023-10-08T12:00:20.595025+0000","last_became_peered":"2023-10-08T12:00:20.595025+0000","last_unstale":"2023-10-08T12:00:21.602411+0000","last_undegraded":"2023-10-08T12:00:21.602411+0000","last_fullsized":"2023-10-08T12:00:21.602411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:17:42.290460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.631819+0000","last_change":"2023-10-08T12:00:20.625363+0000","last_active":"2023-10-08T12:00:21.631819+0000","last_peered":"2023-10-08T12:00:21.631819+0000","last_clean":"2023-10-08T12:00:21.631819+0000","last_became_active":"2023-10-08T12:00:20.623270+0000","last_became_peered":"2023-10-08T12:00:20.623270+0000","last_unstale":"2023-10-08T12:00:21.631819+0000","last_undegraded":"2023-10-08T12:00:21.631819+0000","last_fullsized":"2023-10-08T12:00:21.631819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:53:47.853039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.602599+0000","last_change":"2023-10-08T12:00:20.600868+0000","last_active":"2023-10-08T12:00:21.602599+0000","last_peered":"2023-10-08T12:00:21.602599+0000","last_clean":"2023-10-08T12:00:21.602599+0000","last_became_active":"2023-10-08T12:00:20.600160+0000","last_became_peered":"2023-10-08T12:00:20.600160+0000","last_unstale":"2023-10-08T12:00:21.602599+0000","last_undegraded":"2023-10-08T12:00:21.602599+0000","last_fullsized":"2023-10-08T12:00:21.602599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:57:40.359987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.631537+0000","last_change":"2023-10-08T12:00:20.625181+0000","last_active":"2023-10-08T12:00:21.631537+0000","last_peered":"2023-10-08T12:00:21.631537+0000","last_clean":"2023-10-08T12:00:21.631537+0000","last_became_active":"2023-10-08T12:00:20.623344+0000","last_became_peered":"2023-10-08T12:00:20.623344+0000","last_unstale":"2023-10-08T12:00:21.631537+0000","last_undegraded":"2023-10-08T12:00:21.631537+0000","last_fullsized":"2023-10-08T12:00:21.631537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:17:42.290460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855227+0000","last_change":"2023-10-08T12:00:20.594960+0000","last_active":"2023-10-08T12:00:21.855227+0000","last_peered":"2023-10-08T12:00:21.855227+0000","last_clean":"2023-10-08T12:00:21.855227+0000","last_became_active":"2023-10-08T12:00:20.594580+0000","last_became_peered":"2023-10-08T12:00:20.594580+0000","last_unstale":"2023-10-08T12:00:21.855227+0000","last_undegraded":"2023-10-08T12:00:21.855227+0000","last_fullsized":"2023-10-08T12:00:21.855227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:10:09.509770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.632479+0000","last_change":"2023-10-08T12:00:20.625978+0000","last_active":"2023-10-08T12:00:21.632479+0000","last_peered":"2023-10-08T12:00:21.632479+0000","last_clean":"2023-10-08T12:00:21.632479+0000","last_became_active":"2023-10-08T12:00:20.624917+0000","last_became_peered":"2023-10-08T12:00:20.624917+0000","last_unstale":"2023-10-08T12:00:21.632479+0000","last_undegraded":"2023-10-08T12:00:21.632479+0000","last_fullsized":"2023-10-08T12:00:21.632479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:11:56.311548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855967+0000","last_change":"2023-10-08T12:00:20.613419+0000","last_active":"2023-10-08T12:00:21.855967+0000","last_peered":"2023-10-08T12:00:21.855967+0000","last_clean":"2023-10-08T12:00:21.855967+0000","last_became_active":"2023-10-08T12:00:20.612588+0000","last_became_peered":"2023-10-08T12:00:20.612588+0000","last_unstale":"2023-10-08T12:00:21.855967+0000","last_undegraded":"2023-10-08T12:00:21.855967+0000","last_fullsized":"2023-10-08T12:00:21.855967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:54:07.447661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855739+0000","last_change":"2023-10-08T12:00:20.614307+0000","last_active":"2023-10-08T12:00:21.855739+0000","last_peered":"2023-10-08T12:00:21.855739+0000","last_clean":"2023-10-08T12:00:21.855739+0000","last_became_active":"2023-10-08T12:00:20.613632+0000","last_became_peered":"2023-10-08T12:00:20.613632+0000","last_unstale":"2023-10-08T12:00:21.855739+0000","last_undegraded":"2023-10-08T12:00:21.855739+0000","last_fullsized":"2023-10-08T12:00:21.855739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:54:25.498802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.602167+0000","last_change":"2023-10-08T12:00:20.615632+0000","last_active":"2023-10-08T12:00:21.602167+0000","last_peered":"2023-10-08T12:00:21.602167+0000","last_clean":"2023-10-08T12:00:21.602167+0000","last_became_active":"2023-10-08T12:00:20.615011+0000","last_became_peered":"2023-10-08T12:00:20.615011+0000","last_unstale":"2023-10-08T12:00:21.602167+0000","last_undegraded":"2023-10-08T12:00:21.602167+0000","last_fullsized":"2023-10-08T12:00:21.602167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:03:28.440799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.856538+0000","last_change":"2023-10-08T12:00:20.621730+0000","last_active":"2023-10-08T12:00:21.856538+0000","last_peered":"2023-10-08T12:00:21.856538+0000","last_clean":"2023-10-08T12:00:21.856538+0000","last_became_active":"2023-10-08T12:00:20.621145+0000","last_became_peered":"2023-10-08T12:00:20.621145+0000","last_unstale":"2023-10-08T12:00:21.856538+0000","last_undegraded":"2023-10-08T12:00:21.856538+0000","last_fullsized":"2023-10-08T12:00:21.856538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:54:07.447661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.854760+0000","last_change":"2023-10-08T12:00:20.590571+0000","last_active":"2023-10-08T12:00:21.854760+0000","last_peered":"2023-10-08T12:00:21.854760+0000","last_clean":"2023-10-08T12:00:21.854760+0000","last_became_active":"2023-10-08T12:00:20.590216+0000","last_became_peered":"2023-10-08T12:00:20.590216+0000","last_unstale":"2023-10-08T12:00:21.854760+0000","last_undegraded":"2023-10-08T12:00:21.854760+0000","last_fullsized":"2023-10-08T12:00:21.854760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:58:37.629058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.598733+0000","last_change":"2023-10-08T12:00:20.609487+0000","last_active":"2023-10-08T12:00:21.598733+0000","last_peered":"2023-10-08T12:00:21.598733+0000","last_clean":"2023-10-08T12:00:21.598733+0000","last_became_active":"2023-10-08T12:00:20.609198+0000","last_became_peered":"2023-10-08T12:00:20.609198+0000","last_unstale":"2023-10-08T12:00:21.598733+0000","last_undegraded":"2023-10-08T12:00:21.598733+0000","last_fullsized":"2023-10-08T12:00:21.598733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:22:42.527070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.601660+0000","last_change":"2023-10-08T12:00:20.605444+0000","last_active":"2023-10-08T12:00:21.601660+0000","last_peered":"2023-10-08T12:00:21.601660+0000","last_clean":"2023-10-08T12:00:21.601660+0000","last_became_active":"2023-10-08T12:00:20.604696+0000","last_became_peered":"2023-10-08T12:00:20.604696+0000","last_unstale":"2023-10-08T12:00:21.601660+0000","last_undegraded":"2023-10-08T12:00:21.601660+0000","last_fullsized":"2023-10-08T12:00:21.601660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:46:22.522999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.604436+0000","last_change":"2023-10-08T12:00:20.626616+0000","last_active":"2023-10-08T12:00:21.604436+0000","last_peered":"2023-10-08T12:00:21.604436+0000","last_clean":"2023-10-08T12:00:21.604436+0000","last_became_active":"2023-10-08T12:00:20.626042+0000","last_became_peered":"2023-10-08T12:00:20.626042+0000","last_unstale":"2023-10-08T12:00:21.604436+0000","last_undegraded":"2023-10-08T12:00:21.604436+0000","last_fullsized":"2023-10-08T12:00:21.604436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:11:56.311548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.640507+0000","last_change":"2023-10-08T12:00:20.621413+0000","last_active":"2023-10-08T12:00:21.640507+0000","last_peered":"2023-10-08T12:00:21.640507+0000","last_clean":"2023-10-08T12:00:21.640507+0000","last_became_active":"2023-10-08T12:00:20.621169+0000","last_became_peered":"2023-10-08T12:00:20.621169+0000","last_unstale":"2023-10-08T12:00:21.640507+0000","last_undegraded":"2023-10-08T12:00:21.640507+0000","last_fullsized":"2023-10-08T12:00:21.640507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:03:28.440799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.632631+0000","last_change":"2023-10-08T12:00:20.627431+0000","last_active":"2023-10-08T12:00:21.632631+0000","last_peered":"2023-10-08T12:00:21.632631+0000","last_clean":"2023-10-08T12:00:21.632631+0000","last_became_active":"2023-10-08T12:00:20.624730+0000","last_became_peered":"2023-10-08T12:00:20.624730+0000","last_unstale":"2023-10-08T12:00:21.632631+0000","last_undegraded":"2023-10-08T12:00:21.632631+0000","last_fullsized":"2023-10-08T12:00:21.632631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:22:34.137787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855624+0000","last_change":"2023-10-08T12:00:20.620364+0000","last_active":"2023-10-08T12:00:21.855624+0000","last_peered":"2023-10-08T12:00:21.855624+0000","last_clean":"2023-10-08T12:00:21.855624+0000","last_became_active":"2023-10-08T12:00:20.619755+0000","last_became_peered":"2023-10-08T12:00:20.619755+0000","last_unstale":"2023-10-08T12:00:21.855624+0000","last_undegraded":"2023-10-08T12:00:21.855624+0000","last_fullsized":"2023-10-08T12:00:21.855624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:42:54.801760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855087+0000","last_change":"2023-10-08T12:00:20.623340+0000","last_active":"2023-10-08T12:00:21.855087+0000","last_peered":"2023-10-08T12:00:21.855087+0000","last_clean":"2023-10-08T12:00:21.855087+0000","last_became_active":"2023-10-08T12:00:20.623038+0000","last_became_peered":"2023-10-08T12:00:20.623038+0000","last_unstale":"2023-10-08T12:00:21.855087+0000","last_undegraded":"2023-10-08T12:00:21.855087+0000","last_fullsized":"2023-10-08T12:00:21.855087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:06:51.286457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.602856+0000","last_change":"2023-10-08T12:00:20.627019+0000","last_active":"2023-10-08T12:00:21.602856+0000","last_peered":"2023-10-08T12:00:21.602856+0000","last_clean":"2023-10-08T12:00:21.602856+0000","last_became_active":"2023-10-08T12:00:20.626509+0000","last_became_peered":"2023-10-08T12:00:20.626509+0000","last_unstale":"2023-10-08T12:00:21.602856+0000","last_undegraded":"2023-10-08T12:00:21.602856+0000","last_fullsized":"2023-10-08T12:00:21.602856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:30:47.199431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.856085+0000","last_change":"2023-10-08T12:00:20.608919+0000","last_active":"2023-10-08T12:00:21.856085+0000","last_peered":"2023-10-08T12:00:21.856085+0000","last_clean":"2023-10-08T12:00:21.856085+0000","last_became_active":"2023-10-08T12:00:20.608477+0000","last_became_peered":"2023-10-08T12:00:20.608477+0000","last_unstale":"2023-10-08T12:00:21.856085+0000","last_undegraded":"2023-10-08T12:00:21.856085+0000","last_fullsized":"2023-10-08T12:00:21.856085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:42:54.801760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.601997+0000","last_change":"2023-10-08T12:00:20.590431+0000","last_active":"2023-10-08T12:00:21.601997+0000","last_peered":"2023-10-08T12:00:21.601997+0000","last_clean":"2023-10-08T12:00:21.601997+0000","last_became_active":"2023-10-08T12:00:20.589585+0000","last_became_peered":"2023-10-08T12:00:20.589585+0000","last_unstale":"2023-10-08T12:00:21.601997+0000","last_undegraded":"2023-10-08T12:00:21.601997+0000","last_fullsized":"2023-10-08T12:00:21.601997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:55:19.542748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.856733+0000","last_change":"2023-10-08T12:00:20.603260+0000","last_active":"2023-10-08T12:00:21.856733+0000","last_peered":"2023-10-08T12:00:21.856733+0000","last_clean":"2023-10-08T12:00:21.856733+0000","last_became_active":"2023-10-08T12:00:20.602872+0000","last_became_peered":"2023-10-08T12:00:20.602872+0000","last_unstale":"2023-10-08T12:00:21.856733+0000","last_undegraded":"2023-10-08T12:00:21.856733+0000","last_fullsized":"2023-10-08T12:00:21.856733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:17:42.290460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.856070+0000","last_change":"2023-10-08T12:00:20.624667+0000","last_active":"2023-10-08T12:00:21.856070+0000","last_peered":"2023-10-08T12:00:21.856070+0000","last_clean":"2023-10-08T12:00:21.856070+0000","last_became_active":"2023-10-08T12:00:20.624080+0000","last_became_peered":"2023-10-08T12:00:20.624080+0000","last_unstale":"2023-10-08T12:00:21.856070+0000","last_undegraded":"2023-10-08T12:00:21.856070+0000","last_fullsized":"2023-10-08T12:00:21.856070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:46:22.522999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.599492+0000","last_change":"2023-10-08T12:00:20.606784+0000","last_active":"2023-10-08T12:00:21.599492+0000","last_peered":"2023-10-08T12:00:21.599492+0000","last_clean":"2023-10-08T12:00:21.599492+0000","last_became_active":"2023-10-08T12:00:20.606415+0000","last_became_peered":"2023-10-08T12:00:20.606415+0000","last_unstale":"2023-10-08T12:00:21.599492+0000","last_undegraded":"2023-10-08T12:00:21.599492+0000","last_fullsized":"2023-10-08T12:00:21.599492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:55:19.542748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.856912+0000","last_change":"2023-10-08T12:00:20.619158+0000","last_active":"2023-10-08T12:00:21.856912+0000","last_peered":"2023-10-08T12:00:21.856912+0000","last_clean":"2023-10-08T12:00:21.856912+0000","last_became_active":"2023-10-08T12:00:20.618857+0000","last_became_peered":"2023-10-08T12:00:20.618857+0000","last_unstale":"2023-10-08T12:00:21.856912+0000","last_undegraded":"2023-10-08T12:00:21.856912+0000","last_fullsized":"2023-10-08T12:00:21.856912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:57:40.359987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855238+0000","last_change":"2023-10-08T12:00:20.601375+0000","last_active":"2023-10-08T12:00:21.855238+0000","last_peered":"2023-10-08T12:00:21.855238+0000","last_clean":"2023-10-08T12:00:21.855238+0000","last_became_active":"2023-10-08T12:00:20.600980+0000","last_became_peered":"2023-10-08T12:00:20.600980+0000","last_unstale":"2023-10-08T12:00:21.855238+0000","last_undegraded":"2023-10-08T12:00:21.855238+0000","last_fullsized":"2023-10-08T12:00:21.855238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:30:14.921064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.603029+0000","last_change":"2023-10-08T12:00:20.608122+0000","last_active":"2023-10-08T12:00:21.603029+0000","last_peered":"2023-10-08T12:00:21.603029+0000","last_clean":"2023-10-08T12:00:21.603029+0000","last_became_active":"2023-10-08T12:00:20.603444+0000","last_became_peered":"2023-10-08T12:00:20.603444+0000","last_unstale":"2023-10-08T12:00:21.603029+0000","last_undegraded":"2023-10-08T12:00:21.603029+0000","last_fullsized":"2023-10-08T12:00:21.603029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:42:51.152070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.640418+0000","last_change":"2023-10-08T12:00:20.604312+0000","last_active":"2023-10-08T12:00:21.640418+0000","last_peered":"2023-10-08T12:00:21.640418+0000","last_clean":"2023-10-08T12:00:21.640418+0000","last_became_active":"2023-10-08T12:00:20.603285+0000","last_became_peered":"2023-10-08T12:00:20.603285+0000","last_unstale":"2023-10-08T12:00:21.640418+0000","last_undegraded":"2023-10-08T12:00:21.640418+0000","last_fullsized":"2023-10-08T12:00:21.640418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:27:04.539065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855353+0000","last_change":"2023-10-08T12:00:20.604806+0000","last_active":"2023-10-08T12:00:21.855353+0000","last_peered":"2023-10-08T12:00:21.855353+0000","last_clean":"2023-10-08T12:00:21.855353+0000","last_became_active":"2023-10-08T12:00:20.602679+0000","last_became_peered":"2023-10-08T12:00:20.602679+0000","last_unstale":"2023-10-08T12:00:21.855353+0000","last_undegraded":"2023-10-08T12:00:21.855353+0000","last_fullsized":"2023-10-08T12:00:21.855353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:10:09.509770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.601550+0000","last_change":"2023-10-08T12:00:20.587095+0000","last_active":"2023-10-08T12:00:21.601550+0000","last_peered":"2023-10-08T12:00:21.601550+0000","last_clean":"2023-10-08T12:00:21.601550+0000","last_became_active":"2023-10-08T12:00:20.586374+0000","last_became_peered":"2023-10-08T12:00:20.586374+0000","last_unstale":"2023-10-08T12:00:21.601550+0000","last_undegraded":"2023-10-08T12:00:21.601550+0000","last_fullsized":"2023-10-08T12:00:21.601550+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:37:45.357564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.856807+0000","last_change":"2023-10-08T12:00:19.547119+0000","last_active":"2023-10-08T12:00:21.856807+0000","last_peered":"2023-10-08T12:00:21.856807+0000","last_clean":"2023-10-08T12:00:21.856807+0000","last_became_active":"2023-10-08T12:00:19.546721+0000","last_became_peered":"2023-10-08T12:00:19.546721+0000","last_unstale":"2023-10-08T12:00:21.856807+0000","last_undegraded":"2023-10-08T12:00:21.856807+0000","last_fullsized":"2023-10-08T12:00:21.856807+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:58:36.625035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855308+0000","last_change":"2023-10-08T12:00:20.587928+0000","last_active":"2023-10-08T12:00:21.855308+0000","last_peered":"2023-10-08T12:00:21.855308+0000","last_clean":"2023-10-08T12:00:21.855308+0000","last_became_active":"2023-10-08T12:00:20.587195+0000","last_became_peered":"2023-10-08T12:00:20.587195+0000","last_unstale":"2023-10-08T12:00:21.855308+0000","last_undegraded":"2023-10-08T12:00:21.855308+0000","last_fullsized":"2023-10-08T12:00:21.855308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:22:42.527070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855483+0000","last_change":"2023-10-08T12:00:19.544794+0000","last_active":"2023-10-08T12:00:21.855483+0000","last_peered":"2023-10-08T12:00:21.855483+0000","last_clean":"2023-10-08T12:00:21.855483+0000","last_became_active":"2023-10-08T12:00:19.544159+0000","last_became_peered":"2023-10-08T12:00:19.544159+0000","last_unstale":"2023-10-08T12:00:21.855483+0000","last_undegraded":"2023-10-08T12:00:21.855483+0000","last_fullsized":"2023-10-08T12:00:21.855483+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:03:27.436776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.856316+0000","last_change":"2023-10-08T12:00:19.533572+0000","last_active":"2023-10-08T12:00:21.856316+0000","last_peered":"2023-10-08T12:00:21.856316+0000","last_clean":"2023-10-08T12:00:21.856316+0000","last_became_active":"2023-10-08T12:00:19.533122+0000","last_became_peered":"2023-10-08T12:00:19.533122+0000","last_unstale":"2023-10-08T12:00:21.856316+0000","last_undegraded":"2023-10-08T12:00:21.856316+0000","last_fullsized":"2023-10-08T12:00:21.856316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:45:15.530667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855898+0000","last_change":"2023-10-08T12:00:20.600857+0000","last_active":"2023-10-08T12:00:21.855898+0000","last_peered":"2023-10-08T12:00:21.855898+0000","last_clean":"2023-10-08T12:00:21.855898+0000","last_became_active":"2023-10-08T12:00:20.600486+0000","last_became_peered":"2023-10-08T12:00:20.600486+0000","last_unstale":"2023-10-08T12:00:21.855898+0000","last_undegraded":"2023-10-08T12:00:21.855898+0000","last_fullsized":"2023-10-08T12:00:21.855898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:30:14.921064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.602215+0000","last_change":"2023-10-08T12:00:19.537352+0000","last_active":"2023-10-08T12:00:21.602215+0000","last_peered":"2023-10-08T12:00:21.602215+0000","last_clean":"2023-10-08T12:00:21.602215+0000","last_became_active":"2023-10-08T12:00:19.536451+0000","last_became_peered":"2023-10-08T12:00:19.536451+0000","last_unstale":"2023-10-08T12:00:21.602215+0000","last_undegraded":"2023-10-08T12:00:21.602215+0000","last_fullsized":"2023-10-08T12:00:21.602215+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:03:27.436776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.598788+0000","last_change":"2023-10-08T12:00:20.606398+0000","last_active":"2023-10-08T12:00:21.598788+0000","last_peered":"2023-10-08T12:00:21.598788+0000","last_clean":"2023-10-08T12:00:21.598788+0000","last_became_active":"2023-10-08T12:00:20.606065+0000","last_became_peered":"2023-10-08T12:00:20.606065+0000","last_unstale":"2023-10-08T12:00:21.598788+0000","last_undegraded":"2023-10-08T12:00:21.598788+0000","last_fullsized":"2023-10-08T12:00:21.598788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:42:54.801760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855996+0000","last_change":"2023-10-08T12:00:19.549304+0000","last_active":"2023-10-08T12:00:21.855996+0000","last_peered":"2023-10-08T12:00:21.855996+0000","last_clean":"2023-10-08T12:00:21.855996+0000","last_became_active":"2023-10-08T12:00:19.548656+0000","last_became_peered":"2023-10-08T12:00:19.548656+0000","last_unstale":"2023-10-08T12:00:21.855996+0000","last_undegraded":"2023-10-08T12:00:21.855996+0000","last_fullsized":"2023-10-08T12:00:21.855996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:37:27.924905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.603981+0000","last_change":"2023-10-08T12:00:20.626582+0000","last_active":"2023-10-08T12:00:21.603981+0000","last_peered":"2023-10-08T12:00:21.603981+0000","last_clean":"2023-10-08T12:00:21.603981+0000","last_became_active":"2023-10-08T12:00:20.626022+0000","last_became_peered":"2023-10-08T12:00:20.626022+0000","last_unstale":"2023-10-08T12:00:21.603981+0000","last_undegraded":"2023-10-08T12:00:21.603981+0000","last_fullsized":"2023-10-08T12:00:21.603981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:43:35.534698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.604190+0000","last_change":"2023-10-08T12:00:19.541832+0000","last_active":"2023-10-08T12:00:21.604190+0000","last_peered":"2023-10-08T12:00:21.604190+0000","last_clean":"2023-10-08T12:00:21.604190+0000","last_became_active":"2023-10-08T12:00:19.538528+0000","last_became_peered":"2023-10-08T12:00:19.538528+0000","last_unstale":"2023-10-08T12:00:21.604190+0000","last_undegraded":"2023-10-08T12:00:21.604190+0000","last_fullsized":"2023-10-08T12:00:21.604190+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:06:50.282434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855468+0000","last_change":"2023-10-08T12:00:20.586258+0000","last_active":"2023-10-08T12:00:21.855468+0000","last_peered":"2023-10-08T12:00:21.855468+0000","last_clean":"2023-10-08T12:00:21.855468+0000","last_became_active":"2023-10-08T12:00:20.585881+0000","last_became_peered":"2023-10-08T12:00:20.585881+0000","last_unstale":"2023-10-08T12:00:21.855468+0000","last_undegraded":"2023-10-08T12:00:21.855468+0000","last_fullsized":"2023-10-08T12:00:21.855468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:42:54.801760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.599480+0000","last_change":"2023-10-08T12:00:19.534608+0000","last_active":"2023-10-08T12:00:21.599480+0000","last_peered":"2023-10-08T12:00:21.599480+0000","last_clean":"2023-10-08T12:00:21.599480+0000","last_became_active":"2023-10-08T12:00:19.534194+0000","last_became_peered":"2023-10-08T12:00:19.534194+0000","last_unstale":"2023-10-08T12:00:21.599480+0000","last_undegraded":"2023-10-08T12:00:21.599480+0000","last_fullsized":"2023-10-08T12:00:21.599480+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:58:36.625035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.602490+0000","last_change":"2023-10-08T12:00:20.631795+0000","last_active":"2023-10-08T12:00:21.602490+0000","last_peered":"2023-10-08T12:00:21.602490+0000","last_clean":"2023-10-08T12:00:21.602490+0000","last_became_active":"2023-10-08T12:00:20.630218+0000","last_became_peered":"2023-10-08T12:00:20.630218+0000","last_unstale":"2023-10-08T12:00:21.602490+0000","last_undegraded":"2023-10-08T12:00:21.602490+0000","last_fullsized":"2023-10-08T12:00:21.602490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:37:28.928928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855668+0000","last_change":"2023-10-08T12:00:19.531553+0000","last_active":"2023-10-08T12:00:21.855668+0000","last_peered":"2023-10-08T12:00:21.855668+0000","last_clean":"2023-10-08T12:00:21.855668+0000","last_became_active":"2023-10-08T12:00:19.530408+0000","last_became_peered":"2023-10-08T12:00:19.530408+0000","last_unstale":"2023-10-08T12:00:21.855668+0000","last_undegraded":"2023-10-08T12:00:21.855668+0000","last_fullsized":"2023-10-08T12:00:21.855668+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:45:15.530667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.632040+0000","last_change":"2023-10-08T12:00:20.625311+0000","last_active":"2023-10-08T12:00:21.632040+0000","last_peered":"2023-10-08T12:00:21.632040+0000","last_clean":"2023-10-08T12:00:21.632040+0000","last_became_active":"2023-10-08T12:00:20.623142+0000","last_became_peered":"2023-10-08T12:00:20.623142+0000","last_unstale":"2023-10-08T12:00:21.632040+0000","last_undegraded":"2023-10-08T12:00:21.632040+0000","last_fullsized":"2023-10-08T12:00:21.632040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:08:02.997033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855519+0000","last_change":"2023-10-08T12:00:19.536104+0000","last_active":"2023-10-08T12:00:21.855519+0000","last_peered":"2023-10-08T12:00:21.855519+0000","last_clean":"2023-10-08T12:00:21.855519+0000","last_became_active":"2023-10-08T12:00:19.535651+0000","last_became_peered":"2023-10-08T12:00:19.535651+0000","last_unstale":"2023-10-08T12:00:21.855519+0000","last_undegraded":"2023-10-08T12:00:21.855519+0000","last_fullsized":"2023-10-08T12:00:21.855519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:50:34.635731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855128+0000","last_change":"2023-10-08T12:00:20.598434+0000","last_active":"2023-10-08T12:00:21.855128+0000","last_peered":"2023-10-08T12:00:21.855128+0000","last_clean":"2023-10-08T12:00:21.855128+0000","last_became_active":"2023-10-08T12:00:20.598046+0000","last_became_peered":"2023-10-08T12:00:20.598046+0000","last_unstale":"2023-10-08T12:00:21.855128+0000","last_undegraded":"2023-10-08T12:00:21.855128+0000","last_fullsized":"2023-10-08T12:00:21.855128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:10:09.509770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.603141+0000","last_change":"2023-10-08T12:00:19.522917+0000","last_active":"2023-10-08T12:00:21.603141+0000","last_peered":"2023-10-08T12:00:21.603141+0000","last_clean":"2023-10-08T12:00:21.603141+0000","last_became_active":"2023-10-08T12:00:19.522172+0000","last_became_peered":"2023-10-08T12:00:19.522172+0000","last_unstale":"2023-10-08T12:00:21.603141+0000","last_undegraded":"2023-10-08T12:00:21.603141+0000","last_fullsized":"2023-10-08T12:00:21.603141+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:51:26.897821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.632418+0000","last_change":"2023-10-08T12:00:20.626570+0000","last_active":"2023-10-08T12:00:21.632418+0000","last_peered":"2023-10-08T12:00:21.632418+0000","last_clean":"2023-10-08T12:00:21.632418+0000","last_became_active":"2023-10-08T12:00:20.625928+0000","last_became_peered":"2023-10-08T12:00:20.625928+0000","last_unstale":"2023-10-08T12:00:21.632418+0000","last_undegraded":"2023-10-08T12:00:21.632418+0000","last_fullsized":"2023-10-08T12:00:21.632418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:30:47.199431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855385+0000","last_change":"2023-10-08T12:00:19.545158+0000","last_active":"2023-10-08T12:00:21.855385+0000","last_peered":"2023-10-08T12:00:21.855385+0000","last_clean":"2023-10-08T12:00:21.855385+0000","last_became_active":"2023-10-08T12:00:19.544490+0000","last_became_peered":"2023-10-08T12:00:19.544490+0000","last_unstale":"2023-10-08T12:00:21.855385+0000","last_undegraded":"2023-10-08T12:00:21.855385+0000","last_fullsized":"2023-10-08T12:00:21.855385+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:27:03.535042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855412+0000","last_change":"2023-10-08T12:00:20.602776+0000","last_active":"2023-10-08T12:00:21.855412+0000","last_peered":"2023-10-08T12:00:21.855412+0000","last_clean":"2023-10-08T12:00:21.855412+0000","last_became_active":"2023-10-08T12:00:20.601726+0000","last_became_peered":"2023-10-08T12:00:20.601726+0000","last_unstale":"2023-10-08T12:00:21.855412+0000","last_undegraded":"2023-10-08T12:00:21.855412+0000","last_fullsized":"2023-10-08T12:00:21.855412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:30:14.921064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.640174+0000","last_change":"2023-10-08T12:00:19.525010+0000","last_active":"2023-10-08T12:00:21.640174+0000","last_peered":"2023-10-08T12:00:21.640174+0000","last_clean":"2023-10-08T12:00:21.640174+0000","last_became_active":"2023-10-08T12:00:19.524689+0000","last_became_peered":"2023-10-08T12:00:19.524689+0000","last_unstale":"2023-10-08T12:00:21.640174+0000","last_undegraded":"2023-10-08T12:00:21.640174+0000","last_fullsized":"2023-10-08T12:00:21.640174+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:39:17.089135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.631709+0000","last_change":"2023-10-08T12:00:20.624644+0000","last_active":"2023-10-08T12:00:21.631709+0000","last_peered":"2023-10-08T12:00:21.631709+0000","last_clean":"2023-10-08T12:00:21.631709+0000","last_became_active":"2023-10-08T12:00:20.623936+0000","last_became_peered":"2023-10-08T12:00:20.623936+0000","last_unstale":"2023-10-08T12:00:21.631709+0000","last_undegraded":"2023-10-08T12:00:21.631709+0000","last_fullsized":"2023-10-08T12:00:21.631709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:57:40.359987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.602477+0000","last_change":"2023-10-08T12:00:19.525128+0000","last_active":"2023-10-08T12:00:21.602477+0000","last_peered":"2023-10-08T12:00:21.602477+0000","last_clean":"2023-10-08T12:00:21.602477+0000","last_became_active":"2023-10-08T12:00:19.524428+0000","last_became_peered":"2023-10-08T12:00:19.524428+0000","last_unstale":"2023-10-08T12:00:21.602477+0000","last_undegraded":"2023-10-08T12:00:21.602477+0000","last_fullsized":"2023-10-08T12:00:21.602477+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:28:30.235998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.632464+0000","last_change":"2023-10-08T12:00:20.624158+0000","last_active":"2023-10-08T12:00:21.632464+0000","last_peered":"2023-10-08T12:00:21.632464+0000","last_clean":"2023-10-08T12:00:21.632464+0000","last_became_active":"2023-10-08T12:00:20.623663+0000","last_became_peered":"2023-10-08T12:00:20.623663+0000","last_unstale":"2023-10-08T12:00:21.632464+0000","last_undegraded":"2023-10-08T12:00:21.632464+0000","last_fullsized":"2023-10-08T12:00:21.632464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:35:25.862808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.640474+0000","last_change":"2023-10-08T12:00:19.521327+0000","last_active":"2023-10-08T12:00:21.640474+0000","last_peered":"2023-10-08T12:00:21.640474+0000","last_clean":"2023-10-08T12:00:21.640474+0000","last_became_active":"2023-10-08T12:00:19.520907+0000","last_became_peered":"2023-10-08T12:00:19.520907+0000","last_unstale":"2023-10-08T12:00:21.640474+0000","last_undegraded":"2023-10-08T12:00:21.640474+0000","last_fullsized":"2023-10-08T12:00:21.640474+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:17:52.345672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.632767+0000","last_change":"2023-10-08T12:00:20.631419+0000","last_active":"2023-10-08T12:00:21.632767+0000","last_peered":"2023-10-08T12:00:21.632767+0000","last_clean":"2023-10-08T12:00:21.632767+0000","last_became_active":"2023-10-08T12:00:20.630933+0000","last_became_peered":"2023-10-08T12:00:20.630933+0000","last_unstale":"2023-10-08T12:00:21.632767+0000","last_undegraded":"2023-10-08T12:00:21.632767+0000","last_fullsized":"2023-10-08T12:00:21.632767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:23:03.900263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.599639+0000","last_change":"2023-10-08T12:00:19.535778+0000","last_active":"2023-10-08T12:00:21.599639+0000","last_peered":"2023-10-08T12:00:21.599639+0000","last_clean":"2023-10-08T12:00:21.599639+0000","last_became_active":"2023-10-08T12:00:19.535463+0000","last_became_peered":"2023-10-08T12:00:19.535463+0000","last_unstale":"2023-10-08T12:00:21.599639+0000","last_undegraded":"2023-10-08T12:00:21.599639+0000","last_fullsized":"2023-10-08T12:00:21.599639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:06:50.282434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.602845+0000","last_change":"2023-10-08T12:00:20.590511+0000","last_active":"2023-10-08T12:00:21.602845+0000","last_peered":"2023-10-08T12:00:21.602845+0000","last_clean":"2023-10-08T12:00:21.602845+0000","last_became_active":"2023-10-08T12:00:20.589762+0000","last_became_peered":"2023-10-08T12:00:20.589762+0000","last_unstale":"2023-10-08T12:00:21.602845+0000","last_undegraded":"2023-10-08T12:00:21.602845+0000","last_fullsized":"2023-10-08T12:00:21.602845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:08:02.997033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.640487+0000","last_change":"2023-10-08T12:00:19.530223+0000","last_active":"2023-10-08T12:00:21.640487+0000","last_peered":"2023-10-08T12:00:21.640487+0000","last_clean":"2023-10-08T12:00:21.640487+0000","last_became_active":"2023-10-08T12:00:19.529830+0000","last_became_peered":"2023-10-08T12:00:19.529830+0000","last_unstale":"2023-10-08T12:00:21.640487+0000","last_undegraded":"2023-10-08T12:00:21.640487+0000","last_fullsized":"2023-10-08T12:00:21.640487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:47:56.523501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.632457+0000","last_change":"2023-10-08T12:00:20.626826+0000","last_active":"2023-10-08T12:00:21.632457+0000","last_peered":"2023-10-08T12:00:21.632457+0000","last_clean":"2023-10-08T12:00:21.632457+0000","last_became_active":"2023-10-08T12:00:20.624034+0000","last_became_peered":"2023-10-08T12:00:20.624034+0000","last_unstale":"2023-10-08T12:00:21.632457+0000","last_undegraded":"2023-10-08T12:00:21.632457+0000","last_fullsized":"2023-10-08T12:00:21.632457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:42:51.152070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T12:00:20.587986+0000","last_change":"2023-10-08T12:00:08.887559+0000","last_active":"2023-10-08T12:00:20.587986+0000","last_peered":"2023-10-08T12:00:20.587986+0000","last_clean":"2023-10-08T12:00:20.587986+0000","last_became_active":"2023-10-08T12:00:08.884794+0000","last_became_peered":"2023-10-08T12:00:08.884794+0000","last_unstale":"2023-10-08T12:00:20.587986+0000","last_undegraded":"2023-10-08T12:00:20.587986+0000","last_fullsized":"2023-10-08T12:00:20.587986+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:07.812869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:07.812869+0000","last_clean_scrub_stamp":"2023-10-08T12:00:07.812869+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:58:36.123159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.603377+0000","last_change":"2023-10-08T12:00:19.524401+0000","last_active":"2023-10-08T12:00:21.603377+0000","last_peered":"2023-10-08T12:00:21.603377+0000","last_clean":"2023-10-08T12:00:21.603377+0000","last_became_active":"2023-10-08T12:00:19.523604+0000","last_became_peered":"2023-10-08T12:00:19.523604+0000","last_unstale":"2023-10-08T12:00:21.603377+0000","last_undegraded":"2023-10-08T12:00:21.603377+0000","last_fullsized":"2023-10-08T12:00:21.603377+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:10:08.505747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.856444+0000","last_change":"2023-10-08T12:00:20.605554+0000","last_active":"2023-10-08T12:00:21.856444+0000","last_peered":"2023-10-08T12:00:21.856444+0000","last_clean":"2023-10-08T12:00:21.856444+0000","last_became_active":"2023-10-08T12:00:20.604329+0000","last_became_peered":"2023-10-08T12:00:20.604329+0000","last_unstale":"2023-10-08T12:00:21.856444+0000","last_undegraded":"2023-10-08T12:00:21.856444+0000","last_fullsized":"2023-10-08T12:00:21.856444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:54:25.498802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.631264+0000","last_change":"2023-10-08T12:00:19.552974+0000","last_active":"2023-10-08T12:00:21.631264+0000","last_peered":"2023-10-08T12:00:21.631264+0000","last_clean":"2023-10-08T12:00:21.631264+0000","last_became_active":"2023-10-08T12:00:19.552408+0000","last_became_peered":"2023-10-08T12:00:19.552408+0000","last_unstale":"2023-10-08T12:00:21.631264+0000","last_undegraded":"2023-10-08T12:00:21.631264+0000","last_fullsized":"2023-10-08T12:00:21.631264+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:37:44.353541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.854532+0000","last_change":"2023-10-08T12:00:20.609466+0000","last_active":"2023-10-08T12:00:21.854532+0000","last_peered":"2023-10-08T12:00:21.854532+0000","last_clean":"2023-10-08T12:00:21.854532+0000","last_became_active":"2023-10-08T12:00:20.609116+0000","last_became_peered":"2023-10-08T12:00:20.609116+0000","last_unstale":"2023-10-08T12:00:21.854532+0000","last_undegraded":"2023-10-08T12:00:21.854532+0000","last_fullsized":"2023-10-08T12:00:21.854532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:51:27.901843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.640292+0000","last_change":"2023-10-08T12:00:19.520729+0000","last_active":"2023-10-08T12:00:21.640292+0000","last_peered":"2023-10-08T12:00:21.640292+0000","last_clean":"2023-10-08T12:00:21.640292+0000","last_became_active":"2023-10-08T12:00:19.520254+0000","last_became_peered":"2023-10-08T12:00:19.520254+0000","last_unstale":"2023-10-08T12:00:21.640292+0000","last_undegraded":"2023-10-08T12:00:21.640292+0000","last_fullsized":"2023-10-08T12:00:21.640292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:50:34.635731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.598860+0000","last_change":"2023-10-08T12:00:20.591873+0000","last_active":"2023-10-08T12:00:21.598860+0000","last_peered":"2023-10-08T12:00:21.598860+0000","last_clean":"2023-10-08T12:00:21.598860+0000","last_became_active":"2023-10-08T12:00:20.591431+0000","last_became_peered":"2023-10-08T12:00:20.591431+0000","last_unstale":"2023-10-08T12:00:21.598860+0000","last_undegraded":"2023-10-08T12:00:21.598860+0000","last_fullsized":"2023-10-08T12:00:21.598860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:54:25.498802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.603246+0000","last_change":"2023-10-08T12:00:19.530940+0000","last_active":"2023-10-08T12:00:21.603246+0000","last_peered":"2023-10-08T12:00:21.603246+0000","last_clean":"2023-10-08T12:00:21.603246+0000","last_became_active":"2023-10-08T12:00:19.530216+0000","last_became_peered":"2023-10-08T12:00:19.530216+0000","last_unstale":"2023-10-08T12:00:21.603246+0000","last_undegraded":"2023-10-08T12:00:21.603246+0000","last_fullsized":"2023-10-08T12:00:21.603246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:45:15.530667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.602773+0000","last_change":"2023-10-08T12:00:20.584188+0000","last_active":"2023-10-08T12:00:21.602773+0000","last_peered":"2023-10-08T12:00:21.602773+0000","last_clean":"2023-10-08T12:00:21.602773+0000","last_became_active":"2023-10-08T12:00:20.583209+0000","last_became_peered":"2023-10-08T12:00:20.583209+0000","last_unstale":"2023-10-08T12:00:21.602773+0000","last_undegraded":"2023-10-08T12:00:21.602773+0000","last_fullsized":"2023-10-08T12:00:21.602773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:51:27.901843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.599342+0000","last_change":"2023-10-08T12:00:19.525924+0000","last_active":"2023-10-08T12:00:21.599342+0000","last_peered":"2023-10-08T12:00:21.599342+0000","last_clean":"2023-10-08T12:00:21.599342+0000","last_became_active":"2023-10-08T12:00:19.525508+0000","last_became_peered":"2023-10-08T12:00:19.525508+0000","last_unstale":"2023-10-08T12:00:21.599342+0000","last_undegraded":"2023-10-08T12:00:21.599342+0000","last_fullsized":"2023-10-08T12:00:21.599342+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:51:26.897821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.604521+0000","last_change":"2023-10-08T12:00:20.591551+0000","last_active":"2023-10-08T12:00:21.604521+0000","last_peered":"2023-10-08T12:00:21.604521+0000","last_clean":"2023-10-08T12:00:21.604521+0000","last_became_active":"2023-10-08T12:00:20.589572+0000","last_became_peered":"2023-10-08T12:00:20.589572+0000","last_unstale":"2023-10-08T12:00:21.604521+0000","last_undegraded":"2023-10-08T12:00:21.604521+0000","last_fullsized":"2023-10-08T12:00:21.604521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:22:34.137787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.632679+0000","last_change":"2023-10-08T12:00:19.555017+0000","last_active":"2023-10-08T12:00:21.632679+0000","last_peered":"2023-10-08T12:00:21.632679+0000","last_clean":"2023-10-08T12:00:21.632679+0000","last_became_active":"2023-10-08T12:00:19.554451+0000","last_became_peered":"2023-10-08T12:00:19.554451+0000","last_unstale":"2023-10-08T12:00:21.632679+0000","last_undegraded":"2023-10-08T12:00:21.632679+0000","last_fullsized":"2023-10-08T12:00:21.632679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:54:06.443638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.599236+0000","last_change":"2023-10-08T12:00:20.595603+0000","last_active":"2023-10-08T12:00:21.599236+0000","last_peered":"2023-10-08T12:00:21.599236+0000","last_clean":"2023-10-08T12:00:21.599236+0000","last_became_active":"2023-10-08T12:00:20.595176+0000","last_became_peered":"2023-10-08T12:00:20.595176+0000","last_unstale":"2023-10-08T12:00:21.599236+0000","last_undegraded":"2023-10-08T12:00:21.599236+0000","last_fullsized":"2023-10-08T12:00:21.599236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:46:22.522999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:22.583156+0000","last_change":"2023-10-08T12:00:19.542919+0000","last_active":"2023-10-08T12:00:22.583156+0000","last_peered":"2023-10-08T12:00:22.583156+0000","last_clean":"2023-10-08T12:00:22.583156+0000","last_became_active":"2023-10-08T12:00:19.542518+0000","last_became_peered":"2023-10-08T12:00:19.542518+0000","last_unstale":"2023-10-08T12:00:22.583156+0000","last_undegraded":"2023-10-08T12:00:22.583156+0000","last_fullsized":"2023-10-08T12:00:22.583156+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:10:08.505747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.857089+0000","last_change":"2023-10-08T12:00:20.625910+0000","last_active":"2023-10-08T12:00:21.857089+0000","last_peered":"2023-10-08T12:00:21.857089+0000","last_clean":"2023-10-08T12:00:21.857089+0000","last_became_active":"2023-10-08T12:00:20.625608+0000","last_became_peered":"2023-10-08T12:00:20.625608+0000","last_unstale":"2023-10-08T12:00:21.857089+0000","last_undegraded":"2023-10-08T12:00:21.857089+0000","last_fullsized":"2023-10-08T12:00:21.857089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:53:47.853039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.856048+0000","last_change":"2023-10-08T12:00:19.553242+0000","last_active":"2023-10-08T12:00:21.856048+0000","last_peered":"2023-10-08T12:00:21.856048+0000","last_clean":"2023-10-08T12:00:21.856048+0000","last_became_active":"2023-10-08T12:00:19.552693+0000","last_became_peered":"2023-10-08T12:00:19.552693+0000","last_unstale":"2023-10-08T12:00:21.856048+0000","last_undegraded":"2023-10-08T12:00:21.856048+0000","last_fullsized":"2023-10-08T12:00:21.856048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:51:26.897821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855831+0000","last_change":"2023-10-08T12:00:20.591317+0000","last_active":"2023-10-08T12:00:21.855831+0000","last_peered":"2023-10-08T12:00:21.855831+0000","last_clean":"2023-10-08T12:00:21.855831+0000","last_became_active":"2023-10-08T12:00:20.591008+0000","last_became_peered":"2023-10-08T12:00:20.591008+0000","last_unstale":"2023-10-08T12:00:21.855831+0000","last_undegraded":"2023-10-08T12:00:21.855831+0000","last_fullsized":"2023-10-08T12:00:21.855831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:54:07.447661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.631260+0000","last_change":"2023-10-08T12:00:19.554635+0000","last_active":"2023-10-08T12:00:21.631260+0000","last_peered":"2023-10-08T12:00:21.631260+0000","last_clean":"2023-10-08T12:00:21.631260+0000","last_became_active":"2023-10-08T12:00:19.553990+0000","last_became_peered":"2023-10-08T12:00:19.553990+0000","last_unstale":"2023-10-08T12:00:21.631260+0000","last_undegraded":"2023-10-08T12:00:21.631260+0000","last_fullsized":"2023-10-08T12:00:21.631260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:50:34.635731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.601954+0000","last_change":"2023-10-08T12:00:20.596182+0000","last_active":"2023-10-08T12:00:21.601954+0000","last_peered":"2023-10-08T12:00:21.601954+0000","last_clean":"2023-10-08T12:00:21.601954+0000","last_became_active":"2023-10-08T12:00:20.595333+0000","last_became_peered":"2023-10-08T12:00:20.595333+0000","last_unstale":"2023-10-08T12:00:21.601954+0000","last_undegraded":"2023-10-08T12:00:21.601954+0000","last_fullsized":"2023-10-08T12:00:21.601954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:27:04.539065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.598828+0000","last_change":"2023-10-08T12:00:19.552883+0000","last_active":"2023-10-08T12:00:21.598828+0000","last_peered":"2023-10-08T12:00:21.598828+0000","last_clean":"2023-10-08T12:00:21.598828+0000","last_became_active":"2023-10-08T12:00:19.552343+0000","last_became_peered":"2023-10-08T12:00:19.552343+0000","last_unstale":"2023-10-08T12:00:21.598828+0000","last_undegraded":"2023-10-08T12:00:21.598828+0000","last_fullsized":"2023-10-08T12:00:21.598828+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:37:27.924905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855959+0000","last_change":"2023-10-08T12:00:20.593145+0000","last_active":"2023-10-08T12:00:21.855959+0000","last_peered":"2023-10-08T12:00:21.855959+0000","last_clean":"2023-10-08T12:00:21.855959+0000","last_became_active":"2023-10-08T12:00:20.592778+0000","last_became_peered":"2023-10-08T12:00:20.592778+0000","last_unstale":"2023-10-08T12:00:21.855959+0000","last_undegraded":"2023-10-08T12:00:21.855959+0000","last_fullsized":"2023-10-08T12:00:21.855959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:22:42.527070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.599800+0000","last_change":"2023-10-08T12:00:19.524846+0000","last_active":"2023-10-08T12:00:21.599800+0000","last_peered":"2023-10-08T12:00:21.599800+0000","last_clean":"2023-10-08T12:00:21.599800+0000","last_became_active":"2023-10-08T12:00:19.524431+0000","last_became_peered":"2023-10-08T12:00:19.524431+0000","last_unstale":"2023-10-08T12:00:21.599800+0000","last_undegraded":"2023-10-08T12:00:21.599800+0000","last_fullsized":"2023-10-08T12:00:21.599800+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:45:15.530667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.856621+0000","last_change":"2023-10-08T12:00:20.603921+0000","last_active":"2023-10-08T12:00:21.856621+0000","last_peered":"2023-10-08T12:00:21.856621+0000","last_clean":"2023-10-08T12:00:21.856621+0000","last_became_active":"2023-10-08T12:00:20.601742+0000","last_became_peered":"2023-10-08T12:00:20.601742+0000","last_unstale":"2023-10-08T12:00:21.856621+0000","last_undegraded":"2023-10-08T12:00:21.856621+0000","last_fullsized":"2023-10-08T12:00:21.856621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:55:19.542748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.632096+0000","last_change":"2023-10-08T12:00:19.554323+0000","last_active":"2023-10-08T12:00:21.632096+0000","last_peered":"2023-10-08T12:00:21.632096+0000","last_clean":"2023-10-08T12:00:21.632096+0000","last_became_active":"2023-10-08T12:00:19.553748+0000","last_became_peered":"2023-10-08T12:00:19.553748+0000","last_unstale":"2023-10-08T12:00:21.632096+0000","last_undegraded":"2023-10-08T12:00:21.632096+0000","last_fullsized":"2023-10-08T12:00:21.632096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:51:26.897821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855418+0000","last_change":"2023-10-08T12:00:20.613066+0000","last_active":"2023-10-08T12:00:21.855418+0000","last_peered":"2023-10-08T12:00:21.855418+0000","last_clean":"2023-10-08T12:00:21.855418+0000","last_became_active":"2023-10-08T12:00:20.612422+0000","last_became_peered":"2023-10-08T12:00:20.612422+0000","last_unstale":"2023-10-08T12:00:21.855418+0000","last_undegraded":"2023-10-08T12:00:21.855418+0000","last_fullsized":"2023-10-08T12:00:21.855418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:22:42.527070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.604197+0000","last_change":"2023-10-08T12:00:20.607333+0000","last_active":"2023-10-08T12:00:21.604197+0000","last_peered":"2023-10-08T12:00:21.604197+0000","last_clean":"2023-10-08T12:00:21.604197+0000","last_became_active":"2023-10-08T12:00:20.606634+0000","last_became_peered":"2023-10-08T12:00:20.606634+0000","last_unstale":"2023-10-08T12:00:21.604197+0000","last_undegraded":"2023-10-08T12:00:21.604197+0000","last_fullsized":"2023-10-08T12:00:21.604197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:35:25.862808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.631868+0000","last_change":"2023-10-08T12:00:19.553120+0000","last_active":"2023-10-08T12:00:21.631868+0000","last_peered":"2023-10-08T12:00:21.631868+0000","last_clean":"2023-10-08T12:00:21.631868+0000","last_became_active":"2023-10-08T12:00:19.552479+0000","last_became_peered":"2023-10-08T12:00:19.552479+0000","last_unstale":"2023-10-08T12:00:21.631868+0000","last_undegraded":"2023-10-08T12:00:21.631868+0000","last_fullsized":"2023-10-08T12:00:21.631868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:35:48.346462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.602591+0000","last_change":"2023-10-08T12:00:20.607581+0000","last_active":"2023-10-08T12:00:21.602591+0000","last_peered":"2023-10-08T12:00:21.602591+0000","last_clean":"2023-10-08T12:00:21.602591+0000","last_became_active":"2023-10-08T12:00:20.606887+0000","last_became_peered":"2023-10-08T12:00:20.606887+0000","last_unstale":"2023-10-08T12:00:21.602591+0000","last_undegraded":"2023-10-08T12:00:21.602591+0000","last_fullsized":"2023-10-08T12:00:21.602591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:53:47.853039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.632291+0000","last_change":"2023-10-08T12:00:19.555477+0000","last_active":"2023-10-08T12:00:21.632291+0000","last_peered":"2023-10-08T12:00:21.632291+0000","last_clean":"2023-10-08T12:00:21.632291+0000","last_became_active":"2023-10-08T12:00:19.553643+0000","last_became_peered":"2023-10-08T12:00:19.553643+0000","last_unstale":"2023-10-08T12:00:21.632291+0000","last_undegraded":"2023-10-08T12:00:21.632291+0000","last_fullsized":"2023-10-08T12:00:21.632291+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:30:13.917041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855050+0000","last_change":"2023-10-08T12:00:20.576541+0000","last_active":"2023-10-08T12:00:21.855050+0000","last_peered":"2023-10-08T12:00:21.855050+0000","last_clean":"2023-10-08T12:00:21.855050+0000","last_became_active":"2023-10-08T12:00:20.575715+0000","last_became_peered":"2023-10-08T12:00:20.575715+0000","last_unstale":"2023-10-08T12:00:21.855050+0000","last_undegraded":"2023-10-08T12:00:21.855050+0000","last_fullsized":"2023-10-08T12:00:21.855050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:45:16.534690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.857043+0000","last_change":"2023-10-08T12:00:19.524299+0000","last_active":"2023-10-08T12:00:21.857043+0000","last_peered":"2023-10-08T12:00:21.857043+0000","last_clean":"2023-10-08T12:00:21.857043+0000","last_became_active":"2023-10-08T12:00:19.523979+0000","last_became_peered":"2023-10-08T12:00:19.523979+0000","last_unstale":"2023-10-08T12:00:21.857043+0000","last_undegraded":"2023-10-08T12:00:21.857043+0000","last_fullsized":"2023-10-08T12:00:21.857043+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:06:50.282434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.856602+0000","last_change":"2023-10-08T12:00:20.621615+0000","last_active":"2023-10-08T12:00:21.856602+0000","last_peered":"2023-10-08T12:00:21.856602+0000","last_clean":"2023-10-08T12:00:21.856602+0000","last_became_active":"2023-10-08T12:00:20.621249+0000","last_became_peered":"2023-10-08T12:00:20.621249+0000","last_unstale":"2023-10-08T12:00:21.856602+0000","last_undegraded":"2023-10-08T12:00:21.856602+0000","last_fullsized":"2023-10-08T12:00:21.856602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:19.490069+0000","last_clean_scrub_stamp":"2023-10-08T12:00:19.490069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:46:22.522999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T12:00:21.855793+0000","last_change":"2023-10-08T12:00:19.546557+0000","last_active":"2023-10-08T12:00:21.855793+0000","last_peered":"2023-10-08T12:00:21.855793+0000","last_clean":"2023-10-08T12:00:21.855793+0000","last_became_active":"2023-10-08T12:00:19.546297+0000","last_became_peered":"2023-10-08T12:00:19.546297+0000","last_unstale":"2023-10-08T12:00:21.855793+0000","last_undegraded":"2023-10-08T12:00:21.855793+0000","last_fullsized":"2023-10-08T12:00:21.855793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:18.486046+0000","last_clean_scrub_stamp":"2023-10-08T12:00:18.486046+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:37:27.924905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":661848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0920000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.052}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.133}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92400000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.351}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":72510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0880000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0549999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":208896,"data_stored":70988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.214}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2749999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4019999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1659999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.103}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.21}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3819999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1559999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1930000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":70898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.085}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.123}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.012}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0640000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.022}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":811008,"data_stored":661904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T12:00:29.534 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-08T12:00:29.534 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-08T12:00:29.534 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-08T12:00:29.535 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-08T12:00:29.684 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.675+0000 7f60c7e42640 1 -- 172.21.15.62:0/487991173 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f60c00b99e0 msgr2=0x7f60c009d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:29.684 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.675+0000 7f60c7e42640 1 --2- 172.21.15.62:0/487991173 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f60c00b99e0 0x7f60c009d040 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f60c0068d00 tx=0x7f60b801c8a0 comp rx=0 tx=0).stop 2023-10-08T12:00:29.684 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.675+0000 7f60c7e42640 1 -- 172.21.15.62:0/487991173 shutdown_connections 2023-10-08T12:00:29.684 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.675+0000 7f60c7e42640 1 --2- 172.21.15.62:0/487991173 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f60c00b5c20 0x7f60c0149910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:29.684 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.675+0000 7f60c7e42640 1 --2- 172.21.15.62:0/487991173 >> v2:172.21.15.130:3300/0 conn(0x7f60c00b5170 0x7f60c00b56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:29.685 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.675+0000 7f60c7e42640 1 --2- 172.21.15.62:0/487991173 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f60c00b99e0 0x7f60c009d040 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:29.685 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.675+0000 7f60c7e42640 1 -- 172.21.15.62:0/487991173 >> 172.21.15.62:0/487991173 conn(0x7f60c009c520 msgr2=0x7f60c009c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:29.685 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.675+0000 7f60c7e42640 1 -- 172.21.15.62:0/487991173 shutdown_connections 2023-10-08T12:00:29.685 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.675+0000 7f60c7e42640 1 -- 172.21.15.62:0/487991173 wait complete. 2023-10-08T12:00:29.685 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.679+0000 7f60c7e42640 1 Processor -- start 2023-10-08T12:00:29.685 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.679+0000 7f60c7e42640 1 -- start start 2023-10-08T12:00:29.685 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.679+0000 7f60c7e42640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f60c00b5170 0x7f60c0140180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:29.685 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.679+0000 7f60c7e42640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f60c00b5c20 0x7f60c006f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:29.686 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.679+0000 7f60c7e42640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f60c00b99e0 0x7f60c006f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:29.686 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.679+0000 7f60c7e42640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60c009e060 con 0x7f60c00b99e0 2023-10-08T12:00:29.686 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.679+0000 7f60c7e42640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60c01406c0 con 0x7f60c00b5170 2023-10-08T12:00:29.686 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.679+0000 7f60c7e42640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60c01e3520 con 0x7f60c00b5c20 2023-10-08T12:00:29.686 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.679+0000 7f60c63df640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f60c00b99e0 0x7f60c006f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:29.686 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.679+0000 7f60c63df640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f60c00b99e0 0x7f60c006f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:44024/0 (socket says 172.21.15.62:44024) 2023-10-08T12:00:29.686 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.679+0000 7f60c63df640 1 -- 172.21.15.62:0/4277329063 learned_addr learned my addr 172.21.15.62:0/4277329063 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:29.686 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.679+0000 7f60c53dd640 1 --2- 172.21.15.62:0/4277329063 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f60c00b5c20 0x7f60c006f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:29.687 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.679+0000 7f60c5bde640 1 --2- 172.21.15.62:0/4277329063 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f60c00b5170 0x7f60c0140180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:29.687 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.679+0000 7f60c63df640 1 -- 172.21.15.62:0/4277329063 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f60c00b5c20 msgr2=0x7f60c006f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:29.687 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.679+0000 7f60c63df640 1 --2- 172.21.15.62:0/4277329063 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f60c00b5c20 0x7f60c006f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:29.687 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.679+0000 7f60c63df640 1 -- 172.21.15.62:0/4277329063 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f60c00b5170 msgr2=0x7f60c0140180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:29.687 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.679+0000 7f60c63df640 1 --2- 172.21.15.62:0/4277329063 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f60c00b5170 0x7f60c0140180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:29.687 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.679+0000 7f60c63df640 1 -- 172.21.15.62:0/4277329063 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60b8009560 con 0x7f60c00b99e0 2023-10-08T12:00:29.687 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.679+0000 7f60c63df640 1 --2- 172.21.15.62:0/4277329063 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f60c00b99e0 0x7f60c006f740 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f60b000cce0 tx=0x7f60b000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:29.687 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.679+0000 7f60be7fc640 1 -- 172.21.15.62:0/4277329063 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b0004b30 con 0x7f60c00b99e0 2023-10-08T12:00:29.688 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.679+0000 7f60be7fc640 1 -- 172.21.15.62:0/4277329063 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f60b0004d80 con 0x7f60c00b99e0 2023-10-08T12:00:29.688 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.679+0000 7f60c7e42640 1 -- 172.21.15.62:0/4277329063 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60c01e3770 con 0x7f60c00b99e0 2023-10-08T12:00:29.688 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.679+0000 7f60be7fc640 1 -- 172.21.15.62:0/4277329063 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b0005280 con 0x7f60c00b99e0 2023-10-08T12:00:29.688 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.679+0000 7f60c7e42640 1 -- 172.21.15.62:0/4277329063 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60c01e3d30 con 0x7f60c00b99e0 2023-10-08T12:00:29.688 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.679+0000 7f60c7e42640 1 -- 172.21.15.62:0/4277329063 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60c004da80 con 0x7f60c00b99e0 2023-10-08T12:00:29.688 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.679+0000 7f60be7fc640 1 -- 172.21.15.62:0/4277329063 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f60b00053e0 con 0x7f60c00b99e0 2023-10-08T12:00:29.689 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.679+0000 7f60be7fc640 1 --2- 172.21.15.62:0/4277329063 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f60ac0664a0 0x7f60ac068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:29.689 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.679+0000 7f60be7fc640 1 -- 172.21.15.62:0/4277329063 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f60b0084680 con 0x7f60c00b99e0 2023-10-08T12:00:29.689 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.679+0000 7f60c5bde640 1 --2- 172.21.15.62:0/4277329063 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f60ac0664a0 0x7f60ac068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:29.689 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.683+0000 7f60c5bde640 1 --2- 172.21.15.62:0/4277329063 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f60ac0664a0 0x7f60ac068960 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f60b80af000 tx=0x7f60b801b0e0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:29.689 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.683+0000 7f60be7fc640 1 -- 172.21.15.62:0/4277329063 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f60b0051b00 con 0x7f60c00b99e0 2023-10-08T12:00:29.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.867+0000 7f60c7e42640 1 -- 172.21.15.62:0/4277329063 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f60c0140840 con 0x7f60c00b99e0 2023-10-08T12:00:29.872 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.867+0000 7f60be7fc640 1 -- 172.21.15.62:0/4277329063 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f60b0055120 con 0x7f60c00b99e0 2023-10-08T12:00:29.872 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T12:00:29.872 INFO:teuthology.orchestra.run.smithi062.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-08T12:00:29.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.871+0000 7f60c7e42640 1 -- 172.21.15.62:0/4277329063 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f60ac0664a0 msgr2=0x7f60ac068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:29.875 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.871+0000 7f60c7e42640 1 --2- 172.21.15.62:0/4277329063 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f60ac0664a0 0x7f60ac068960 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f60b80af000 tx=0x7f60b801b0e0 comp rx=0 tx=0).stop 2023-10-08T12:00:29.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.871+0000 7f60c7e42640 1 -- 172.21.15.62:0/4277329063 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f60c00b99e0 msgr2=0x7f60c006f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:29.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.871+0000 7f60c7e42640 1 --2- 172.21.15.62:0/4277329063 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f60c00b99e0 0x7f60c006f740 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f60b000cce0 tx=0x7f60b000a620 comp rx=0 tx=0).stop 2023-10-08T12:00:29.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.871+0000 7f60c7e42640 1 -- 172.21.15.62:0/4277329063 shutdown_connections 2023-10-08T12:00:29.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.871+0000 7f60c7e42640 1 --2- 172.21.15.62:0/4277329063 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f60ac0664a0 0x7f60ac068960 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:29.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.871+0000 7f60c7e42640 1 --2- 172.21.15.62:0/4277329063 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f60c00b5c20 0x7f60c006f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:29.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.871+0000 7f60c7e42640 1 --2- 172.21.15.62:0/4277329063 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f60c00b99e0 0x7f60c006f740 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:29.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.871+0000 7f60c7e42640 1 --2- 172.21.15.62:0/4277329063 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f60c00b5170 0x7f60c0140180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:29.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.871+0000 7f60c7e42640 1 -- 172.21.15.62:0/4277329063 >> 172.21.15.62:0/4277329063 conn(0x7f60c009c520 msgr2=0x7f60c013c790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:29.877 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.871+0000 7f60c7e42640 1 -- 172.21.15.62:0/4277329063 shutdown_connections 2023-10-08T12:00:29.877 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:29.871+0000 7f60c7e42640 1 -- 172.21.15.62:0/4277329063 wait complete. 2023-10-08T12:00:29.890 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-08T12:00:29.891 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:00:30.015 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.011+0000 7fa4137cf640 1 -- 172.21.15.62:0/494557471 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa40c0a08b0 msgr2=0x7fa40c0b6b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:30.015 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.011+0000 7fa4137cf640 1 --2- 172.21.15.62:0/494557471 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa40c0a08b0 0x7fa40c0b6b20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa408009840 tx=0x7fa40801c6e0 comp rx=0 tx=0).stop 2023-10-08T12:00:30.015 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.011+0000 7fa4137cf640 1 -- 172.21.15.62:0/494557471 shutdown_connections 2023-10-08T12:00:30.015 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.011+0000 7fa4137cf640 1 --2- 172.21.15.62:0/494557471 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa40c065920 0x7fa40c150540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:30.015 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.011+0000 7fa4137cf640 1 --2- 172.21.15.62:0/494557471 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa40c0a08b0 0x7fa40c0b6b20 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:30.015 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.011+0000 7fa4137cf640 1 -- 172.21.15.62:0/494557471 >> 172.21.15.62:0/494557471 conn(0x7fa40c0b7b10 msgr2=0x7fa40c0b7f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:30.015 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.011+0000 7fa4137cf640 1 -- 172.21.15.62:0/494557471 shutdown_connections 2023-10-08T12:00:30.016 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.011+0000 7fa4137cf640 1 -- 172.21.15.62:0/494557471 wait complete. 2023-10-08T12:00:30.016 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.011+0000 7fa4137cf640 1 Processor -- start 2023-10-08T12:00:30.016 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.011+0000 7fa4137cf640 1 -- start start 2023-10-08T12:00:30.018 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.011+0000 7fa4137cf640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa40c065920 0x7fa40c13f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:30.018 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.011+0000 7fa4137cf640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa40c0a08b0 0x7fa40c0b2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:30.018 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.011+0000 7fa4137cf640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa40c0a0c90 0x7fa40c1391a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:30.018 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.011+0000 7fa4137cf640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa40c13f800 con 0x7fa40c0a08b0 2023-10-08T12:00:30.019 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.011+0000 7fa4137cf640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa40c1e4650 con 0x7fa40c0a0c90 2023-10-08T12:00:30.019 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.011+0000 7fa4137cf640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa40c1e3890 con 0x7fa40c065920 2023-10-08T12:00:30.019 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.011+0000 7fa410d6a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa40c0a08b0 0x7fa40c0b2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:30.019 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.011+0000 7fa410d6a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa40c0a08b0 0x7fa40c0b2ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:44032/0 (socket says 172.21.15.62:44032) 2023-10-08T12:00:30.019 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.011+0000 7fa410d6a640 1 -- 172.21.15.62:0/2378290194 learned_addr learned my addr 172.21.15.62:0/2378290194 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:30.019 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.011+0000 7fa41156b640 1 --2- 172.21.15.62:0/2378290194 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa40c065920 0x7fa40c13f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:30.019 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.011+0000 7fa411d6c640 1 --2- 172.21.15.62:0/2378290194 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa40c0a0c90 0x7fa40c1391a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:30.019 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.011+0000 7fa410d6a640 1 -- 172.21.15.62:0/2378290194 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa40c065920 msgr2=0x7fa40c13f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:30.019 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.011+0000 7fa410d6a640 1 --2- 172.21.15.62:0/2378290194 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa40c065920 0x7fa40c13f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:30.019 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.011+0000 7fa410d6a640 1 -- 172.21.15.62:0/2378290194 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa40c0a0c90 msgr2=0x7fa40c1391a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:30.019 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.011+0000 7fa410d6a640 1 --2- 172.21.15.62:0/2378290194 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa40c0a0c90 0x7fa40c1391a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:30.020 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.011+0000 7fa410d6a640 1 -- 172.21.15.62:0/2378290194 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa404009820 con 0x7fa40c0a08b0 2023-10-08T12:00:30.020 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.011+0000 7fa41156b640 1 --2- 172.21.15.62:0/2378290194 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa40c065920 0x7fa40c13f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:00:30.020 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.015+0000 7fa410d6a640 1 --2- 172.21.15.62:0/2378290194 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa40c0a08b0 0x7fa40c0b2ca0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc00c310 tx=0x7fa3fc00c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:30.020 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.015+0000 7fa401ffb640 1 -- 172.21.15.62:0/2378290194 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3fc004230 con 0x7fa40c0a08b0 2023-10-08T12:00:30.020 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.015+0000 7fa401ffb640 1 -- 172.21.15.62:0/2378290194 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa3fc0044a0 con 0x7fa40c0a08b0 2023-10-08T12:00:30.020 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.015+0000 7fa4137cf640 1 -- 172.21.15.62:0/2378290194 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4080094a0 con 0x7fa40c0a08b0 2023-10-08T12:00:30.020 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.015+0000 7fa401ffb640 1 -- 172.21.15.62:0/2378290194 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3fc005260 con 0x7fa40c0a08b0 2023-10-08T12:00:30.020 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.015+0000 7fa4137cf640 1 -- 172.21.15.62:0/2378290194 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa40c1e3e50 con 0x7fa40c0a08b0 2023-10-08T12:00:30.021 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.015+0000 7fa4137cf640 1 -- 172.21.15.62:0/2378290194 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa40c0739e0 con 0x7fa40c0a08b0 2023-10-08T12:00:30.021 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.015+0000 7fa401ffb640 1 -- 172.21.15.62:0/2378290194 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa3fc0053c0 con 0x7fa40c0a08b0 2023-10-08T12:00:30.021 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.015+0000 7fa401ffb640 1 --2- 172.21.15.62:0/2378290194 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fa3f0066470 0x7fa3f0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:30.021 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.015+0000 7fa401ffb640 1 -- 172.21.15.62:0/2378290194 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa3fc0833a0 con 0x7fa40c0a08b0 2023-10-08T12:00:30.021 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.015+0000 7fa41156b640 1 --2- 172.21.15.62:0/2378290194 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fa3f0066470 0x7fa3f0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:30.022 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.015+0000 7fa41156b640 1 --2- 172.21.15.62:0/2378290194 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fa3f0066470 0x7fa3f0068930 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa4080ae000 tx=0x7fa4080b3040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:30.024 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.019+0000 7fa401ffb640 1 -- 172.21.15.62:0/2378290194 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa3fc050820 con 0x7fa40c0a08b0 2023-10-08T12:00:30.181 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.175+0000 7fa4137cf640 1 -- 172.21.15.62:0/2378290194 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa40c0b7650 con 0x7fa40c0a08b0 2023-10-08T12:00:30.183 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.179+0000 7fa401ffb640 1 -- 172.21.15.62:0/2378290194 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16481 (secure 0 0 0) 0x7fa3fc053e40 con 0x7fa40c0a08b0 2023-10-08T12:00:30.184 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T12:00:30.184 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":20,"fsid":"3e777930-c2c1-4f2b-a903-c07ee4ca2c52","created":"2023-10-08T11:59:54.510229+0000","modified":"2023-10-08T12:00:21.580704+0000","last_up_change":"2023-10-08T12:00:06.783998+0000","last_in_change":"2023-10-08T11:59:57.847944+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:00:07.189433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:00:17.895548+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T12:00:18.871217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7bc3070a-7240-43d9-9ec3-397b68a37e2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6820","nonce":2227876905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6824","nonce":2227876905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6831","nonce":2227876905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6828","nonce":2227876905}]},"public_addr":"172.21.15.62:6820/2227876905","cluster_addr":"172.21.15.62:6824/2227876905","heartbeat_back_addr":"172.21.15.62:6831/2227876905","heartbeat_front_addr":"172.21.15.62:6828/2227876905","state":["exists","up"]},{"osd":1,"uuid":"5e0fa1f5-9ddc-4882-b460-5578bb571003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6801","nonce":315660906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6803","nonce":315660906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6808","nonce":315660906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6805","nonce":315660906}]},"public_addr":"172.21.15.62:6801/315660906","cluster_addr":"172.21.15.62:6803/315660906","heartbeat_back_addr":"172.21.15.62:6808/315660906","heartbeat_front_addr":"172.21.15.62:6805/315660906","state":["exists","up"]},{"osd":2,"uuid":"262b5ee9-4243-4309-a14f-88ad4e8bf812","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6807","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6809","nonce":3784842938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6811","nonce":3784842938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6815","nonce":3784842938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6813","nonce":3784842938}]},"public_addr":"172.21.15.62:6809/3784842938","cluster_addr":"172.21.15.62:6811/3784842938","heartbeat_back_addr":"172.21.15.62:6815/3784842938","heartbeat_front_addr":"172.21.15.62:6813/3784842938","state":["exists","up"]},{"osd":3,"uuid":"1770bdb8-c12b-43b1-aaab-1d6b6fd18f4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6817","nonce":3385303160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6821","nonce":3385303160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6827","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6829","nonce":3385303160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6823","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6825","nonce":3385303160}]},"public_addr":"172.21.15.62:6817/3385303160","cluster_addr":"172.21.15.62:6821/3385303160","heartbeat_back_addr":"172.21.15.62:6829/3385303160","heartbeat_front_addr":"172.21.15.62:6825/3385303160","state":["exists","up"]},{"osd":4,"uuid":"74c73631-9351-494a-8246-28ee86e9f862","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6807","nonce":1174056987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6809","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6811","nonce":1174056987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6820","nonce":1174056987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6813","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6816","nonce":1174056987}]},"public_addr":"172.21.15.130:6807/1174056987","cluster_addr":"172.21.15.130:6811/1174056987","heartbeat_back_addr":"172.21.15.130:6820/1174056987","heartbeat_front_addr":"172.21.15.130:6816/1174056987","state":["exists","up"]},{"osd":5,"uuid":"1040f389-272c-41d6-ae76-70c04d09afa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6801","nonce":561928414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6803","nonce":561928414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6815","nonce":561928414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6808","nonce":561928414}]},"public_addr":"172.21.15.130:6801/561928414","cluster_addr":"172.21.15.130:6803/561928414","heartbeat_back_addr":"172.21.15.130:6815/561928414","heartbeat_front_addr":"172.21.15.130:6808/561928414","state":["exists","up"]},{"osd":6,"uuid":"178553eb-03e1-4ab8-9826-4f5997e6da0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6810","nonce":2877303015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6817","nonce":2877303015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6823","nonce":2877303015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6819","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6821","nonce":2877303015}]},"public_addr":"172.21.15.130:6810/2877303015","cluster_addr":"172.21.15.130:6817/2877303015","heartbeat_back_addr":"172.21.15.130:6823/2877303015","heartbeat_front_addr":"172.21.15.130:6821/2877303015","state":["exists","up"]},{"osd":7,"uuid":"b6581c8f-30b1-4dfd-b7b6-94b579128835","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6825","nonce":680009774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6827","nonce":680009774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6831","nonce":680009774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6829","nonce":680009774}]},"public_addr":"172.21.15.130:6825/680009774","cluster_addr":"172.21.15.130:6827/680009774","heartbeat_back_addr":"172.21.15.130:6831/680009774","heartbeat_front_addr":"172.21.15.130:6829/680009774","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.505543+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.394383+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.456652+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.529168+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.235414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.392158+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.347556+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.432039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:00:30.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.179+0000 7fa4137cf640 1 -- 172.21.15.62:0/2378290194 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fa3f0066470 msgr2=0x7fa3f0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:30.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.179+0000 7fa4137cf640 1 --2- 172.21.15.62:0/2378290194 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fa3f0066470 0x7fa3f0068930 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa4080ae000 tx=0x7fa4080b3040 comp rx=0 tx=0).stop 2023-10-08T12:00:30.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.179+0000 7fa4137cf640 1 -- 172.21.15.62:0/2378290194 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa40c0a08b0 msgr2=0x7fa40c0b2ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:30.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.179+0000 7fa4137cf640 1 --2- 172.21.15.62:0/2378290194 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa40c0a08b0 0x7fa40c0b2ca0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc00c310 tx=0x7fa3fc00c7d0 comp rx=0 tx=0).stop 2023-10-08T12:00:30.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.179+0000 7fa4137cf640 1 -- 172.21.15.62:0/2378290194 shutdown_connections 2023-10-08T12:00:30.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.179+0000 7fa4137cf640 1 --2- 172.21.15.62:0/2378290194 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fa3f0066470 0x7fa3f0068930 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:30.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.179+0000 7fa4137cf640 1 --2- 172.21.15.62:0/2378290194 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa40c0a0c90 0x7fa40c1391a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:30.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.179+0000 7fa4137cf640 1 --2- 172.21.15.62:0/2378290194 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa40c0a08b0 0x7fa40c0b2ca0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:30.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.179+0000 7fa4137cf640 1 --2- 172.21.15.62:0/2378290194 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa40c065920 0x7fa40c13f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:30.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.179+0000 7fa4137cf640 1 -- 172.21.15.62:0/2378290194 >> 172.21.15.62:0/2378290194 conn(0x7fa40c0b7b10 msgr2=0x7fa40c13d580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:30.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.179+0000 7fa4137cf640 1 -- 172.21.15.62:0/2378290194 shutdown_connections 2023-10-08T12:00:30.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.183+0000 7fa4137cf640 1 -- 172.21.15.62:0/2378290194 wait complete. 2023-10-08T12:00:30.203 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T12:00:07.189433+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T12:00:17.895548+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T12:00:18.871217+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T12:00:30.203 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T12:00:30.326 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.323+0000 7f6d525e9640 1 -- 172.21.15.62:0/3672624807 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d4c06b1c0 msgr2=0x7f6d4c0b5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:30.327 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.323+0000 7f6d525e9640 1 --2- 172.21.15.62:0/3672624807 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d4c06b1c0 0x7f6d4c0b5a70 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c00a950 tx=0x7f6d3c01dac0 comp rx=0 tx=0).stop 2023-10-08T12:00:30.327 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.323+0000 7f6d525e9640 1 -- 172.21.15.62:0/3672624807 shutdown_connections 2023-10-08T12:00:30.327 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.323+0000 7f6d525e9640 1 --2- 172.21.15.62:0/3672624807 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6d4c0ba340 0x7f6d4c0b91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:30.327 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.323+0000 7f6d525e9640 1 --2- 172.21.15.62:0/3672624807 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d4c06b1c0 0x7f6d4c0b5a70 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:30.327 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.323+0000 7f6d525e9640 1 -- 172.21.15.62:0/3672624807 >> 172.21.15.62:0/3672624807 conn(0x7f6d4c09c520 msgr2=0x7f6d4c09c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:30.327 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.323+0000 7f6d525e9640 1 -- 172.21.15.62:0/3672624807 shutdown_connections 2023-10-08T12:00:30.327 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.323+0000 7f6d525e9640 1 -- 172.21.15.62:0/3672624807 wait complete. 2023-10-08T12:00:30.329 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.323+0000 7f6d525e9640 1 Processor -- start 2023-10-08T12:00:30.329 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.323+0000 7f6d525e9640 1 -- start start 2023-10-08T12:00:30.330 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.323+0000 7f6d525e9640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6d4c06b1c0 0x7f6d4c0b2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:30.330 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.323+0000 7f6d525e9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d4c06b5a0 0x7f6d4c14e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:30.330 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.323+0000 7f6d525e9640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6d4c0ba340 0x7f6d4c0b2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:30.330 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.323+0000 7f6d525e9640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4c14e770 con 0x7f6d4c06b5a0 2023-10-08T12:00:30.330 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.323+0000 7f6d525e9640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4c0b4200 con 0x7f6d4c0ba340 2023-10-08T12:00:30.330 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.323+0000 7f6d525e9640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4c0b3de0 con 0x7f6d4c06b1c0 2023-10-08T12:00:30.330 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.323+0000 7f6d4b7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d4c06b5a0 0x7f6d4c14e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:30.330 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.323+0000 7f6d4b7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d4c06b5a0 0x7f6d4c14e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:44058/0 (socket says 172.21.15.62:44058) 2023-10-08T12:00:30.330 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.323+0000 7f6d4b7fe640 1 -- 172.21.15.62:0/3232009211 learned_addr learned my addr 172.21.15.62:0/3232009211 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:30.331 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.323+0000 7f6d4b7fe640 1 -- 172.21.15.62:0/3232009211 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6d4c06b1c0 msgr2=0x7f6d4c0b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:30.331 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.323+0000 7f6d4b7fe640 1 --2- 172.21.15.62:0/3232009211 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6d4c06b1c0 0x7f6d4c0b2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:30.331 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.323+0000 7f6d4b7fe640 1 -- 172.21.15.62:0/3232009211 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6d4c0ba340 msgr2=0x7f6d4c0b2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:30.331 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.323+0000 7f6d50b86640 1 --2- 172.21.15.62:0/3232009211 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6d4c0ba340 0x7f6d4c0b2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:30.331 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.323+0000 7f6d4b7fe640 1 --2- 172.21.15.62:0/3232009211 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6d4c0ba340 0x7f6d4c0b2ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:30.331 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.323+0000 7f6d4b7fe640 1 -- 172.21.15.62:0/3232009211 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d3c00a5b0 con 0x7f6d4c06b5a0 2023-10-08T12:00:30.331 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.323+0000 7f6d4b7fe640 1 --2- 172.21.15.62:0/3232009211 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d4c06b5a0 0x7f6d4c14e230 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6d4000b3f0 tx=0x7f6d4000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:30.331 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.323+0000 7f6d48ff9640 1 -- 172.21.15.62:0/3232009211 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d40011830 con 0x7f6d4c06b5a0 2023-10-08T12:00:30.331 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.323+0000 7f6d48ff9640 1 -- 172.21.15.62:0/3232009211 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6d40011a80 con 0x7f6d4c06b5a0 2023-10-08T12:00:30.331 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.323+0000 7f6d525e9640 1 -- 172.21.15.62:0/3232009211 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d4c142860 con 0x7f6d4c06b5a0 2023-10-08T12:00:30.331 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.323+0000 7f6d48ff9640 1 -- 172.21.15.62:0/3232009211 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d40011e90 con 0x7f6d4c06b5a0 2023-10-08T12:00:30.331 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.323+0000 7f6d525e9640 1 -- 172.21.15.62:0/3232009211 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d4c143400 con 0x7f6d4c06b5a0 2023-10-08T12:00:30.332 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.327+0000 7f6d525e9640 1 -- 172.21.15.62:0/3232009211 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d4c073210 con 0x7f6d4c06b5a0 2023-10-08T12:00:30.332 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.327+0000 7f6d48ff9640 1 -- 172.21.15.62:0/3232009211 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6d4001a400 con 0x7f6d4c06b5a0 2023-10-08T12:00:30.332 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.327+0000 7f6d48ff9640 1 --2- 172.21.15.62:0/3232009211 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f6d38066470 0x7f6d38068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:30.333 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.327+0000 7f6d48ff9640 1 -- 172.21.15.62:0/3232009211 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6d400841f0 con 0x7f6d4c06b5a0 2023-10-08T12:00:30.333 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.327+0000 7f6d4bfff640 1 --2- 172.21.15.62:0/3232009211 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f6d38066470 0x7f6d38068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:30.333 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.327+0000 7f6d4bfff640 1 --2- 172.21.15.62:0/3232009211 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f6d38066470 0x7f6d38068930 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c0b0000 tx=0x7f6d3c01a860 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:30.334 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.331+0000 7f6d48ff9640 1 -- 172.21.15.62:0/3232009211 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6d40051680 con 0x7f6d4c06b5a0 2023-10-08T12:00:30.483 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.479+0000 7f6d525e9640 1 -- 172.21.15.62:0/3232009211 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6d4c0b43c0 con 0x7f6d4c06b5a0 2023-10-08T12:00:30.483 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.479+0000 7f6d48ff9640 1 -- 172.21.15.62:0/3232009211 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6d40054ca0 con 0x7f6d4c06b5a0 2023-10-08T12:00:30.484 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2023-10-08T12:00:30.486 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.483+0000 7f6d525e9640 1 -- 172.21.15.62:0/3232009211 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f6d38066470 msgr2=0x7f6d38068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:30.486 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.483+0000 7f6d525e9640 1 --2- 172.21.15.62:0/3232009211 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f6d38066470 0x7f6d38068930 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c0b0000 tx=0x7f6d3c01a860 comp rx=0 tx=0).stop 2023-10-08T12:00:30.487 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.483+0000 7f6d525e9640 1 -- 172.21.15.62:0/3232009211 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d4c06b5a0 msgr2=0x7f6d4c14e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:30.487 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.483+0000 7f6d525e9640 1 --2- 172.21.15.62:0/3232009211 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d4c06b5a0 0x7f6d4c14e230 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6d4000b3f0 tx=0x7f6d4000b8b0 comp rx=0 tx=0).stop 2023-10-08T12:00:30.487 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.483+0000 7f6d525e9640 1 -- 172.21.15.62:0/3232009211 shutdown_connections 2023-10-08T12:00:30.487 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.483+0000 7f6d525e9640 1 --2- 172.21.15.62:0/3232009211 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f6d38066470 0x7f6d38068930 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:30.487 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.483+0000 7f6d525e9640 1 --2- 172.21.15.62:0/3232009211 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6d4c0ba340 0x7f6d4c0b2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:30.488 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.483+0000 7f6d525e9640 1 --2- 172.21.15.62:0/3232009211 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d4c06b5a0 0x7f6d4c14e230 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:30.488 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.483+0000 7f6d525e9640 1 --2- 172.21.15.62:0/3232009211 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6d4c06b1c0 0x7f6d4c0b2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:30.488 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.483+0000 7f6d525e9640 1 -- 172.21.15.62:0/3232009211 >> 172.21.15.62:0/3232009211 conn(0x7f6d4c09c520 msgr2=0x7f6d4c145ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:30.488 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.483+0000 7f6d525e9640 1 -- 172.21.15.62:0/3232009211 shutdown_connections 2023-10-08T12:00:30.488 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.483+0000 7f6d525e9640 1 -- 172.21.15.62:0/3232009211 wait complete. 2023-10-08T12:00:30.502 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T12:00:30.623 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.619+0000 7fe73a795640 1 -- 172.21.15.62:0/854666668 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe71c004ac0 msgr2=0x7fe71c004ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:30.623 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.619+0000 7fe73a795640 1 --2- 172.21.15.62:0/854666668 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe71c004ac0 0x7fe71c004ee0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe7240016b0 tx=0x7fe72401c6e0 comp rx=0 tx=0).stop 2023-10-08T12:00:30.623 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.619+0000 7fe738d32640 1 -- 172.21.15.62:0/854666668 reap_dead start 2023-10-08T12:00:30.623 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.619+0000 7fe73a795640 1 -- 172.21.15.62:0/854666668 shutdown_connections 2023-10-08T12:00:30.624 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.619+0000 7fe73a795640 1 -- 172.21.15.62:0/854666668 >> 172.21.15.62:0/854666668 conn(0x7fe73409c520 msgr2=0x7fe73409c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:30.624 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.619+0000 7fe73a795640 1 -- 172.21.15.62:0/854666668 shutdown_connections 2023-10-08T12:00:30.624 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.619+0000 7fe73a795640 1 -- 172.21.15.62:0/854666668 wait complete. 2023-10-08T12:00:30.627 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.619+0000 7fe73a795640 1 Processor -- start 2023-10-08T12:00:30.627 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.619+0000 7fe73a795640 1 -- start start 2023-10-08T12:00:30.627 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.619+0000 7fe73a795640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe71c004ac0 0x7fe73414e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:30.627 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.619+0000 7fe73a795640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe73409b740 0x7fe7341e6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:30.628 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.619+0000 7fe73a795640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe7341e6640 0x7fe73413f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:30.628 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.619+0000 7fe73a795640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe73414eab0 con 0x7fe73409b740 2023-10-08T12:00:30.628 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.619+0000 7fe73a795640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7341e6ac0 con 0x7fe71c004ac0 2023-10-08T12:00:30.628 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.619+0000 7fe73a795640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe73409bbc0 con 0x7fe7341e6640 2023-10-08T12:00:30.628 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.619+0000 7fe7337fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe73409b740 0x7fe7341e6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:30.628 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.619+0000 7fe7337fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe73409b740 0x7fe7341e6100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:44068/0 (socket says 172.21.15.62:44068) 2023-10-08T12:00:30.628 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.619+0000 7fe7337fe640 1 -- 172.21.15.62:0/1143073012 learned_addr learned my addr 172.21.15.62:0/1143073012 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:30.628 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.619+0000 7fe738d32640 1 --2- 172.21.15.62:0/1143073012 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe7341e6640 0x7fe73413f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:30.629 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.619+0000 7fe733fff640 1 --2- 172.21.15.62:0/1143073012 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe71c004ac0 0x7fe73414e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:30.629 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.619+0000 7fe7337fe640 1 -- 172.21.15.62:0/1143073012 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe7341e6640 msgr2=0x7fe73413f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:30.629 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.619+0000 7fe7337fe640 1 --2- 172.21.15.62:0/1143073012 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe7341e6640 0x7fe73413f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:30.629 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.619+0000 7fe7337fe640 1 -- 172.21.15.62:0/1143073012 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe71c004ac0 msgr2=0x7fe73414e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:30.629 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.619+0000 7fe7337fe640 1 --2- 172.21.15.62:0/1143073012 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe71c004ac0 0x7fe73414e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:30.629 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.619+0000 7fe7337fe640 1 -- 172.21.15.62:0/1143073012 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe73414fed0 con 0x7fe73409b740 2023-10-08T12:00:30.629 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.619+0000 7fe738d32640 1 --2- 172.21.15.62:0/1143073012 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe7341e6640 0x7fe73413f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:00:30.629 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.619+0000 7fe733fff640 1 --2- 172.21.15.62:0/1143073012 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe71c004ac0 0x7fe73414e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:00:30.629 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.619+0000 7fe7337fe640 1 --2- 172.21.15.62:0/1143073012 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe73409b740 0x7fe7341e6100 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe728010a10 tx=0x7fe728010ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:30.629 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.619+0000 7fe730ff9640 1 -- 172.21.15.62:0/1143073012 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72800ece0 con 0x7fe73409b740 2023-10-08T12:00:30.629 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.619+0000 7fe730ff9640 1 -- 172.21.15.62:0/1143073012 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe72800ee40 con 0x7fe73409b740 2023-10-08T12:00:30.630 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.619+0000 7fe73a795640 1 -- 172.21.15.62:0/1143073012 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7341501b0 con 0x7fe73409b740 2023-10-08T12:00:30.630 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.619+0000 7fe730ff9640 1 -- 172.21.15.62:0/1143073012 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe728005280 con 0x7fe73409b740 2023-10-08T12:00:30.630 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.619+0000 7fe73a795640 1 -- 172.21.15.62:0/1143073012 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe73414f710 con 0x7fe73409b740 2023-10-08T12:00:30.630 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.623+0000 7fe73a795640 1 -- 172.21.15.62:0/1143073012 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe73404da80 con 0x7fe73409b740 2023-10-08T12:00:30.630 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.623+0000 7fe730ff9640 1 -- 172.21.15.62:0/1143073012 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe7280053e0 con 0x7fe73409b740 2023-10-08T12:00:30.630 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.623+0000 7fe730ff9640 1 --2- 172.21.15.62:0/1143073012 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fe7200664a0 0x7fe720068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:30.630 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.623+0000 7fe730ff9640 1 -- 172.21.15.62:0/1143073012 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe728016070 con 0x7fe73409b740 2023-10-08T12:00:30.630 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.623+0000 7fe733fff640 1 --2- 172.21.15.62:0/1143073012 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fe7200664a0 0x7fe720068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:30.631 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.623+0000 7fe733fff640 1 --2- 172.21.15.62:0/1143073012 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fe7200664a0 0x7fe720068960 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe724001680 tx=0x7fe724019480 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:30.631 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.627+0000 7fe730ff9640 1 -- 172.21.15.62:0/1143073012 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe728051f80 con 0x7fe73409b740 2023-10-08T12:00:30.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.779+0000 7fe73a795640 1 -- 172.21.15.62:0/1143073012 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe734151240 con 0x7fe73409b740 2023-10-08T12:00:30.784 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.779+0000 7fe730ff9640 1 -- 172.21.15.62:0/1143073012 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe7280555a0 con 0x7fe73409b740 2023-10-08T12:00:30.784 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-10-08T12:00:30.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.783+0000 7fe73a795640 1 -- 172.21.15.62:0/1143073012 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fe7200664a0 msgr2=0x7fe720068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:30.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.783+0000 7fe73a795640 1 --2- 172.21.15.62:0/1143073012 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fe7200664a0 0x7fe720068960 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe724001680 tx=0x7fe724019480 comp rx=0 tx=0).stop 2023-10-08T12:00:30.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.783+0000 7fe73a795640 1 -- 172.21.15.62:0/1143073012 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe73409b740 msgr2=0x7fe7341e6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:30.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.783+0000 7fe73a795640 1 --2- 172.21.15.62:0/1143073012 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe73409b740 0x7fe7341e6100 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe728010a10 tx=0x7fe728010ed0 comp rx=0 tx=0).stop 2023-10-08T12:00:30.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.783+0000 7fe73a795640 1 -- 172.21.15.62:0/1143073012 shutdown_connections 2023-10-08T12:00:30.788 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.783+0000 7fe73a795640 1 --2- 172.21.15.62:0/1143073012 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fe7200664a0 0x7fe720068960 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:30.788 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.783+0000 7fe73a795640 1 --2- 172.21.15.62:0/1143073012 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe7341e6640 0x7fe73413f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:30.788 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.783+0000 7fe73a795640 1 --2- 172.21.15.62:0/1143073012 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe73409b740 0x7fe7341e6100 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:30.788 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.783+0000 7fe73a795640 1 --2- 172.21.15.62:0/1143073012 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe71c004ac0 0x7fe73414e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:30.789 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.783+0000 7fe73a795640 1 -- 172.21.15.62:0/1143073012 >> 172.21.15.62:0/1143073012 conn(0x7fe73409c520 msgr2=0x7fe7340b7170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:30.789 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.783+0000 7fe73a795640 1 -- 172.21.15.62:0/1143073012 shutdown_connections 2023-10-08T12:00:30.789 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.783+0000 7fe73a795640 1 -- 172.21.15.62:0/1143073012 wait complete. 2023-10-08T12:00:30.803 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T12:00:30.936 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.931+0000 7f4cf4b40640 1 -- 172.21.15.62:0/1170528938 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4cf00b9900 msgr2=0x7f4cf014fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:30.937 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.931+0000 7f4cf4b40640 1 --2- 172.21.15.62:0/1170528938 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4cf00b9900 0x7f4cf014fd40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4cf0073400 tx=0x7f4ce801cad0 comp rx=0 tx=0).stop 2023-10-08T12:00:30.937 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.931+0000 7f4cf4b40640 1 -- 172.21.15.62:0/1170528938 shutdown_connections 2023-10-08T12:00:30.937 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.931+0000 7f4cf4b40640 1 --2- 172.21.15.62:0/1170528938 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4cf00b9900 0x7f4cf014fd40 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:30.937 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.931+0000 7f4cf4b40640 1 --2- 172.21.15.62:0/1170528938 >> v2:172.21.15.130:3300/0 conn(0x7f4cf006b1c0 0x7f4cf00b5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:30.938 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.931+0000 7f4cf4b40640 1 -- 172.21.15.62:0/1170528938 >> 172.21.15.62:0/1170528938 conn(0x7f4cf009c520 msgr2=0x7f4cf009c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:30.938 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.931+0000 7f4cf4b40640 1 -- 172.21.15.62:0/1170528938 shutdown_connections 2023-10-08T12:00:30.938 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.931+0000 7f4cf4b40640 1 -- 172.21.15.62:0/1170528938 wait complete. 2023-10-08T12:00:30.938 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.931+0000 7f4cf4b40640 1 Processor -- start 2023-10-08T12:00:30.938 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.931+0000 7f4cf4b40640 1 -- start start 2023-10-08T12:00:30.943 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.931+0000 7f4cf4b40640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4cf006b1c0 0x7f4cf0153c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:30.943 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.931+0000 7f4cf4b40640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4cf00b9900 0x7f4cf013fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:30.943 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.931+0000 7f4cf4b40640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4cf00ba340 0x7f4cf0152ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:30.944 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.931+0000 7f4cf4b40640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf0153430 con 0x7f4cf00ba340 2023-10-08T12:00:30.944 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.931+0000 7f4cf4b40640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf013a790 con 0x7f4cf00b9900 2023-10-08T12:00:30.944 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.931+0000 7f4cf4b40640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf00a0b10 con 0x7f4cf006b1c0 2023-10-08T12:00:30.944 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.931+0000 7f4ceed9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4cf00ba340 0x7f4cf0152ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:30.944 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.931+0000 7f4ceed9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4cf00ba340 0x7f4cf0152ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:44084/0 (socket says 172.21.15.62:44084) 2023-10-08T12:00:30.945 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.931+0000 7f4ceed9d640 1 -- 172.21.15.62:0/2311751264 learned_addr learned my addr 172.21.15.62:0/2311751264 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:30.945 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.935+0000 7f4cedd9b640 1 --2- 172.21.15.62:0/2311751264 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4cf00b9900 0x7f4cf013fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:30.945 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.935+0000 7f4cee59c640 1 --2- 172.21.15.62:0/2311751264 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4cf006b1c0 0x7f4cf0153c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:30.945 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.935+0000 7f4ceed9d640 1 -- 172.21.15.62:0/2311751264 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4cf006b1c0 msgr2=0x7f4cf0153c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:30.945 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.935+0000 7f4ceed9d640 1 --2- 172.21.15.62:0/2311751264 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4cf006b1c0 0x7f4cf0153c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:30.946 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.935+0000 7f4ceed9d640 1 -- 172.21.15.62:0/2311751264 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4cf00b9900 msgr2=0x7f4cf013fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:30.946 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.935+0000 7f4ceed9d640 1 --2- 172.21.15.62:0/2311751264 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4cf00b9900 0x7f4cf013fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:30.946 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.935+0000 7f4ceed9d640 1 -- 172.21.15.62:0/2311751264 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ce8009820 con 0x7f4cf00ba340 2023-10-08T12:00:30.946 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.935+0000 7f4cedd9b640 1 --2- 172.21.15.62:0/2311751264 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4cf00b9900 0x7f4cf013fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:00:30.946 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.935+0000 7f4cee59c640 1 --2- 172.21.15.62:0/2311751264 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4cf006b1c0 0x7f4cf0153c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:00:30.946 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.935+0000 7f4ceed9d640 1 --2- 172.21.15.62:0/2311751264 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4cf00ba340 0x7f4cf0152ef0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4ce80196e0 tx=0x7f4ce80a5930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:30.947 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.935+0000 7f4cdeffd640 1 -- 172.21.15.62:0/2311751264 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce8004d10 con 0x7f4cf00ba340 2023-10-08T12:00:30.947 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.935+0000 7f4cdeffd640 1 -- 172.21.15.62:0/2311751264 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4ce8004e70 con 0x7f4cf00ba340 2023-10-08T12:00:30.947 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.935+0000 7f4cf4b40640 1 -- 172.21.15.62:0/2311751264 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cf0140f00 con 0x7f4cf00ba340 2023-10-08T12:00:30.947 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.935+0000 7f4cdeffd640 1 -- 172.21.15.62:0/2311751264 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce80041e0 con 0x7f4cf00ba340 2023-10-08T12:00:30.947 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.935+0000 7f4cf4b40640 1 -- 172.21.15.62:0/2311751264 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cf0153740 con 0x7f4cf00ba340 2023-10-08T12:00:30.948 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.935+0000 7f4cf4b40640 1 -- 172.21.15.62:0/2311751264 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cf0153930 con 0x7f4cf00ba340 2023-10-08T12:00:30.948 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.935+0000 7f4cdeffd640 1 -- 172.21.15.62:0/2311751264 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4ce80b4040 con 0x7f4cf00ba340 2023-10-08T12:00:30.948 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.935+0000 7f4cdeffd640 1 --2- 172.21.15.62:0/2311751264 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f4cd0066470 0x7f4cd0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:30.948 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.935+0000 7f4cdeffd640 1 -- 172.21.15.62:0/2311751264 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4ce811e8b0 con 0x7f4cf00ba340 2023-10-08T12:00:30.948 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.935+0000 7f4cee59c640 1 --2- 172.21.15.62:0/2311751264 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f4cd0066470 0x7f4cd0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:30.949 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.935+0000 7f4cee59c640 1 --2- 172.21.15.62:0/2311751264 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f4cd0066470 0x7f4cd0068930 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4ce0005fd0 tx=0x7f4ce0005da0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:30.950 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:30.939+0000 7f4cdeffd640 1 -- 172.21.15.62:0/2311751264 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4ce80ebdc0 con 0x7f4cf00ba340 2023-10-08T12:00:31.092 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.087+0000 7f4cf4b40640 1 -- 172.21.15.62:0/2311751264 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4cf004da80 con 0x7f4cf00ba340 2023-10-08T12:00:31.092 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.087+0000 7f4cdeffd640 1 -- 172.21.15.62:0/2311751264 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4ce80b2020 con 0x7f4cf00ba340 2023-10-08T12:00:31.093 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 64 2023-10-08T12:00:31.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.091+0000 7f4cf4b40640 1 -- 172.21.15.62:0/2311751264 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f4cd0066470 msgr2=0x7f4cd0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:31.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.091+0000 7f4cf4b40640 1 --2- 172.21.15.62:0/2311751264 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f4cd0066470 0x7f4cd0068930 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4ce0005fd0 tx=0x7f4ce0005da0 comp rx=0 tx=0).stop 2023-10-08T12:00:31.096 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.091+0000 7f4cf4b40640 1 -- 172.21.15.62:0/2311751264 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4cf00ba340 msgr2=0x7f4cf0152ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:31.096 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.091+0000 7f4cf4b40640 1 --2- 172.21.15.62:0/2311751264 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4cf00ba340 0x7f4cf0152ef0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4ce80196e0 tx=0x7f4ce80a5930 comp rx=0 tx=0).stop 2023-10-08T12:00:31.096 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.091+0000 7f4cf4b40640 1 -- 172.21.15.62:0/2311751264 shutdown_connections 2023-10-08T12:00:31.096 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.091+0000 7f4cf4b40640 1 --2- 172.21.15.62:0/2311751264 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f4cd0066470 0x7f4cd0068930 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:31.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.091+0000 7f4cf4b40640 1 --2- 172.21.15.62:0/2311751264 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4cf00ba340 0x7f4cf0152ef0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:31.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.091+0000 7f4cf4b40640 1 --2- 172.21.15.62:0/2311751264 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4cf00b9900 0x7f4cf013fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:31.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.091+0000 7f4cf4b40640 1 --2- 172.21.15.62:0/2311751264 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4cf006b1c0 0x7f4cf0153c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:31.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.091+0000 7f4cf4b40640 1 -- 172.21.15.62:0/2311751264 >> 172.21.15.62:0/2311751264 conn(0x7f4cf009c520 msgr2=0x7f4cf00b7200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:31.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.091+0000 7f4cf4b40640 1 -- 172.21.15.62:0/2311751264 shutdown_connections 2023-10-08T12:00:31.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.091+0000 7f4cf4b40640 1 -- 172.21.15.62:0/2311751264 wait complete. 2023-10-08T12:00:31.111 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:00:31.230 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.227+0000 7f6c27e9f640 1 -- 172.21.15.62:0/2489754270 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6c2006a520 msgr2=0x7f6c20149be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:31.230 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.227+0000 7f6c27e9f640 1 --2- 172.21.15.62:0/2489754270 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6c2006a520 0x7f6c20149be0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6c20089310 tx=0x7f6c1c01c780 comp rx=0 tx=0).stop 2023-10-08T12:00:31.231 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.227+0000 7f6c27e9f640 1 -- 172.21.15.62:0/2489754270 shutdown_connections 2023-10-08T12:00:31.231 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.227+0000 7f6c27e9f640 1 --2- 172.21.15.62:0/2489754270 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6c200bdba0 0x7f6c2014c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:31.231 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.227+0000 7f6c27e9f640 1 --2- 172.21.15.62:0/2489754270 >> v2:172.21.15.130:3300/0 conn(0x7f6c200bc670 0x7f6c20069790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:31.231 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.227+0000 7f6c27e9f640 1 --2- 172.21.15.62:0/2489754270 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6c2006a520 0x7f6c20149be0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:31.231 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.227+0000 7f6c27e9f640 1 -- 172.21.15.62:0/2489754270 >> 172.21.15.62:0/2489754270 conn(0x7f6c200a0540 msgr2=0x7f6c200a0950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:31.231 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.227+0000 7f6c27e9f640 1 -- 172.21.15.62:0/2489754270 shutdown_connections 2023-10-08T12:00:31.231 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.227+0000 7f6c27e9f640 1 -- 172.21.15.62:0/2489754270 wait complete. 2023-10-08T12:00:31.234 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.227+0000 7f6c27e9f640 1 Processor -- start 2023-10-08T12:00:31.234 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.227+0000 7f6c27e9f640 1 -- start start 2023-10-08T12:00:31.235 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.227+0000 7f6c27e9f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6c2006a520 0x7f6c200a21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:31.235 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.227+0000 7f6c27e9f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6c200bc670 0x7f6c201e2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:31.235 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.227+0000 7f6c27e9f640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6c200bdba0 0x7f6c201e31b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:31.235 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.227+0000 7f6c27e9f640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c200a26e0 con 0x7f6c200bc670 2023-10-08T12:00:31.235 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.227+0000 7f6c27e9f640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c2013bab0 con 0x7f6c2006a520 2023-10-08T12:00:31.235 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.227+0000 7f6c27e9f640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c2013bd90 con 0x7f6c200bdba0 2023-10-08T12:00:31.235 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.227+0000 7f6c2543a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6c200bc670 0x7f6c201e2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:31.235 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.227+0000 7f6c2543a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6c200bc670 0x7f6c201e2c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:44110/0 (socket says 172.21.15.62:44110) 2023-10-08T12:00:31.236 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.227+0000 7f6c2543a640 1 -- 172.21.15.62:0/2368661128 learned_addr learned my addr 172.21.15.62:0/2368661128 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:31.236 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.227+0000 7f6c25c3b640 1 --2- 172.21.15.62:0/2368661128 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6c2006a520 0x7f6c200a21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:31.236 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.227+0000 7f6c2643c640 1 --2- 172.21.15.62:0/2368661128 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6c200bdba0 0x7f6c201e31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:31.236 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.227+0000 7f6c2543a640 1 -- 172.21.15.62:0/2368661128 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6c200bdba0 msgr2=0x7f6c201e31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:31.236 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.227+0000 7f6c2543a640 1 --2- 172.21.15.62:0/2368661128 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6c200bdba0 0x7f6c201e31b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:31.236 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.227+0000 7f6c2543a640 1 -- 172.21.15.62:0/2368661128 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6c2006a520 msgr2=0x7f6c200a21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:31.236 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.227+0000 7f6c2543a640 1 --2- 172.21.15.62:0/2368661128 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6c2006a520 0x7f6c200a21a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:31.236 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.227+0000 7f6c2543a640 1 -- 172.21.15.62:0/2368661128 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c1c009560 con 0x7f6c200bc670 2023-10-08T12:00:31.237 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.227+0000 7f6c25c3b640 1 --2- 172.21.15.62:0/2368661128 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6c2006a520 0x7f6c200a21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:00:31.237 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.227+0000 7f6c2543a640 1 --2- 172.21.15.62:0/2368661128 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6c200bc670 0x7f6c201e2c70 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6c1000b480 tx=0x7f6c1000b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:31.237 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.227+0000 7f6c167fc640 1 -- 172.21.15.62:0/2368661128 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c10010870 con 0x7f6c200bc670 2023-10-08T12:00:31.237 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.227+0000 7f6c167fc640 1 -- 172.21.15.62:0/2368661128 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6c10010ae0 con 0x7f6c200bc670 2023-10-08T12:00:31.237 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.227+0000 7f6c27e9f640 1 -- 172.21.15.62:0/2368661128 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c2013c070 con 0x7f6c200bc670 2023-10-08T12:00:31.237 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.227+0000 7f6c167fc640 1 -- 172.21.15.62:0/2368661128 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c1000f3c0 con 0x7f6c200bc670 2023-10-08T12:00:31.237 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.227+0000 7f6c27e9f640 1 -- 172.21.15.62:0/2368661128 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c2013c350 con 0x7f6c200bc670 2023-10-08T12:00:31.238 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.231+0000 7f6c27e9f640 1 -- 172.21.15.62:0/2368661128 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c20066a30 con 0x7f6c200bc670 2023-10-08T12:00:31.238 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.231+0000 7f6c167fc640 1 -- 172.21.15.62:0/2368661128 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6c1000f520 con 0x7f6c200bc670 2023-10-08T12:00:31.239 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.231+0000 7f6c167fc640 1 --2- 172.21.15.62:0/2368661128 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f6c040664a0 0x7f6c04068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:31.239 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.231+0000 7f6c167fc640 1 -- 172.21.15.62:0/2368661128 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6c10084040 con 0x7f6c200bc670 2023-10-08T12:00:31.239 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.231+0000 7f6c25c3b640 1 --2- 172.21.15.62:0/2368661128 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f6c040664a0 0x7f6c04068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:31.239 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.231+0000 7f6c25c3b640 1 --2- 172.21.15.62:0/2368661128 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f6c040664a0 0x7f6c04068960 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c0af000 tx=0x7f6c1c01afc0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:31.239 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.235+0000 7f6c167fc640 1 -- 172.21.15.62:0/2368661128 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6c10051550 con 0x7f6c200bc670 2023-10-08T12:00:31.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.419+0000 7f6c27e9f640 1 -- 172.21.15.62:0/2368661128 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6c2004da80 con 0x7f6c200bc670 2023-10-08T12:00:31.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.419+0000 7f6c167fc640 1 -- 172.21.15.62:0/2368661128 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4120 (secure 0 0 0) 0x7f6c10014090 con 0x7f6c200bc670 2023-10-08T12:00:31.424 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T12:00:31.424 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4334,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/2629778704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":2629778704},{"type":"v1","addr":"172.21.15.130:6835","nonce":2629778704}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4359,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/2134446062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":2134446062},{"type":"v1","addr":"172.21.15.62:6835","nonce":2134446062}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T12:00:19.866714+0000","modified":"2023-10-08T12:00:22.958677+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4362},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4362":{"gid":4362,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6834/2629384568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":2629384568},{"type":"v1","addr":"172.21.15.62:6834","nonce":2629384568}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:00:31.424 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 8 2023-10-08T12:00:31.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.423+0000 7f6c27e9f640 1 -- 172.21.15.62:0/2368661128 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f6c040664a0 msgr2=0x7f6c04068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:31.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.423+0000 7f6c27e9f640 1 --2- 172.21.15.62:0/2368661128 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f6c040664a0 0x7f6c04068960 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c0af000 tx=0x7f6c1c01afc0 comp rx=0 tx=0).stop 2023-10-08T12:00:31.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.423+0000 7f6c27e9f640 1 -- 172.21.15.62:0/2368661128 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6c200bc670 msgr2=0x7f6c201e2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:31.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.423+0000 7f6c27e9f640 1 --2- 172.21.15.62:0/2368661128 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6c200bc670 0x7f6c201e2c70 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6c1000b480 tx=0x7f6c1000b940 comp rx=0 tx=0).stop 2023-10-08T12:00:31.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.423+0000 7f6c27e9f640 1 -- 172.21.15.62:0/2368661128 shutdown_connections 2023-10-08T12:00:31.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.423+0000 7f6c27e9f640 1 --2- 172.21.15.62:0/2368661128 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f6c040664a0 0x7f6c04068960 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:31.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.423+0000 7f6c27e9f640 1 --2- 172.21.15.62:0/2368661128 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6c200bdba0 0x7f6c201e31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:31.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.423+0000 7f6c27e9f640 1 --2- 172.21.15.62:0/2368661128 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6c200bc670 0x7f6c201e2c70 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:31.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.423+0000 7f6c27e9f640 1 --2- 172.21.15.62:0/2368661128 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6c2006a520 0x7f6c200a21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:31.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.423+0000 7f6c27e9f640 1 -- 172.21.15.62:0/2368661128 >> 172.21.15.62:0/2368661128 conn(0x7f6c200a0540 msgr2=0x7f6c2013cb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:31.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.423+0000 7f6c27e9f640 1 -- 172.21.15.62:0/2368661128 shutdown_connections 2023-10-08T12:00:31.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.423+0000 7f6c27e9f640 1 -- 172.21.15.62:0/2368661128 wait complete. 2023-10-08T12:00:31.442 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:00:31.570 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.567+0000 7fb9dbc33640 1 -- 172.21.15.62:0/3378319039 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9d40ba240 msgr2=0x7fb9d406b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:31.570 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.567+0000 7fb9dbc33640 1 --2- 172.21.15.62:0/3378319039 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9d40ba240 0x7fb9d406b1c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb9c400a950 tx=0x7fb9c4020340 comp rx=0 tx=0).stop 2023-10-08T12:00:31.570 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.567+0000 7fb9dbc33640 1 -- 172.21.15.62:0/3378319039 shutdown_connections 2023-10-08T12:00:31.570 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.567+0000 7fb9dbc33640 1 --2- 172.21.15.62:0/3378319039 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9d40ba240 0x7fb9d406b1c0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:31.570 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.567+0000 7fb9dbc33640 1 --2- 172.21.15.62:0/3378319039 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb9d40b9e60 0x7fb9d40b5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:31.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.567+0000 7fb9dbc33640 1 -- 172.21.15.62:0/3378319039 >> 172.21.15.62:0/3378319039 conn(0x7fb9d409c520 msgr2=0x7fb9d409c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:31.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.567+0000 7fb9dbc33640 1 -- 172.21.15.62:0/3378319039 shutdown_connections 2023-10-08T12:00:31.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.567+0000 7fb9dbc33640 1 -- 172.21.15.62:0/3378319039 wait complete. 2023-10-08T12:00:31.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.567+0000 7fb9dbc33640 1 Processor -- start 2023-10-08T12:00:31.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.567+0000 7fb9dbc33640 1 -- start start 2023-10-08T12:00:31.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.567+0000 7fb9dbc33640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9d40b09e0 0x7fb9d4141a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:31.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.567+0000 7fb9dbc33640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb9d40b9e60 0x7fb9d4146b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:31.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.567+0000 7fb9dbc33640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb9d40ba240 0x7fb9d41de9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:31.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.567+0000 7fb9dbc33640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d4149250 con 0x7fb9d40b09e0 2023-10-08T12:00:31.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.567+0000 7fb9dbc33640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d4148060 con 0x7fb9d40ba240 2023-10-08T12:00:31.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.567+0000 7fb9dbc33640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d4141fd0 con 0x7fb9d40b9e60 2023-10-08T12:00:31.574 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.567+0000 7fb9d99cf640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9d40b09e0 0x7fb9d4141a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:31.574 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.567+0000 7fb9d99cf640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9d40b09e0 0x7fb9d4141a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:44134/0 (socket says 172.21.15.62:44134) 2023-10-08T12:00:31.574 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.567+0000 7fb9d99cf640 1 -- 172.21.15.62:0/4072418092 learned_addr learned my addr 172.21.15.62:0/4072418092 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:31.574 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.567+0000 7fb9d91ce640 1 --2- 172.21.15.62:0/4072418092 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb9d40b9e60 0x7fb9d4146b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:31.574 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.567+0000 7fb9da1d0640 1 --2- 172.21.15.62:0/4072418092 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb9d40ba240 0x7fb9d41de9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:31.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.567+0000 7fb9d99cf640 1 -- 172.21.15.62:0/4072418092 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb9d40b9e60 msgr2=0x7fb9d4146b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:31.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.567+0000 7fb9d99cf640 1 --2- 172.21.15.62:0/4072418092 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb9d40b9e60 0x7fb9d4146b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:31.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.567+0000 7fb9d99cf640 1 -- 172.21.15.62:0/4072418092 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb9d40ba240 msgr2=0x7fb9d41de9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:31.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.567+0000 7fb9d99cf640 1 --2- 172.21.15.62:0/4072418092 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb9d40ba240 0x7fb9d41de9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:31.576 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.567+0000 7fb9d99cf640 1 -- 172.21.15.62:0/4072418092 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9c400a5b0 con 0x7fb9d40b09e0 2023-10-08T12:00:31.576 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.567+0000 7fb9da1d0640 1 --2- 172.21.15.62:0/4072418092 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb9d40ba240 0x7fb9d41de9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:00:31.576 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.567+0000 7fb9d99cf640 1 --2- 172.21.15.62:0/4072418092 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9d40b09e0 0x7fb9d4141a90 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb9d000d9b0 tx=0x7fb9d000de70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:31.576 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.567+0000 7fb9ca7fc640 1 -- 172.21.15.62:0/4072418092 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d0009bd0 con 0x7fb9d40b09e0 2023-10-08T12:00:31.576 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.567+0000 7fb9ca7fc640 1 -- 172.21.15.62:0/4072418092 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb9d0009e20 con 0x7fb9d40b09e0 2023-10-08T12:00:31.576 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.567+0000 7fb9ca7fc640 1 -- 172.21.15.62:0/4072418092 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d0005280 con 0x7fb9d40b09e0 2023-10-08T12:00:31.576 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.567+0000 7fb9dbc33640 1 -- 172.21.15.62:0/4072418092 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9d4148680 con 0x7fb9d40b09e0 2023-10-08T12:00:31.576 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.567+0000 7fb9dbc33640 1 -- 172.21.15.62:0/4072418092 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9d4148b90 con 0x7fb9d40b09e0 2023-10-08T12:00:31.577 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.567+0000 7fb9dbc33640 1 -- 172.21.15.62:0/4072418092 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9d404da80 con 0x7fb9d40b09e0 2023-10-08T12:00:31.577 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.571+0000 7fb9ca7fc640 1 -- 172.21.15.62:0/4072418092 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb9d00053e0 con 0x7fb9d40b09e0 2023-10-08T12:00:31.577 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.571+0000 7fb9ca7fc640 1 --2- 172.21.15.62:0/4072418092 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fb9b8066470 0x7fb9b8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:31.577 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.571+0000 7fb9ca7fc640 1 -- 172.21.15.62:0/4072418092 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb9d0084190 con 0x7fb9d40b09e0 2023-10-08T12:00:31.577 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.571+0000 7fb9d91ce640 1 --2- 172.21.15.62:0/4072418092 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fb9b8066470 0x7fb9b8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:31.577 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.571+0000 7fb9d91ce640 1 --2- 172.21.15.62:0/4072418092 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fb9b8066470 0x7fb9b8068930 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb9c40b2000 tx=0x7fb9c401eb80 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:31.578 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.575+0000 7fb9ca7fc640 1 -- 172.21.15.62:0/4072418092 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb9d0051600 con 0x7fb9d40b09e0 2023-10-08T12:00:31.732 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.727+0000 7fb9dbc33640 1 -- 172.21.15.62:0/4072418092 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb9d4149920 con 0x7fb9d40b09e0 2023-10-08T12:00:31.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.727+0000 7fb9ca7fc640 1 -- 172.21.15.62:0/4072418092 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16481 (secure 0 0 0) 0x7fb9d0020090 con 0x7fb9d40b09e0 2023-10-08T12:00:31.733 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T12:00:31.734 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":20,"fsid":"3e777930-c2c1-4f2b-a903-c07ee4ca2c52","created":"2023-10-08T11:59:54.510229+0000","modified":"2023-10-08T12:00:21.580704+0000","last_up_change":"2023-10-08T12:00:06.783998+0000","last_in_change":"2023-10-08T11:59:57.847944+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:00:07.189433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:00:17.895548+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T12:00:18.871217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7bc3070a-7240-43d9-9ec3-397b68a37e2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6820","nonce":2227876905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6824","nonce":2227876905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6831","nonce":2227876905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6828","nonce":2227876905}]},"public_addr":"172.21.15.62:6820/2227876905","cluster_addr":"172.21.15.62:6824/2227876905","heartbeat_back_addr":"172.21.15.62:6831/2227876905","heartbeat_front_addr":"172.21.15.62:6828/2227876905","state":["exists","up"]},{"osd":1,"uuid":"5e0fa1f5-9ddc-4882-b460-5578bb571003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6801","nonce":315660906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6803","nonce":315660906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6808","nonce":315660906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6805","nonce":315660906}]},"public_addr":"172.21.15.62:6801/315660906","cluster_addr":"172.21.15.62:6803/315660906","heartbeat_back_addr":"172.21.15.62:6808/315660906","heartbeat_front_addr":"172.21.15.62:6805/315660906","state":["exists","up"]},{"osd":2,"uuid":"262b5ee9-4243-4309-a14f-88ad4e8bf812","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6807","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6809","nonce":3784842938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6811","nonce":3784842938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6815","nonce":3784842938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6813","nonce":3784842938}]},"public_addr":"172.21.15.62:6809/3784842938","cluster_addr":"172.21.15.62:6811/3784842938","heartbeat_back_addr":"172.21.15.62:6815/3784842938","heartbeat_front_addr":"172.21.15.62:6813/3784842938","state":["exists","up"]},{"osd":3,"uuid":"1770bdb8-c12b-43b1-aaab-1d6b6fd18f4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6817","nonce":3385303160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6821","nonce":3385303160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6827","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6829","nonce":3385303160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6823","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6825","nonce":3385303160}]},"public_addr":"172.21.15.62:6817/3385303160","cluster_addr":"172.21.15.62:6821/3385303160","heartbeat_back_addr":"172.21.15.62:6829/3385303160","heartbeat_front_addr":"172.21.15.62:6825/3385303160","state":["exists","up"]},{"osd":4,"uuid":"74c73631-9351-494a-8246-28ee86e9f862","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6807","nonce":1174056987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6809","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6811","nonce":1174056987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6820","nonce":1174056987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6813","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6816","nonce":1174056987}]},"public_addr":"172.21.15.130:6807/1174056987","cluster_addr":"172.21.15.130:6811/1174056987","heartbeat_back_addr":"172.21.15.130:6820/1174056987","heartbeat_front_addr":"172.21.15.130:6816/1174056987","state":["exists","up"]},{"osd":5,"uuid":"1040f389-272c-41d6-ae76-70c04d09afa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6801","nonce":561928414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6803","nonce":561928414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6815","nonce":561928414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6808","nonce":561928414}]},"public_addr":"172.21.15.130:6801/561928414","cluster_addr":"172.21.15.130:6803/561928414","heartbeat_back_addr":"172.21.15.130:6815/561928414","heartbeat_front_addr":"172.21.15.130:6808/561928414","state":["exists","up"]},{"osd":6,"uuid":"178553eb-03e1-4ab8-9826-4f5997e6da0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6810","nonce":2877303015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6817","nonce":2877303015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6823","nonce":2877303015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6819","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6821","nonce":2877303015}]},"public_addr":"172.21.15.130:6810/2877303015","cluster_addr":"172.21.15.130:6817/2877303015","heartbeat_back_addr":"172.21.15.130:6823/2877303015","heartbeat_front_addr":"172.21.15.130:6821/2877303015","state":["exists","up"]},{"osd":7,"uuid":"b6581c8f-30b1-4dfd-b7b6-94b579128835","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6825","nonce":680009774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6827","nonce":680009774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6831","nonce":680009774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6829","nonce":680009774}]},"public_addr":"172.21.15.130:6825/680009774","cluster_addr":"172.21.15.130:6827/680009774","heartbeat_back_addr":"172.21.15.130:6831/680009774","heartbeat_front_addr":"172.21.15.130:6829/680009774","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.505543+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.394383+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.456652+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.529168+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.235414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.392158+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.347556+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.432039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:00:31.735 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.731+0000 7fb9dbc33640 1 -- 172.21.15.62:0/4072418092 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fb9b8066470 msgr2=0x7fb9b8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:31.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.731+0000 7fb9dbc33640 1 --2- 172.21.15.62:0/4072418092 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fb9b8066470 0x7fb9b8068930 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb9c40b2000 tx=0x7fb9c401eb80 comp rx=0 tx=0).stop 2023-10-08T12:00:31.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.731+0000 7fb9dbc33640 1 -- 172.21.15.62:0/4072418092 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9d40b09e0 msgr2=0x7fb9d4141a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:31.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.731+0000 7fb9dbc33640 1 --2- 172.21.15.62:0/4072418092 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9d40b09e0 0x7fb9d4141a90 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb9d000d9b0 tx=0x7fb9d000de70 comp rx=0 tx=0).stop 2023-10-08T12:00:31.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.731+0000 7fb9dbc33640 1 -- 172.21.15.62:0/4072418092 shutdown_connections 2023-10-08T12:00:31.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.731+0000 7fb9dbc33640 1 --2- 172.21.15.62:0/4072418092 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fb9b8066470 0x7fb9b8068930 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:31.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.731+0000 7fb9dbc33640 1 --2- 172.21.15.62:0/4072418092 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb9d40b9e60 0x7fb9d4146b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:31.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.731+0000 7fb9dbc33640 1 --2- 172.21.15.62:0/4072418092 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb9d40ba240 0x7fb9d41de9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:31.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.731+0000 7fb9dbc33640 1 --2- 172.21.15.62:0/4072418092 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9d40b09e0 0x7fb9d4141a90 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:31.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.731+0000 7fb9dbc33640 1 -- 172.21.15.62:0/4072418092 >> 172.21.15.62:0/4072418092 conn(0x7fb9d409c520 msgr2=0x7fb9d4097a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:31.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.731+0000 7fb9dbc33640 1 -- 172.21.15.62:0/4072418092 shutdown_connections 2023-10-08T12:00:31.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.731+0000 7fb9dbc33640 1 -- 172.21.15.62:0/4072418092 wait complete. 2023-10-08T12:00:31.752 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T12:00:07.189433+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T12:00:17.895548+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T12:00:18.871217+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T12:00:31.752 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T12:00:31.873 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.867+0000 7f0157d89640 1 -- 172.21.15.62:0/2128292240 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0150149a10 msgr2=0x7f0150149e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:31.873 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.867+0000 7f0157d89640 1 --2- 172.21.15.62:0/2128292240 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0150149a10 0x7f0150149e20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f015006a560 tx=0x7f014001c7d0 comp rx=0 tx=0).stop 2023-10-08T12:00:31.873 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.867+0000 7f0157d89640 1 -- 172.21.15.62:0/2128292240 shutdown_connections 2023-10-08T12:00:31.873 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.867+0000 7f0157d89640 1 --2- 172.21.15.62:0/2128292240 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0150149a10 0x7f0150149e20 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:31.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.867+0000 7f0157d89640 1 --2- 172.21.15.62:0/2128292240 >> v2:172.21.15.130:3300/0 conn(0x7f01500b99e0 0x7f015009d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:31.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.867+0000 7f0157d89640 1 -- 172.21.15.62:0/2128292240 >> 172.21.15.62:0/2128292240 conn(0x7f015009c520 msgr2=0x7f015009c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:31.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.867+0000 7f0157d89640 1 -- 172.21.15.62:0/2128292240 shutdown_connections 2023-10-08T12:00:31.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.867+0000 7f0157d89640 1 -- 172.21.15.62:0/2128292240 wait complete. 2023-10-08T12:00:31.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.871+0000 7f0157d89640 1 Processor -- start 2023-10-08T12:00:31.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.871+0000 7f0157d89640 1 -- start start 2023-10-08T12:00:31.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.871+0000 7f0157d89640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f01500b5480 0x7f01500b8670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:31.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.871+0000 7f0157d89640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f01500b99e0 0x7f01501e2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:31.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.871+0000 7f0157d89640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0150149a10 0x7f01501e34c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:31.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.871+0000 7f0157d89640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01500b4680 con 0x7f01500b5480 2023-10-08T12:00:31.877 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.871+0000 7f0157d89640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01500b48d0 con 0x7f01500b99e0 2023-10-08T12:00:31.877 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.871+0000 7f0157d89640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f015009f3e0 con 0x7f0150149a10 2023-10-08T12:00:31.877 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.871+0000 7f0155b25640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f01500b5480 0x7f01500b8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:31.877 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.871+0000 7f0155b25640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f01500b5480 0x7f01500b8670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:44146/0 (socket says 172.21.15.62:44146) 2023-10-08T12:00:31.877 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.871+0000 7f0155b25640 1 -- 172.21.15.62:0/2570016210 learned_addr learned my addr 172.21.15.62:0/2570016210 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:31.877 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.871+0000 7f0156326640 1 --2- 172.21.15.62:0/2570016210 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0150149a10 0x7f01501e34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:31.877 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.871+0000 7f0155324640 1 --2- 172.21.15.62:0/2570016210 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f01500b99e0 0x7f01501e2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:31.877 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.871+0000 7f0155b25640 1 -- 172.21.15.62:0/2570016210 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0150149a10 msgr2=0x7f01501e34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:31.877 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.871+0000 7f0155b25640 1 --2- 172.21.15.62:0/2570016210 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0150149a10 0x7f01501e34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:31.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.871+0000 7f0155b25640 1 -- 172.21.15.62:0/2570016210 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f01500b99e0 msgr2=0x7f01501e2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:31.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.871+0000 7f0155b25640 1 --2- 172.21.15.62:0/2570016210 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f01500b99e0 0x7f01501e2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:31.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.871+0000 7f0155b25640 1 -- 172.21.15.62:0/2570016210 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0140009560 con 0x7f01500b5480 2023-10-08T12:00:31.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.871+0000 7f0155b25640 1 --2- 172.21.15.62:0/2570016210 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f01500b5480 0x7f01500b8670 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f014800b550 tx=0x7f014800ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:31.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.871+0000 7f01467fc640 1 -- 172.21.15.62:0/2570016210 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0148010870 con 0x7f01500b5480 2023-10-08T12:00:31.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.871+0000 7f01467fc640 1 -- 172.21.15.62:0/2570016210 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0148010ae0 con 0x7f01500b5480 2023-10-08T12:00:31.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.871+0000 7f01467fc640 1 -- 172.21.15.62:0/2570016210 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f014800f3c0 con 0x7f01500b5480 2023-10-08T12:00:31.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.871+0000 7f0157d89640 1 -- 172.21.15.62:0/2570016210 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f015009f6c0 con 0x7f01500b5480 2023-10-08T12:00:31.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.871+0000 7f0157d89640 1 -- 172.21.15.62:0/2570016210 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f015013d2c0 con 0x7f01500b5480 2023-10-08T12:00:31.879 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.871+0000 7f0157d89640 1 -- 172.21.15.62:0/2570016210 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f015009fbe0 con 0x7f01500b5480 2023-10-08T12:00:31.879 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.875+0000 7f01467fc640 1 -- 172.21.15.62:0/2570016210 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f014800f520 con 0x7f01500b5480 2023-10-08T12:00:31.879 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.875+0000 7f01467fc640 1 --2- 172.21.15.62:0/2570016210 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f013c066470 0x7f013c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:31.880 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.875+0000 7f01467fc640 1 -- 172.21.15.62:0/2570016210 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0148084390 con 0x7f01500b5480 2023-10-08T12:00:31.880 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.875+0000 7f0155324640 1 --2- 172.21.15.62:0/2570016210 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f013c066470 0x7f013c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:31.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.875+0000 7f0155324640 1 --2- 172.21.15.62:0/2570016210 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f013c066470 0x7f013c068930 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0150140df0 tx=0x7f014c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:31.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:31.879+0000 7f01467fc640 1 -- 172.21.15.62:0/2570016210 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0148051860 con 0x7f01500b5480 2023-10-08T12:00:32.032 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.027+0000 7f0157d89640 1 -- 172.21.15.62:0/2570016210 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f015004da80 con 0x7f01500b5480 2023-10-08T12:00:32.033 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.027+0000 7f01467fc640 1 -- 172.21.15.62:0/2570016210 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f014801e0a0 con 0x7f01500b5480 2023-10-08T12:00:32.033 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2023-10-08T12:00:32.035 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.031+0000 7f0157d89640 1 -- 172.21.15.62:0/2570016210 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f013c066470 msgr2=0x7f013c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:32.035 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.031+0000 7f0157d89640 1 --2- 172.21.15.62:0/2570016210 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f013c066470 0x7f013c068930 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0150140df0 tx=0x7f014c009040 comp rx=0 tx=0).stop 2023-10-08T12:00:32.035 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.031+0000 7f0157d89640 1 -- 172.21.15.62:0/2570016210 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f01500b5480 msgr2=0x7f01500b8670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:32.035 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.031+0000 7f0157d89640 1 --2- 172.21.15.62:0/2570016210 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f01500b5480 0x7f01500b8670 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f014800b550 tx=0x7f014800ba10 comp rx=0 tx=0).stop 2023-10-08T12:00:32.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.031+0000 7f0157d89640 1 -- 172.21.15.62:0/2570016210 shutdown_connections 2023-10-08T12:00:32.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.031+0000 7f0157d89640 1 --2- 172.21.15.62:0/2570016210 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f013c066470 0x7f013c068930 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:32.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.031+0000 7f0157d89640 1 --2- 172.21.15.62:0/2570016210 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0150149a10 0x7f01501e34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:32.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.031+0000 7f0157d89640 1 --2- 172.21.15.62:0/2570016210 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f01500b99e0 0x7f01501e2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:32.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.031+0000 7f0157d89640 1 --2- 172.21.15.62:0/2570016210 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f01500b5480 0x7f01500b8670 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:32.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.031+0000 7f0157d89640 1 -- 172.21.15.62:0/2570016210 >> 172.21.15.62:0/2570016210 conn(0x7f015009c520 msgr2=0x7f015009cb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:32.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.031+0000 7f0157d89640 1 -- 172.21.15.62:0/2570016210 shutdown_connections 2023-10-08T12:00:32.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.031+0000 7f0157d89640 1 -- 172.21.15.62:0/2570016210 wait complete. 2023-10-08T12:00:32.053 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T12:00:32.181 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.175+0000 7fea1dc71640 1 -- 172.21.15.62:0/4264673699 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea04003980 msgr2=0x7fea04003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:32.181 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.175+0000 7fea1dc71640 1 --2- 172.21.15.62:0/4264673699 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea04003980 0x7fea04003d80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fea08006fd0 tx=0x7fea0801cfc0 comp rx=0 tx=0).stop 2023-10-08T12:00:32.181 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.175+0000 7fea1dc71640 1 -- 172.21.15.62:0/4264673699 shutdown_connections 2023-10-08T12:00:32.181 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.175+0000 7fea1dc71640 1 --2- 172.21.15.62:0/4264673699 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea04003980 0x7fea04003d80 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:32.181 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.175+0000 7fea1dc71640 1 -- 172.21.15.62:0/4264673699 >> 172.21.15.62:0/4264673699 conn(0x7fea1809c520 msgr2=0x7fea1809c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:32.181 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.175+0000 7fea1dc71640 1 -- 172.21.15.62:0/4264673699 shutdown_connections 2023-10-08T12:00:32.181 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.175+0000 7fea1dc71640 1 -- 172.21.15.62:0/4264673699 wait complete. 2023-10-08T12:00:32.183 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.179+0000 7fea1dc71640 1 Processor -- start 2023-10-08T12:00:32.184 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.179+0000 7fea1dc71640 1 -- start start 2023-10-08T12:00:32.184 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.179+0000 7fea1dc71640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fea04003980 0x7fea18070da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:32.184 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.179+0000 7fea1dc71640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea181e2c80 0x7fea1806fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:32.184 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.179+0000 7fea1dc71640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fea180b44c0 0x7fea1806e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:32.184 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.179+0000 7fea1dc71640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea181e3220 con 0x7fea181e2c80 2023-10-08T12:00:32.184 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.179+0000 7fea1dc71640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea181e3500 con 0x7fea04003980 2023-10-08T12:00:32.184 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.179+0000 7fea1dc71640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea181e37e0 con 0x7fea180b44c0 2023-10-08T12:00:32.184 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.179+0000 7fea0effd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea181e2c80 0x7fea1806fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:32.184 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.179+0000 7fea0effd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea181e2c80 0x7fea1806fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:44166/0 (socket says 172.21.15.62:44166) 2023-10-08T12:00:32.184 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.179+0000 7fea0effd640 1 -- 172.21.15.62:0/2791501110 learned_addr learned my addr 172.21.15.62:0/2791501110 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:32.184 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.179+0000 7fea17fff640 1 --2- 172.21.15.62:0/2791501110 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fea180b44c0 0x7fea1806e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:32.184 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.179+0000 7fea177fe640 1 --2- 172.21.15.62:0/2791501110 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fea04003980 0x7fea18070da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:32.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.179+0000 7fea0effd640 1 -- 172.21.15.62:0/2791501110 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fea180b44c0 msgr2=0x7fea1806e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:32.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.179+0000 7fea0effd640 1 --2- 172.21.15.62:0/2791501110 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fea180b44c0 0x7fea1806e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:32.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.179+0000 7fea0effd640 1 -- 172.21.15.62:0/2791501110 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fea04003980 msgr2=0x7fea18070da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:32.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.179+0000 7fea0effd640 1 --2- 172.21.15.62:0/2791501110 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fea04003980 0x7fea18070da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:32.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.179+0000 7fea0effd640 1 -- 172.21.15.62:0/2791501110 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea181e3ac0 con 0x7fea181e2c80 2023-10-08T12:00:32.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.179+0000 7fea177fe640 1 --2- 172.21.15.62:0/2791501110 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fea04003980 0x7fea18070da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:00:32.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.179+0000 7fea0effd640 1 --2- 172.21.15.62:0/2791501110 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea181e2c80 0x7fea1806fe00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fea0000d990 tx=0x7fea0000de50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:32.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.179+0000 7fea14ff9640 1 -- 172.21.15.62:0/2791501110 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea00008c60 con 0x7fea181e2c80 2023-10-08T12:00:32.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.179+0000 7fea14ff9640 1 -- 172.21.15.62:0/2791501110 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fea00008dc0 con 0x7fea181e2c80 2023-10-08T12:00:32.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.179+0000 7fea14ff9640 1 -- 172.21.15.62:0/2791501110 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea00004280 con 0x7fea181e2c80 2023-10-08T12:00:32.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.179+0000 7fea1dc71640 1 -- 172.21.15.62:0/2791501110 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea180af790 con 0x7fea181e2c80 2023-10-08T12:00:32.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.179+0000 7fea1dc71640 1 -- 172.21.15.62:0/2791501110 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea18070510 con 0x7fea181e2c80 2023-10-08T12:00:32.187 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.179+0000 7fea1dc71640 1 -- 172.21.15.62:0/2791501110 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea180b5be0 con 0x7fea181e2c80 2023-10-08T12:00:32.187 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.179+0000 7fea14ff9640 1 -- 172.21.15.62:0/2791501110 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fea00003600 con 0x7fea181e2c80 2023-10-08T12:00:32.187 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.179+0000 7fea14ff9640 1 --2- 172.21.15.62:0/2791501110 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fe9f80664a0 0x7fe9f8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:32.187 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.183+0000 7fea14ff9640 1 -- 172.21.15.62:0/2791501110 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fea00013070 con 0x7fea181e2c80 2023-10-08T12:00:32.187 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.183+0000 7fea177fe640 1 --2- 172.21.15.62:0/2791501110 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fe9f80664a0 0x7fe9f8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:32.187 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.183+0000 7fea177fe640 1 --2- 172.21.15.62:0/2791501110 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fe9f80664a0 0x7fe9f8068960 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fea080ac000 tx=0x7fea08019d60 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:32.189 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.187+0000 7fea14ff9640 1 -- 172.21.15.62:0/2791501110 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fea00051ad0 con 0x7fea181e2c80 2023-10-08T12:00:32.339 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.331+0000 7fea1dc71640 1 -- 172.21.15.62:0/2791501110 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fea181e3360 con 0x7fea181e2c80 2023-10-08T12:00:32.339 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.331+0000 7fea14ff9640 1 -- 172.21.15.62:0/2791501110 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fea181e3360 con 0x7fea181e2c80 2023-10-08T12:00:32.339 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-10-08T12:00:32.340 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.335+0000 7fea1dc71640 1 -- 172.21.15.62:0/2791501110 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fe9f80664a0 msgr2=0x7fe9f8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:32.340 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.335+0000 7fea1dc71640 1 --2- 172.21.15.62:0/2791501110 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fe9f80664a0 0x7fe9f8068960 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fea080ac000 tx=0x7fea08019d60 comp rx=0 tx=0).stop 2023-10-08T12:00:32.340 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.335+0000 7fea1dc71640 1 -- 172.21.15.62:0/2791501110 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea181e2c80 msgr2=0x7fea1806fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:32.340 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.335+0000 7fea1dc71640 1 --2- 172.21.15.62:0/2791501110 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea181e2c80 0x7fea1806fe00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fea0000d990 tx=0x7fea0000de50 comp rx=0 tx=0).stop 2023-10-08T12:00:32.340 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.335+0000 7fea1dc71640 1 -- 172.21.15.62:0/2791501110 shutdown_connections 2023-10-08T12:00:32.340 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.335+0000 7fea1dc71640 1 --2- 172.21.15.62:0/2791501110 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fe9f80664a0 0x7fe9f8068960 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:32.340 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.335+0000 7fea1dc71640 1 --2- 172.21.15.62:0/2791501110 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fea180b44c0 0x7fea1806e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:32.340 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.335+0000 7fea1dc71640 1 --2- 172.21.15.62:0/2791501110 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea181e2c80 0x7fea1806fe00 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:32.340 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.335+0000 7fea1dc71640 1 --2- 172.21.15.62:0/2791501110 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fea04003980 0x7fea18070da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:32.341 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.335+0000 7fea1dc71640 1 -- 172.21.15.62:0/2791501110 >> 172.21.15.62:0/2791501110 conn(0x7fea1809c520 msgr2=0x7fea1806a930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:32.341 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.335+0000 7fea1dc71640 1 -- 172.21.15.62:0/2791501110 shutdown_connections 2023-10-08T12:00:32.341 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.335+0000 7fea1dc71640 1 -- 172.21.15.62:0/2791501110 wait complete. 2023-10-08T12:00:32.353 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T12:00:32.470 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.467+0000 7fe75a256640 1 -- 172.21.15.62:0/1795001582 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe7540b9260 msgr2=0x7fe7540b8570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:32.470 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.467+0000 7fe75a256640 1 --2- 172.21.15.62:0/1795001582 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe7540b9260 0x7fe7540b8570 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe7540b4e30 tx=0x7fe74c01cd60 comp rx=0 tx=0).stop 2023-10-08T12:00:32.470 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.467+0000 7fe75a256640 1 -- 172.21.15.62:0/1795001582 shutdown_connections 2023-10-08T12:00:32.470 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.467+0000 7fe75a256640 1 --2- 172.21.15.62:0/1795001582 >> v2:172.21.15.130:3300/0 conn(0x7fe754071410 0x7fe754146d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:32.470 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.467+0000 7fe75a256640 1 --2- 172.21.15.62:0/1795001582 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe754147920 0x7fe7540b6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:32.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.467+0000 7fe75a256640 1 --2- 172.21.15.62:0/1795001582 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe7540b9260 0x7fe7540b8570 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:32.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.467+0000 7fe75a256640 1 -- 172.21.15.62:0/1795001582 >> 172.21.15.62:0/1795001582 conn(0x7fe75409c520 msgr2=0x7fe75409c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:32.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.467+0000 7fe75a256640 1 -- 172.21.15.62:0/1795001582 shutdown_connections 2023-10-08T12:00:32.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.467+0000 7fe75a256640 1 -- 172.21.15.62:0/1795001582 wait complete. 2023-10-08T12:00:32.473 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.467+0000 7fe75a256640 1 Processor -- start 2023-10-08T12:00:32.473 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.467+0000 7fe75a256640 1 -- start start 2023-10-08T12:00:32.473 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.467+0000 7fe75a256640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe754071410 0x7fe754099040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:32.473 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.467+0000 7fe75a256640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe7540b9260 0x7fe754098000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:32.473 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.467+0000 7fe75a256640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe754147920 0x7fe7540b0180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:32.474 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.467+0000 7fe75a256640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe754098540 con 0x7fe7540b9260 2023-10-08T12:00:32.474 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.467+0000 7fe75a256640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7541e28c0 con 0x7fe754071410 2023-10-08T12:00:32.474 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.467+0000 7fe75a256640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7541485d0 con 0x7fe754147920 2023-10-08T12:00:32.474 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.467+0000 7fe752ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe7540b9260 0x7fe754098000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:32.474 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.467+0000 7fe752ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe7540b9260 0x7fe754098000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:44184/0 (socket says 172.21.15.62:44184) 2023-10-08T12:00:32.474 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.467+0000 7fe752ffd640 1 -- 172.21.15.62:0/3094284263 learned_addr learned my addr 172.21.15.62:0/3094284263 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:32.474 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.467+0000 7fe7537fe640 1 --2- 172.21.15.62:0/3094284263 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe754071410 0x7fe754099040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:32.474 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.467+0000 7fe753fff640 1 --2- 172.21.15.62:0/3094284263 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe754147920 0x7fe7540b0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:32.474 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.467+0000 7fe752ffd640 1 -- 172.21.15.62:0/3094284263 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe754147920 msgr2=0x7fe7540b0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:32.474 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.467+0000 7fe752ffd640 1 --2- 172.21.15.62:0/3094284263 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe754147920 0x7fe7540b0180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:32.475 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.467+0000 7fe752ffd640 1 -- 172.21.15.62:0/3094284263 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe754071410 msgr2=0x7fe754099040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:32.475 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.467+0000 7fe752ffd640 1 --2- 172.21.15.62:0/3094284263 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe754071410 0x7fe754099040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:32.475 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.467+0000 7fe752ffd640 1 -- 172.21.15.62:0/3094284263 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe74c0098e0 con 0x7fe7540b9260 2023-10-08T12:00:32.475 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.467+0000 7fe7537fe640 1 --2- 172.21.15.62:0/3094284263 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe754071410 0x7fe754099040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:00:32.475 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.467+0000 7fe752ffd640 1 --2- 172.21.15.62:0/3094284263 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe7540b9260 0x7fe754098000 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe73c00b410 tx=0x7fe73c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:32.475 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.467+0000 7fe74bfff640 1 -- 172.21.15.62:0/3094284263 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73c011830 con 0x7fe7540b9260 2023-10-08T12:00:32.475 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.467+0000 7fe74bfff640 1 -- 172.21.15.62:0/3094284263 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe73c011a80 con 0x7fe7540b9260 2023-10-08T12:00:32.475 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.467+0000 7fe75a256640 1 -- 172.21.15.62:0/3094284263 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7540af790 con 0x7fe7540b9260 2023-10-08T12:00:32.475 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.467+0000 7fe74bfff640 1 -- 172.21.15.62:0/3094284263 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73c011e90 con 0x7fe7540b9260 2023-10-08T12:00:32.475 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.467+0000 7fe75a256640 1 -- 172.21.15.62:0/3094284263 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7541e2550 con 0x7fe7540b9260 2023-10-08T12:00:32.476 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.467+0000 7fe75a256640 1 -- 172.21.15.62:0/3094284263 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7540b5be0 con 0x7fe7540b9260 2023-10-08T12:00:32.476 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.471+0000 7fe74bfff640 1 -- 172.21.15.62:0/3094284263 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe73c01a400 con 0x7fe7540b9260 2023-10-08T12:00:32.477 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.471+0000 7fe74bfff640 1 --2- 172.21.15.62:0/3094284263 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fe738066470 0x7fe738068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:32.477 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.471+0000 7fe74bfff640 1 -- 172.21.15.62:0/3094284263 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe73c0842f0 con 0x7fe7540b9260 2023-10-08T12:00:32.477 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.471+0000 7fe7537fe640 1 --2- 172.21.15.62:0/3094284263 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fe738066470 0x7fe738068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:32.477 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.471+0000 7fe7537fe640 1 --2- 172.21.15.62:0/3094284263 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fe738066470 0x7fe738068930 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe74c0af000 tx=0x7fe74c01b5a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:32.478 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.475+0000 7fe74bfff640 1 -- 172.21.15.62:0/3094284263 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe73c051780 con 0x7fe7540b9260 2023-10-08T12:00:32.633 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.627+0000 7fe75a256640 1 -- 172.21.15.62:0/3094284263 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe75404da80 con 0x7fe7540b9260 2023-10-08T12:00:32.634 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.631+0000 7fe74bfff640 1 -- 172.21.15.62:0/3094284263 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe73c054da0 con 0x7fe7540b9260 2023-10-08T12:00:32.634 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 64 2023-10-08T12:00:32.637 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.631+0000 7fe75a256640 1 -- 172.21.15.62:0/3094284263 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fe738066470 msgr2=0x7fe738068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:32.637 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.631+0000 7fe75a256640 1 --2- 172.21.15.62:0/3094284263 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fe738066470 0x7fe738068930 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe74c0af000 tx=0x7fe74c01b5a0 comp rx=0 tx=0).stop 2023-10-08T12:00:32.637 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.631+0000 7fe75a256640 1 -- 172.21.15.62:0/3094284263 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe7540b9260 msgr2=0x7fe754098000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:32.637 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.631+0000 7fe75a256640 1 --2- 172.21.15.62:0/3094284263 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe7540b9260 0x7fe754098000 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe73c00b410 tx=0x7fe73c00b8d0 comp rx=0 tx=0).stop 2023-10-08T12:00:32.637 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.631+0000 7fe75a256640 1 -- 172.21.15.62:0/3094284263 shutdown_connections 2023-10-08T12:00:32.637 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.631+0000 7fe75a256640 1 --2- 172.21.15.62:0/3094284263 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fe738066470 0x7fe738068930 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:32.637 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.631+0000 7fe75a256640 1 --2- 172.21.15.62:0/3094284263 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe754147920 0x7fe7540b0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:32.637 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.631+0000 7fe75a256640 1 --2- 172.21.15.62:0/3094284263 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe7540b9260 0x7fe754098000 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:32.637 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.631+0000 7fe75a256640 1 --2- 172.21.15.62:0/3094284263 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe754071410 0x7fe754099040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:32.637 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.631+0000 7fe75a256640 1 -- 172.21.15.62:0/3094284263 >> 172.21.15.62:0/3094284263 conn(0x7fe75409c520 msgr2=0x7fe754141d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:32.637 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.631+0000 7fe75a256640 1 -- 172.21.15.62:0/3094284263 shutdown_connections 2023-10-08T12:00:32.638 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.631+0000 7fe75a256640 1 -- 172.21.15.62:0/3094284263 wait complete. 2023-10-08T12:00:32.653 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:00:32.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.767+0000 7fee60aff640 1 -- 172.21.15.62:0/482483637 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee44004d10 msgr2=0x7fee44005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:32.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.767+0000 7fee60aff640 1 --2- 172.21.15.62:0/482483637 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee44004d10 0x7fee44005190 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fee54001dd0 tx=0x7fee5401cb00 comp rx=0 tx=0).stop 2023-10-08T12:00:32.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.767+0000 7fee5ad9d640 1 -- 172.21.15.62:0/482483637 reap_dead start 2023-10-08T12:00:32.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.767+0000 7fee60aff640 1 -- 172.21.15.62:0/482483637 shutdown_connections 2023-10-08T12:00:32.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.767+0000 7fee60aff640 1 -- 172.21.15.62:0/482483637 >> 172.21.15.62:0/482483637 conn(0x7fee5c09c520 msgr2=0x7fee5c09c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:32.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.767+0000 7fee60aff640 1 -- 172.21.15.62:0/482483637 shutdown_connections 2023-10-08T12:00:32.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.767+0000 7fee60aff640 1 -- 172.21.15.62:0/482483637 wait complete. 2023-10-08T12:00:32.776 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.771+0000 7fee60aff640 1 Processor -- start 2023-10-08T12:00:32.777 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.771+0000 7fee60aff640 1 -- start start 2023-10-08T12:00:32.777 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.771+0000 7fee60aff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fee44004d10 0x7fee5c0b3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:32.777 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.771+0000 7fee60aff640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fee5c144980 0x7fee5c140550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:32.777 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.771+0000 7fee60aff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee5c144e00 0x7fee5c140a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:32.777 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.771+0000 7fee60aff640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee5c0b3c80 con 0x7fee5c144e00 2023-10-08T12:00:32.777 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.771+0000 7fee60aff640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee5c145c50 con 0x7fee44004d10 2023-10-08T12:00:32.777 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.771+0000 7fee60aff640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee5c0b3e60 con 0x7fee5c144980 2023-10-08T12:00:32.777 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.771+0000 7fee5ad9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee5c144e00 0x7fee5c140a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:32.777 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.771+0000 7fee5ad9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee5c144e00 0x7fee5c140a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:44202/0 (socket says 172.21.15.62:44202) 2023-10-08T12:00:32.777 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.771+0000 7fee5ad9d640 1 -- 172.21.15.62:0/3029545271 learned_addr learned my addr 172.21.15.62:0/3029545271 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:32.777 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.771+0000 7fee5a59c640 1 --2- 172.21.15.62:0/3029545271 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fee44004d10 0x7fee5c0b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:32.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.771+0000 7fee59d9b640 1 --2- 172.21.15.62:0/3029545271 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fee5c144980 0x7fee5c140550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:32.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.771+0000 7fee5ad9d640 1 -- 172.21.15.62:0/3029545271 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fee5c144980 msgr2=0x7fee5c140550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:32.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.771+0000 7fee5ad9d640 1 --2- 172.21.15.62:0/3029545271 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fee5c144980 0x7fee5c140550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:32.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.771+0000 7fee5ad9d640 1 -- 172.21.15.62:0/3029545271 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fee44004d10 msgr2=0x7fee5c0b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:32.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.771+0000 7fee5ad9d640 1 --2- 172.21.15.62:0/3029545271 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fee44004d10 0x7fee5c0b3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:32.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.771+0000 7fee5ad9d640 1 -- 172.21.15.62:0/3029545271 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee5c144280 con 0x7fee5c144e00 2023-10-08T12:00:32.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.771+0000 7fee5ad9d640 1 --2- 172.21.15.62:0/3029545271 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee5c144e00 0x7fee5c140a90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fee540aa040 tx=0x7fee540a7f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:32.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.771+0000 7fee4affd640 1 -- 172.21.15.62:0/3029545271 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee540a5910 con 0x7fee5c144e00 2023-10-08T12:00:32.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.771+0000 7fee4affd640 1 -- 172.21.15.62:0/3029545271 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fee540a5b60 con 0x7fee5c144e00 2023-10-08T12:00:32.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.771+0000 7fee60aff640 1 -- 172.21.15.62:0/3029545271 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee5c146180 con 0x7fee5c144e00 2023-10-08T12:00:32.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.771+0000 7fee4affd640 1 -- 172.21.15.62:0/3029545271 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee540a5d30 con 0x7fee5c144e00 2023-10-08T12:00:32.779 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.771+0000 7fee60aff640 1 -- 172.21.15.62:0/3029545271 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee5c143f10 con 0x7fee5c144e00 2023-10-08T12:00:32.779 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.771+0000 7fee60aff640 1 -- 172.21.15.62:0/3029545271 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee5c144410 con 0x7fee5c144e00 2023-10-08T12:00:32.780 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.771+0000 7fee4affd640 1 -- 172.21.15.62:0/3029545271 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fee540b5070 con 0x7fee5c144e00 2023-10-08T12:00:32.780 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.775+0000 7fee4affd640 1 --2- 172.21.15.62:0/3029545271 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fee3c066470 0x7fee3c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:32.780 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.775+0000 7fee4affd640 1 -- 172.21.15.62:0/3029545271 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fee540aa070 con 0x7fee5c144e00 2023-10-08T12:00:32.780 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.775+0000 7fee5a59c640 1 --2- 172.21.15.62:0/3029545271 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fee3c066470 0x7fee3c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:32.780 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.775+0000 7fee5a59c640 1 --2- 172.21.15.62:0/3029545271 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fee3c066470 0x7fee3c068930 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fee500049d0 tx=0x7fee50001e40 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:32.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.779+0000 7fee4affd640 1 -- 172.21.15.62:0/3029545271 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fee540eb7f0 con 0x7fee5c144e00 2023-10-08T12:00:32.973 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.967+0000 7fee60aff640 1 -- 172.21.15.62:0/3029545271 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fee5c04da80 con 0x7fee5c144e00 2023-10-08T12:00:32.974 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.971+0000 7fee4affd640 1 -- 172.21.15.62:0/3029545271 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4120 (secure 0 0 0) 0x7fee540eee10 con 0x7fee5c144e00 2023-10-08T12:00:32.974 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T12:00:32.974 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4334,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/2629778704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":2629778704},{"type":"v1","addr":"172.21.15.130:6835","nonce":2629778704}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4359,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/2134446062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":2134446062},{"type":"v1","addr":"172.21.15.62:6835","nonce":2134446062}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T12:00:19.866714+0000","modified":"2023-10-08T12:00:22.958677+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4362},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4362":{"gid":4362,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6834/2629384568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":2629384568},{"type":"v1","addr":"172.21.15.62:6834","nonce":2629384568}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:00:32.974 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 8 2023-10-08T12:00:32.976 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.971+0000 7fee60aff640 1 -- 172.21.15.62:0/3029545271 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fee3c066470 msgr2=0x7fee3c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:32.976 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.971+0000 7fee60aff640 1 --2- 172.21.15.62:0/3029545271 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fee3c066470 0x7fee3c068930 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fee500049d0 tx=0x7fee50001e40 comp rx=0 tx=0).stop 2023-10-08T12:00:32.977 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.971+0000 7fee60aff640 1 -- 172.21.15.62:0/3029545271 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee5c144e00 msgr2=0x7fee5c140a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:32.977 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.971+0000 7fee60aff640 1 --2- 172.21.15.62:0/3029545271 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee5c144e00 0x7fee5c140a90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fee540aa040 tx=0x7fee540a7f30 comp rx=0 tx=0).stop 2023-10-08T12:00:32.977 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.971+0000 7fee60aff640 1 -- 172.21.15.62:0/3029545271 shutdown_connections 2023-10-08T12:00:32.977 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.971+0000 7fee60aff640 1 --2- 172.21.15.62:0/3029545271 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fee3c066470 0x7fee3c068930 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:32.977 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.971+0000 7fee60aff640 1 --2- 172.21.15.62:0/3029545271 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fee5c144980 0x7fee5c140550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:32.977 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.971+0000 7fee60aff640 1 --2- 172.21.15.62:0/3029545271 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee5c144e00 0x7fee5c140a90 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:32.978 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.971+0000 7fee60aff640 1 --2- 172.21.15.62:0/3029545271 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fee44004d10 0x7fee5c0b3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:32.978 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.971+0000 7fee60aff640 1 -- 172.21.15.62:0/3029545271 >> 172.21.15.62:0/3029545271 conn(0x7fee5c09c520 msgr2=0x7fee5c09ab10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:32.978 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.971+0000 7fee60aff640 1 -- 172.21.15.62:0/3029545271 shutdown_connections 2023-10-08T12:00:32.978 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:32.971+0000 7fee60aff640 1 -- 172.21.15.62:0/3029545271 wait complete. 2023-10-08T12:00:32.992 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:00:33.110 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.107+0000 7f1aa4a14640 1 -- 172.21.15.62:0/217640883 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1aa0149910 msgr2=0x7f1aa0149d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:33.111 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.107+0000 7f1aa4a14640 1 --2- 172.21.15.62:0/217640883 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1aa0149910 0x7f1aa0149d80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1a98009c80 tx=0x7f1a9801cd10 comp rx=0 tx=0).stop 2023-10-08T12:00:33.111 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.107+0000 7f1aa4a14640 1 -- 172.21.15.62:0/217640883 shutdown_connections 2023-10-08T12:00:33.111 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.107+0000 7f1aa4a14640 1 --2- 172.21.15.62:0/217640883 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1aa0149910 0x7f1aa0149d80 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:33.111 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.107+0000 7f1aa4a14640 1 --2- 172.21.15.62:0/217640883 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1aa00b99e0 0x7f1aa009d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:33.111 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.107+0000 7f1aa4a14640 1 -- 172.21.15.62:0/217640883 >> 172.21.15.62:0/217640883 conn(0x7f1aa009c520 msgr2=0x7f1aa009c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:33.111 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.107+0000 7f1aa4a14640 1 -- 172.21.15.62:0/217640883 shutdown_connections 2023-10-08T12:00:33.111 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.107+0000 7f1aa4a14640 1 -- 172.21.15.62:0/217640883 wait complete. 2023-10-08T12:00:33.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.107+0000 7f1aa4a14640 1 Processor -- start 2023-10-08T12:00:33.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.107+0000 7f1aa4a14640 1 -- start start 2023-10-08T12:00:33.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.107+0000 7f1aa4a14640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1aa00b5170 0x7f1aa0146a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:33.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.107+0000 7f1aa4a14640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1aa00b99e0 0x7f1aa0070600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:33.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.107+0000 7f1aa4a14640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1aa0149910 0x7f1aa006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:33.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.107+0000 7f1aa4a14640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa0146fd0 con 0x7f1aa0149910 2023-10-08T12:00:33.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.107+0000 7f1aa4a14640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa01501f0 con 0x7f1aa00b99e0 2023-10-08T12:00:33.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.107+0000 7f1aa4a14640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa006e700 con 0x7f1aa00b5170 2023-10-08T12:00:33.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.107+0000 7f1a9ed9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1aa0149910 0x7f1aa006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:33.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.107+0000 7f1a9ed9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1aa0149910 0x7f1aa006ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:44222/0 (socket says 172.21.15.62:44222) 2023-10-08T12:00:33.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.107+0000 7f1a9ed9d640 1 -- 172.21.15.62:0/1597727669 learned_addr learned my addr 172.21.15.62:0/1597727669 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:33.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.107+0000 7f1a9e59c640 1 --2- 172.21.15.62:0/1597727669 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1aa00b5170 0x7f1aa0146a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:33.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.107+0000 7f1a9dd9b640 1 --2- 172.21.15.62:0/1597727669 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1aa00b99e0 0x7f1aa0070600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:33.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.107+0000 7f1a9ed9d640 1 -- 172.21.15.62:0/1597727669 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1aa00b5170 msgr2=0x7f1aa0146a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:33.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.107+0000 7f1a9ed9d640 1 --2- 172.21.15.62:0/1597727669 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1aa00b5170 0x7f1aa0146a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:33.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.107+0000 7f1a9ed9d640 1 -- 172.21.15.62:0/1597727669 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1aa00b99e0 msgr2=0x7f1aa0070600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:33.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.107+0000 7f1a9ed9d640 1 --2- 172.21.15.62:0/1597727669 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1aa00b99e0 0x7f1aa0070600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:33.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.107+0000 7f1a9ed9d640 1 -- 172.21.15.62:0/1597727669 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a980098e0 con 0x7f1aa0149910 2023-10-08T12:00:33.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.107+0000 7f1a9ed9d640 1 --2- 172.21.15.62:0/1597727669 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1aa0149910 0x7f1aa006ee80 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1a98009bd0 tx=0x7f1a98003ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:33.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.107+0000 7f1a8effd640 1 -- 172.21.15.62:0/1597727669 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a980ad6a0 con 0x7f1aa0149910 2023-10-08T12:00:33.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.107+0000 7f1a8effd640 1 -- 172.21.15.62:0/1597727669 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1a980ad8f0 con 0x7f1aa0149910 2023-10-08T12:00:33.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.107+0000 7f1a8effd640 1 -- 172.21.15.62:0/1597727669 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a980adcc0 con 0x7f1aa0149910 2023-10-08T12:00:33.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.107+0000 7f1aa4a14640 1 -- 172.21.15.62:0/1597727669 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1aa0070b40 con 0x7f1aa0149910 2023-10-08T12:00:33.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.107+0000 7f1aa4a14640 1 -- 172.21.15.62:0/1597727669 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1aa00a08c0 con 0x7f1aa0149910 2023-10-08T12:00:33.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.111+0000 7f1aa4a14640 1 -- 172.21.15.62:0/1597727669 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1aa00a0ac0 con 0x7f1aa0149910 2023-10-08T12:00:33.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.111+0000 7f1a8effd640 1 -- 172.21.15.62:0/1597727669 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f1a980b4040 con 0x7f1aa0149910 2023-10-08T12:00:33.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.111+0000 7f1a8effd640 1 --2- 172.21.15.62:0/1597727669 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f1a800664a0 0x7f1a80068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:33.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.111+0000 7f1a8effd640 1 -- 172.21.15.62:0/1597727669 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1a9811e180 con 0x7f1aa0149910 2023-10-08T12:00:33.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.111+0000 7f1a9e59c640 1 --2- 172.21.15.62:0/1597727669 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f1a800664a0 0x7f1a80068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:33.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.111+0000 7f1a9e59c640 1 --2- 172.21.15.62:0/1597727669 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f1a800664a0 0x7f1a80068960 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1a940058d0 tx=0x7f1a94005860 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:33.118 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.115+0000 7f1a8effd640 1 -- 172.21.15.62:0/1597727669 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1a980eb690 con 0x7f1aa0149910 2023-10-08T12:00:33.274 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.271+0000 7f1aa4a14640 1 -- 172.21.15.62:0/1597727669 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1aa006e890 con 0x7f1aa0149910 2023-10-08T12:00:33.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.271+0000 7f1a8effd640 1 -- 172.21.15.62:0/1597727669 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16481 (secure 0 0 0) 0x7f1a980bc090 con 0x7f1aa0149910 2023-10-08T12:00:33.276 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T12:00:33.276 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":20,"fsid":"3e777930-c2c1-4f2b-a903-c07ee4ca2c52","created":"2023-10-08T11:59:54.510229+0000","modified":"2023-10-08T12:00:21.580704+0000","last_up_change":"2023-10-08T12:00:06.783998+0000","last_in_change":"2023-10-08T11:59:57.847944+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:00:07.189433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:00:17.895548+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T12:00:18.871217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7bc3070a-7240-43d9-9ec3-397b68a37e2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6820","nonce":2227876905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6824","nonce":2227876905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6831","nonce":2227876905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6828","nonce":2227876905}]},"public_addr":"172.21.15.62:6820/2227876905","cluster_addr":"172.21.15.62:6824/2227876905","heartbeat_back_addr":"172.21.15.62:6831/2227876905","heartbeat_front_addr":"172.21.15.62:6828/2227876905","state":["exists","up"]},{"osd":1,"uuid":"5e0fa1f5-9ddc-4882-b460-5578bb571003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6801","nonce":315660906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6803","nonce":315660906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6808","nonce":315660906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6805","nonce":315660906}]},"public_addr":"172.21.15.62:6801/315660906","cluster_addr":"172.21.15.62:6803/315660906","heartbeat_back_addr":"172.21.15.62:6808/315660906","heartbeat_front_addr":"172.21.15.62:6805/315660906","state":["exists","up"]},{"osd":2,"uuid":"262b5ee9-4243-4309-a14f-88ad4e8bf812","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6807","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6809","nonce":3784842938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6811","nonce":3784842938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6815","nonce":3784842938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6813","nonce":3784842938}]},"public_addr":"172.21.15.62:6809/3784842938","cluster_addr":"172.21.15.62:6811/3784842938","heartbeat_back_addr":"172.21.15.62:6815/3784842938","heartbeat_front_addr":"172.21.15.62:6813/3784842938","state":["exists","up"]},{"osd":3,"uuid":"1770bdb8-c12b-43b1-aaab-1d6b6fd18f4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6817","nonce":3385303160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6821","nonce":3385303160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6827","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6829","nonce":3385303160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6823","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6825","nonce":3385303160}]},"public_addr":"172.21.15.62:6817/3385303160","cluster_addr":"172.21.15.62:6821/3385303160","heartbeat_back_addr":"172.21.15.62:6829/3385303160","heartbeat_front_addr":"172.21.15.62:6825/3385303160","state":["exists","up"]},{"osd":4,"uuid":"74c73631-9351-494a-8246-28ee86e9f862","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6807","nonce":1174056987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6809","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6811","nonce":1174056987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6820","nonce":1174056987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6813","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6816","nonce":1174056987}]},"public_addr":"172.21.15.130:6807/1174056987","cluster_addr":"172.21.15.130:6811/1174056987","heartbeat_back_addr":"172.21.15.130:6820/1174056987","heartbeat_front_addr":"172.21.15.130:6816/1174056987","state":["exists","up"]},{"osd":5,"uuid":"1040f389-272c-41d6-ae76-70c04d09afa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6801","nonce":561928414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6803","nonce":561928414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6815","nonce":561928414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6808","nonce":561928414}]},"public_addr":"172.21.15.130:6801/561928414","cluster_addr":"172.21.15.130:6803/561928414","heartbeat_back_addr":"172.21.15.130:6815/561928414","heartbeat_front_addr":"172.21.15.130:6808/561928414","state":["exists","up"]},{"osd":6,"uuid":"178553eb-03e1-4ab8-9826-4f5997e6da0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6810","nonce":2877303015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6817","nonce":2877303015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6823","nonce":2877303015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6819","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6821","nonce":2877303015}]},"public_addr":"172.21.15.130:6810/2877303015","cluster_addr":"172.21.15.130:6817/2877303015","heartbeat_back_addr":"172.21.15.130:6823/2877303015","heartbeat_front_addr":"172.21.15.130:6821/2877303015","state":["exists","up"]},{"osd":7,"uuid":"b6581c8f-30b1-4dfd-b7b6-94b579128835","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6825","nonce":680009774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6827","nonce":680009774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6831","nonce":680009774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6829","nonce":680009774}]},"public_addr":"172.21.15.130:6825/680009774","cluster_addr":"172.21.15.130:6827/680009774","heartbeat_back_addr":"172.21.15.130:6831/680009774","heartbeat_front_addr":"172.21.15.130:6829/680009774","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.505543+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.394383+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.456652+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.529168+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.235414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.392158+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.347556+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.432039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:00:33.278 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.275+0000 7f1aa4a14640 1 -- 172.21.15.62:0/1597727669 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f1a800664a0 msgr2=0x7f1a80068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:33.278 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.275+0000 7f1aa4a14640 1 --2- 172.21.15.62:0/1597727669 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f1a800664a0 0x7f1a80068960 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1a940058d0 tx=0x7f1a94005860 comp rx=0 tx=0).stop 2023-10-08T12:00:33.278 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.275+0000 7f1aa4a14640 1 -- 172.21.15.62:0/1597727669 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1aa0149910 msgr2=0x7f1aa006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:33.278 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.275+0000 7f1aa4a14640 1 --2- 172.21.15.62:0/1597727669 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1aa0149910 0x7f1aa006ee80 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1a98009bd0 tx=0x7f1a98003ae0 comp rx=0 tx=0).stop 2023-10-08T12:00:33.278 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.275+0000 7f1aa4a14640 1 -- 172.21.15.62:0/1597727669 shutdown_connections 2023-10-08T12:00:33.279 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.275+0000 7f1aa4a14640 1 --2- 172.21.15.62:0/1597727669 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f1a800664a0 0x7f1a80068960 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:33.279 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.275+0000 7f1aa4a14640 1 --2- 172.21.15.62:0/1597727669 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1aa0149910 0x7f1aa006ee80 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:33.279 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.275+0000 7f1aa4a14640 1 --2- 172.21.15.62:0/1597727669 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1aa00b99e0 0x7f1aa0070600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:33.279 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.275+0000 7f1aa4a14640 1 --2- 172.21.15.62:0/1597727669 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1aa00b5170 0x7f1aa0146a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:33.279 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.275+0000 7f1aa4a14640 1 -- 172.21.15.62:0/1597727669 >> 172.21.15.62:0/1597727669 conn(0x7f1aa009c520 msgr2=0x7f1aa009aed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:33.279 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.275+0000 7f1aa4a14640 1 -- 172.21.15.62:0/1597727669 shutdown_connections 2023-10-08T12:00:33.280 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.275+0000 7f1aa4a14640 1 -- 172.21.15.62:0/1597727669 wait complete. 2023-10-08T12:00:33.295 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:00:33.425 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.419+0000 7f6a8a281640 1 -- 172.21.15.62:0/4124238990 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a840718c0 msgr2=0x7f6a840b5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:33.425 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.419+0000 7f6a8a281640 1 --2- 172.21.15.62:0/4124238990 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a840718c0 0x7f6a840b5170 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c009c80 tx=0x7f6a7c01cd40 comp rx=0 tx=0).stop 2023-10-08T12:00:33.425 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.419+0000 7f6a8a281640 1 -- 172.21.15.62:0/4124238990 shutdown_connections 2023-10-08T12:00:33.425 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.419+0000 7f6a8a281640 1 --2- 172.21.15.62:0/4124238990 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a840718c0 0x7f6a840b5170 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:33.425 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.419+0000 7f6a8a281640 1 -- 172.21.15.62:0/4124238990 >> 172.21.15.62:0/4124238990 conn(0x7f6a8409c520 msgr2=0x7f6a8409c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:33.425 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.419+0000 7f6a8a281640 1 -- 172.21.15.62:0/4124238990 shutdown_connections 2023-10-08T12:00:33.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.419+0000 7f6a8a281640 1 -- 172.21.15.62:0/4124238990 wait complete. 2023-10-08T12:00:33.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.419+0000 7f6a8a281640 1 Processor -- start 2023-10-08T12:00:33.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.423+0000 7f6a8a281640 1 -- start start 2023-10-08T12:00:33.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.423+0000 7f6a8a281640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6a840718c0 0x7f6a840994a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:33.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.423+0000 7f6a8a281640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6a840b6a60 0x7f6a841e5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:33.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.423+0000 7f6a8a281640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a840b8570 0x7f6a8406e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:33.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.423+0000 7f6a8a281640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a840b49c0 con 0x7f6a840b8570 2023-10-08T12:00:33.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.423+0000 7f6a8a281640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a841e58b0 con 0x7f6a840b6a60 2023-10-08T12:00:33.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.423+0000 7f6a8a281640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a840999e0 con 0x7f6a840718c0 2023-10-08T12:00:33.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.423+0000 7f6a8881e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a840b8570 0x7f6a8406e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:33.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.423+0000 7f6a8881e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a840b8570 0x7f6a8406e640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:44240/0 (socket says 172.21.15.62:44240) 2023-10-08T12:00:33.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.423+0000 7f6a8881e640 1 -- 172.21.15.62:0/2726861669 learned_addr learned my addr 172.21.15.62:0/2726861669 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:33.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.423+0000 7f6a83fff640 1 --2- 172.21.15.62:0/2726861669 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6a840718c0 0x7f6a840994a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:33.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.423+0000 7f6a837fe640 1 --2- 172.21.15.62:0/2726861669 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6a840b6a60 0x7f6a841e5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:33.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.423+0000 7f6a8881e640 1 -- 172.21.15.62:0/2726861669 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6a840718c0 msgr2=0x7f6a840994a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:33.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.423+0000 7f6a8881e640 1 --2- 172.21.15.62:0/2726861669 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6a840718c0 0x7f6a840994a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:33.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.423+0000 7f6a8881e640 1 -- 172.21.15.62:0/2726861669 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6a840b6a60 msgr2=0x7f6a841e5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:33.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.423+0000 7f6a8881e640 1 --2- 172.21.15.62:0/2726861669 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6a840b6a60 0x7f6a841e5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:33.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.423+0000 7f6a8881e640 1 -- 172.21.15.62:0/2726861669 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a7c0098e0 con 0x7f6a840b8570 2023-10-08T12:00:33.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.423+0000 7f6a837fe640 1 --2- 172.21.15.62:0/2726861669 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6a840b6a60 0x7f6a841e5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:00:33.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.423+0000 7f6a8881e640 1 --2- 172.21.15.62:0/2726861669 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a840b8570 0x7f6a8406e640 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6a7400b440 tx=0x7f6a7400b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:33.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.423+0000 7f6a80ff9640 1 -- 172.21.15.62:0/2726861669 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a74011830 con 0x7f6a840b8570 2023-10-08T12:00:33.430 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.423+0000 7f6a8a281640 1 -- 172.21.15.62:0/2726861669 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a841e5560 con 0x7f6a840b8570 2023-10-08T12:00:33.430 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.423+0000 7f6a80ff9640 1 -- 172.21.15.62:0/2726861669 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6a74011aa0 con 0x7f6a840b8570 2023-10-08T12:00:33.430 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.423+0000 7f6a80ff9640 1 -- 172.21.15.62:0/2726861669 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a74010380 con 0x7f6a840b8570 2023-10-08T12:00:33.430 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.423+0000 7f6a8a281640 1 -- 172.21.15.62:0/2726861669 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a840b4060 con 0x7f6a840b8570 2023-10-08T12:00:33.430 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.423+0000 7f6a8a281640 1 -- 172.21.15.62:0/2726861669 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a8404da80 con 0x7f6a840b8570 2023-10-08T12:00:33.431 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.423+0000 7f6a80ff9640 1 -- 172.21.15.62:0/2726861669 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6a740104e0 con 0x7f6a840b8570 2023-10-08T12:00:33.431 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.423+0000 7f6a80ff9640 1 --2- 172.21.15.62:0/2726861669 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f6a70066470 0x7f6a70068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:33.431 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.423+0000 7f6a80ff9640 1 -- 172.21.15.62:0/2726861669 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6a74083f90 con 0x7f6a840b8570 2023-10-08T12:00:33.431 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.423+0000 7f6a83fff640 1 --2- 172.21.15.62:0/2726861669 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f6a70066470 0x7f6a70068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:33.431 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.427+0000 7f6a83fff640 1 --2- 172.21.15.62:0/2726861669 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f6a70066470 0x7f6a70068930 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c0af000 tx=0x7f6a7c01b580 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:33.435 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.431+0000 7f6a80ff9640 1 -- 172.21.15.62:0/2726861669 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6a740b5090 con 0x7f6a840b8570 2023-10-08T12:00:33.618 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.615+0000 7f6a8a281640 1 -- 172.21.15.62:0/2726861669 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6a841e59f0 con 0x7f6a840b8570 2023-10-08T12:00:33.619 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.615+0000 7f6a80ff9640 1 -- 172.21.15.62:0/2726861669 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4120 (secure 0 0 0) 0x7f6a74051390 con 0x7f6a840b8570 2023-10-08T12:00:33.619 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T12:00:33.620 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4334,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/2629778704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":2629778704},{"type":"v1","addr":"172.21.15.130:6835","nonce":2629778704}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4359,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/2134446062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":2134446062},{"type":"v1","addr":"172.21.15.62:6835","nonce":2134446062}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T12:00:19.866714+0000","modified":"2023-10-08T12:00:22.958677+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4362},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4362":{"gid":4362,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6834/2629384568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":2629384568},{"type":"v1","addr":"172.21.15.62:6834","nonce":2629384568}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:00:33.620 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 8 2023-10-08T12:00:33.621 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.615+0000 7f6a8a281640 1 -- 172.21.15.62:0/2726861669 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f6a70066470 msgr2=0x7f6a70068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:33.622 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.615+0000 7f6a8a281640 1 --2- 172.21.15.62:0/2726861669 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f6a70066470 0x7f6a70068930 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c0af000 tx=0x7f6a7c01b580 comp rx=0 tx=0).stop 2023-10-08T12:00:33.622 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.615+0000 7f6a8a281640 1 -- 172.21.15.62:0/2726861669 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a840b8570 msgr2=0x7f6a8406e640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:33.622 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.615+0000 7f6a8a281640 1 --2- 172.21.15.62:0/2726861669 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a840b8570 0x7f6a8406e640 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6a7400b440 tx=0x7f6a7400b900 comp rx=0 tx=0).stop 2023-10-08T12:00:33.622 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.615+0000 7f6a8a281640 1 -- 172.21.15.62:0/2726861669 shutdown_connections 2023-10-08T12:00:33.622 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.615+0000 7f6a8a281640 1 --2- 172.21.15.62:0/2726861669 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f6a70066470 0x7f6a70068930 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:33.622 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.615+0000 7f6a8a281640 1 --2- 172.21.15.62:0/2726861669 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a840b8570 0x7f6a8406e640 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:33.622 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.615+0000 7f6a8a281640 1 --2- 172.21.15.62:0/2726861669 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6a840b6a60 0x7f6a841e5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:33.623 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.615+0000 7f6a8a281640 1 --2- 172.21.15.62:0/2726861669 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6a840718c0 0x7f6a840994a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:33.623 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.615+0000 7f6a8a281640 1 -- 172.21.15.62:0/2726861669 >> 172.21.15.62:0/2726861669 conn(0x7f6a8409c520 msgr2=0x7f6a84097a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:33.623 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.619+0000 7f6a8a281640 1 -- 172.21.15.62:0/2726861669 shutdown_connections 2023-10-08T12:00:33.623 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:33.619+0000 7f6a8a281640 1 -- 172.21.15.62:0/2726861669 wait complete. 2023-10-08T12:00:33.939 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-08T12:00:19.866714+0000', 'modified': '2023-10-08T12:00:22.958677+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4362}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4362': {'gid': 4362, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.62:6834/2629384568', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6832', 'nonce': 2629384568}, {'type': 'v1', 'addr': '172.21.15.62:6834', 'nonce': 2629384568}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-08T12:00:33.939 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-08T12:00:33.939 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-08T12:00:34.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.071+0000 7f55ccb36640 1 -- 172.21.15.62:0/4072719244 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f55c8143550 msgr2=0x7f55c80bd2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:34.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.071+0000 7f55ccb36640 1 --2- 172.21.15.62:0/4072719244 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f55c8143550 0x7f55c80bd2b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f55c8089330 tx=0x7f55b801c720 comp rx=0 tx=0).stop 2023-10-08T12:00:34.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.071+0000 7f55ccb36640 1 -- 172.21.15.62:0/4072719244 shutdown_connections 2023-10-08T12:00:34.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.071+0000 7f55ccb36640 1 --2- 172.21.15.62:0/4072719244 >> v2:172.21.15.130:3300/0 conn(0x7f55c80bb7a0 0x7f55c81539d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:34.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.071+0000 7f55ccb36640 1 --2- 172.21.15.62:0/4072719244 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f55c8143550 0x7f55c80bd2b0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:34.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.071+0000 7f55ccb36640 1 -- 172.21.15.62:0/4072719244 >> 172.21.15.62:0/4072719244 conn(0x7f55c80a0540 msgr2=0x7f55c80a0950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:34.077 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.071+0000 7f55ccb36640 1 -- 172.21.15.62:0/4072719244 shutdown_connections 2023-10-08T12:00:34.077 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.071+0000 7f55ccb36640 1 -- 172.21.15.62:0/4072719244 wait complete. 2023-10-08T12:00:34.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.071+0000 7f55ccb36640 1 Processor -- start 2023-10-08T12:00:34.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.071+0000 7f55ccb36640 1 -- start start 2023-10-08T12:00:34.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.071+0000 7f55ccb36640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f55c80bb310 0x7f55c8140e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:34.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.071+0000 7f55ccb36640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f55c80bb7a0 0x7f55c81e2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:34.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.071+0000 7f55ccb36640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f55c8143550 0x7f55c8137aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:34.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.071+0000 7f55ccb36640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c8141370 con 0x7f55c8143550 2023-10-08T12:00:34.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.071+0000 7f55ccb36640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c8140110 con 0x7f55c80bb310 2023-10-08T12:00:34.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.071+0000 7f55ccb36640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55c81403d0 con 0x7f55c80bb7a0 2023-10-08T12:00:34.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.071+0000 7f55c6d9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f55c8143550 0x7f55c8137aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:34.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.071+0000 7f55c6d9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f55c8143550 0x7f55c8137aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:44260/0 (socket says 172.21.15.62:44260) 2023-10-08T12:00:34.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.071+0000 7f55c6d9d640 1 -- 172.21.15.62:0/2755854798 learned_addr learned my addr 172.21.15.62:0/2755854798 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:34.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.075+0000 7f55c659c640 1 --2- 172.21.15.62:0/2755854798 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f55c80bb310 0x7f55c8140e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:34.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.075+0000 7f55bdd9b640 1 --2- 172.21.15.62:0/2755854798 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f55c80bb7a0 0x7f55c81e2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:34.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.075+0000 7f55c6d9d640 1 -- 172.21.15.62:0/2755854798 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f55c80bb7a0 msgr2=0x7f55c81e2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:34.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.075+0000 7f55c6d9d640 1 --2- 172.21.15.62:0/2755854798 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f55c80bb7a0 0x7f55c81e2470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:34.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.075+0000 7f55c6d9d640 1 -- 172.21.15.62:0/2755854798 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f55c80bb310 msgr2=0x7f55c8140e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:34.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.075+0000 7f55c6d9d640 1 --2- 172.21.15.62:0/2755854798 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f55c80bb310 0x7f55c8140e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:34.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.075+0000 7f55c6d9d640 1 -- 172.21.15.62:0/2755854798 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55b80094a0 con 0x7f55c8143550 2023-10-08T12:00:34.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.075+0000 7f55c6d9d640 1 --2- 172.21.15.62:0/2755854798 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f55c8143550 0x7f55c8137aa0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f55c000cae0 tx=0x7f55c000a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:34.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.075+0000 7f55bf7fe640 1 -- 172.21.15.62:0/2755854798 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c000ae30 con 0x7f55c8143550 2023-10-08T12:00:34.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.075+0000 7f55bf7fe640 1 -- 172.21.15.62:0/2755854798 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f55c0004b30 con 0x7f55c8143550 2023-10-08T12:00:34.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.075+0000 7f55bf7fe640 1 -- 172.21.15.62:0/2755854798 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c0005020 con 0x7f55c8143550 2023-10-08T12:00:34.083 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.075+0000 7f55ccb36640 1 -- 172.21.15.62:0/2755854798 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55c8142510 con 0x7f55c8143550 2023-10-08T12:00:34.083 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.075+0000 7f55ccb36640 1 -- 172.21.15.62:0/2755854798 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55c8142bb0 con 0x7f55c8143550 2023-10-08T12:00:34.083 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.075+0000 7f55bf7fe640 1 -- 172.21.15.62:0/2755854798 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f55c0005180 con 0x7f55c8143550 2023-10-08T12:00:34.083 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.075+0000 7f55bf7fe640 1 --2- 172.21.15.62:0/2755854798 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f55a8066470 0x7f55a8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:34.083 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.075+0000 7f55bf7fe640 1 -- 172.21.15.62:0/2755854798 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f55c00847c0 con 0x7f55c8143550 2023-10-08T12:00:34.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.075+0000 7f55c659c640 1 --2- 172.21.15.62:0/2755854798 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f55a8066470 0x7f55a8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:34.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.075+0000 7f55cfc7f000 1 Processor -- start 2023-10-08T12:00:34.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.075+0000 7f55cfc7f000 1 -- start start 2023-10-08T12:00:34.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.075+0000 7f55c659c640 1 --2- 172.21.15.62:0/2755854798 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f55a8066470 0x7f55a8068930 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f55b80af000 tx=0x7f55b801af60 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:34.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.079+0000 7f55cfc7f000 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f4bf4721e0 0x55f4bf4725c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:34.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.079+0000 7f55cfc7f000 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f4bf472b00 0x55f4bf472ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:34.091 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.079+0000 7f55cfc7f000 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55f4bf473420 0x55f4bf47d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:34.091 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.079+0000 7f55cfc7f000 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4bf232cc0 con 0x55f4bf472b00 2023-10-08T12:00:34.091 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.079+0000 7f55cfc7f000 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4bf2958e0 con 0x55f4bf4721e0 2023-10-08T12:00:34.091 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.079+0000 7f55cfc7f000 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f4bf292e10 con 0x55f4bf473420 2023-10-08T12:00:34.091 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.079+0000 7f55bdd9b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f4bf472b00 0x55f4bf472ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:34.091 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.079+0000 7f55bdd9b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f4bf472b00 0x55f4bf472ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:44264/0 (socket says 172.21.15.62:44264) 2023-10-08T12:00:34.091 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.079+0000 7f55bdd9b640 1 -- 172.21.15.62:0/2407015467 learned_addr learned my addr 172.21.15.62:0/2407015467 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:34.092 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.079+0000 7f55c6d9d640 1 --2- 172.21.15.62:0/2407015467 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55f4bf473420 0x55f4bf47d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:34.092 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.079+0000 7f55c659c640 1 --2- 172.21.15.62:0/2407015467 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f4bf4721e0 0x55f4bf4725c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:34.092 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.079+0000 7f55bdd9b640 1 -- 172.21.15.62:0/2407015467 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55f4bf473420 msgr2=0x55f4bf47d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:00:34.092 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.079+0000 7f55bdd9b640 1 --2- 172.21.15.62:0/2407015467 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55f4bf473420 0x55f4bf47d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:34.092 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.079+0000 7f55bdd9b640 1 -- 172.21.15.62:0/2407015467 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f4bf4721e0 msgr2=0x55f4bf4725c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:00:34.092 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.079+0000 7f55bdd9b640 1 --2- 172.21.15.62:0/2407015467 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f4bf4721e0 0x55f4bf4725c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:34.092 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.079+0000 7f55bdd9b640 1 -- 172.21.15.62:0/2407015467 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f4bef87890 con 0x55f4bf472b00 2023-10-08T12:00:34.092 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.079+0000 7f55c659c640 1 --2- 172.21.15.62:0/2407015467 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f4bf4721e0 0x55f4bf4725c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:00:34.092 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.079+0000 7f55bdd9b640 1 --2- 172.21.15.62:0/2407015467 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f4bf472b00 0x55f4bf472ee0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f55b00014d0 tx=0x7f55b0001990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b57249256e7a1ca6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:34.092 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.079+0000 7f55a7fff640 1 -- 172.21.15.62:0/2407015467 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b0005020 con 0x55f4bf472b00 2023-10-08T12:00:34.092 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.079+0000 7f55a7fff640 1 -- 172.21.15.62:0/2407015467 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f55b0005270 con 0x55f4bf472b00 2023-10-08T12:00:34.092 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.079+0000 7f55a7fff640 1 -- 172.21.15.62:0/2407015467 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b00046d0 con 0x55f4bf472b00 2023-10-08T12:00:34.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.079+0000 7f55cfc7f000 1 -- 172.21.15.62:0/2407015467 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f4bf472b00 msgr2=0x55f4bf472ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:34.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.079+0000 7f55cfc7f000 1 --2- 172.21.15.62:0/2407015467 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f4bf472b00 0x55f4bf472ee0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f55b00014d0 tx=0x7f55b0001990 comp rx=0 tx=0).stop 2023-10-08T12:00:34.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.079+0000 7f55cfc7f000 1 -- 172.21.15.62:0/2407015467 shutdown_connections 2023-10-08T12:00:34.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.079+0000 7f55cfc7f000 1 --2- 172.21.15.62:0/2407015467 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55f4bf473420 0x55f4bf47d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:34.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.079+0000 7f55cfc7f000 1 --2- 172.21.15.62:0/2407015467 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f4bf472b00 0x55f4bf472ee0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:34.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.079+0000 7f55cfc7f000 1 --2- 172.21.15.62:0/2407015467 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f4bf4721e0 0x55f4bf4725c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:34.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.079+0000 7f55cfc7f000 1 -- 172.21.15.62:0/2407015467 >> 172.21.15.62:0/2407015467 conn(0x55f4bf46df90 msgr2=0x55f4bf470380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:34.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.079+0000 7f55cfc7f000 1 -- 172.21.15.62:0/2407015467 shutdown_connections 2023-10-08T12:00:34.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.079+0000 7f55cfc7f000 1 -- 172.21.15.62:0/2407015467 wait complete. 2023-10-08T12:00:34.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.079+0000 7f55cfc7f000 1 -- start start 2023-10-08T12:00:34.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.079+0000 7f55cfc7f000 1 Processor -- start 2023-10-08T12:00:34.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.079+0000 7f55cfc7f000 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55f4bf4721e0 0x55f4bf443ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:34.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.079+0000 7f55cfc7f000 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f4bf472b00 0x55f4bf443ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:34.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.079+0000 7f55cfc7f000 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f4bf473420 0x55f4bf477350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:34.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.079+0000 7f55cfc7f000 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4bf28e700 con 0x55f4bf472b00 2023-10-08T12:00:34.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.079+0000 7f55cfc7f000 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4bf24dd10 con 0x55f4bf473420 2023-10-08T12:00:34.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.079+0000 7f55cfc7f000 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f4bf24d9b0 con 0x55f4bf4721e0 2023-10-08T12:00:34.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.079+0000 7f55cfc7f000 10 client.0 _ll_register_callbacks cb 0x55f4bf429660 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:00:34.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.079+0000 7f55bdd9b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f4bf472b00 0x55f4bf443ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:34.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.079+0000 7f55bdd9b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f4bf472b00 0x55f4bf443ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:44280/0 (socket says 172.21.15.62:44280) 2023-10-08T12:00:34.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.079+0000 7f55bdd9b640 1 -- 172.21.15.62:0/69968690 learned_addr learned my addr 172.21.15.62:0/69968690 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:34.096 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.079+0000 7f55c659c640 1 --2- 172.21.15.62:0/69968690 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55f4bf4721e0 0x55f4bf443ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:34.096 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.079+0000 7f55c6d9d640 1 --2- 172.21.15.62:0/69968690 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f4bf473420 0x55f4bf477350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:34.096 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.079+0000 7f55bdd9b640 1 -- 172.21.15.62:0/69968690 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55f4bf4721e0 msgr2=0x55f4bf443ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:00:34.096 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.079+0000 7f55bdd9b640 1 --2- 172.21.15.62:0/69968690 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55f4bf4721e0 0x55f4bf443ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:34.096 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.079+0000 7f55bdd9b640 1 -- 172.21.15.62:0/69968690 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f4bf473420 msgr2=0x55f4bf477350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:00:34.096 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.079+0000 7f55bdd9b640 1 --2- 172.21.15.62:0/69968690 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f4bf473420 0x55f4bf477350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:34.096 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.079+0000 7f55bdd9b640 1 -- 172.21.15.62:0/69968690 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55c80bde30 con 0x55f4bf472b00 2023-10-08T12:00:34.096 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.079+0000 7f55c6d9d640 1 --2- 172.21.15.62:0/69968690 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f4bf473420 0x55f4bf477350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:00:34.096 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.079+0000 7f55bdd9b640 1 --2- 172.21.15.62:0/69968690 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f4bf472b00 0x55f4bf443ff0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f55b00048a0 tx=0x7f55b00048d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea44026f84eb852a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:34.096 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.079+0000 7f55a57fa640 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2023-10-08T12:00:34.096 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.079+0000 7f55a57fa640 1 -- 172.21.15.62:0/69968690 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b0007ca0 con 0x55f4bf472b00 2023-10-08T12:00:34.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.079+0000 7f55a57fa640 1 -- 172.21.15.62:0/69968690 <== mon.0 v2:172.21.15.62:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f55b0005560 con 0x55f4bf472b00 2023-10-08T12:00:34.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.079+0000 7f55cfc7f000 1 -- 172.21.15.62:0/69968690 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f4bf242370 con 0x55f4bf472b00 2023-10-08T12:00:34.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.079+0000 7f55a57fa640 1 -- 172.21.15.62:0/69968690 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f55b0004d00 con 0x55f4bf472b00 2023-10-08T12:00:34.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.079+0000 7f55cfc7f000 10 client.4752 fetch_fsmap learned FSMap version 8 2023-10-08T12:00:34.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.079+0000 7f55cfc7f000 1 -- 172.21.15.62:0/69968690 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55f4bf250460 con 0x55f4bf472b00 2023-10-08T12:00:34.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.083+0000 7f55a57fa640 1 -- 172.21.15.62:0/69968690 <== mon.0 v2:172.21.15.62:3300/0 4 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x55f4bf242370 con 0x55f4bf472b00 2023-10-08T12:00:34.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.083+0000 7f55a57fa640 1 -- 172.21.15.62:0/69968690 <== mon.0 v2:172.21.15.62:3300/0 5 ==== fsmap(e 8) v1 ==== 2719+0+0 (secure 0 0 0) 0x7f55b0004020 con 0x55f4bf472b00 2023-10-08T12:00:34.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.083+0000 7f55cfc7f000 10 client.4752 fetch_fsmap finished waiting for FSMap version 8 2023-10-08T12:00:34.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.083+0000 7f55cfc7f000 10 client.4752 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-08T12:00:34.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.083+0000 7f55cfc7f000 20 client.4752 populate_metadata read hostname 'smithi062' 2023-10-08T12:00:34.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.083+0000 7f55cfc7f000 1 --2- 172.21.15.62:0/69968690 >> [v2:172.21.15.62:6832/2629384568,v1:172.21.15.62:6834/2629384568] conn(0x55f4bf477d60 0x55f4bf478140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:34.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.083+0000 7f55cfc7f000 4 client.4752 mds_command: new command op to 4362 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:00:34.098 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.083+0000 7f55cfc7f000 1 -- 172.21.15.62:0/69968690 --> [v2:172.21.15.62:6832/2629384568,v1:172.21.15.62:6834/2629384568] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f4bf2282d0 con 0x55f4bf477d60 2023-10-08T12:00:34.098 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.083+0000 7f55c659c640 1 --2- 172.21.15.62:0/69968690 >> [v2:172.21.15.62:6832/2629384568,v1:172.21.15.62:6834/2629384568] conn(0x55f4bf477d60 0x55f4bf478140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:34.098 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.083+0000 7f55c659c640 1 --2- 172.21.15.62:0/69968690 >> [v2:172.21.15.62:6832/2629384568,v1:172.21.15.62:6834/2629384568] conn(0x55f4bf477d60 0x55f4bf478140 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13bacf354c089bdb server_cookie=46cabbd0b4b74afb in_seq=0 out_seq=0 2023-10-08T12:00:34.098 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.083+0000 7f55a57fa640 10 client.4752 ms_handle_connect on v2:172.21.15.62:6832/2629384568 2023-10-08T12:00:34.098 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.083+0000 7f55a57fa640 1 -- 172.21.15.62:0/69968690 <== mds.0 v2:172.21.15.62:6832/2629384568 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f4bf2282d0 con 0x55f4bf477d60 2023-10-08T12:00:34.098 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.083+0000 7f55a57fa640 10 client.4752 handle_command_reply: tid=0 2023-10-08T12:00:34.098 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.083+0000 7f55cfc7f000 1 client.4752 shutdown 2023-10-08T12:00:34.098 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.083+0000 7f55cfc7f000 1 -- 172.21.15.62:0/69968690 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f4bf472b00 msgr2=0x55f4bf443ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:34.099 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.083+0000 7f55cfc7f000 1 --2- 172.21.15.62:0/69968690 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f4bf472b00 0x55f4bf443ff0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f55b00048a0 tx=0x7f55b00048d0 comp rx=0 tx=0).stop 2023-10-08T12:00:34.099 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.083+0000 7f55cfc7f000 1 -- 172.21.15.62:0/69968690 shutdown_connections 2023-10-08T12:00:34.099 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.083+0000 7f55cfc7f000 1 --2- 172.21.15.62:0/69968690 >> [v2:172.21.15.62:6832/2629384568,v1:172.21.15.62:6834/2629384568] conn(0x55f4bf477d60 0x55f4bf478140 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:34.099 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.083+0000 7f55cfc7f000 1 --2- 172.21.15.62:0/69968690 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f4bf473420 0x55f4bf477350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:34.099 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.083+0000 7f55cfc7f000 1 --2- 172.21.15.62:0/69968690 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f4bf472b00 0x55f4bf443ff0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:34.099 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.083+0000 7f55a57fa640 0 client.4752 ms_handle_reset on v2:172.21.15.62:6832/2629384568 2023-10-08T12:00:34.099 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.083+0000 7f55cfc7f000 1 --2- 172.21.15.62:0/69968690 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55f4bf4721e0 0x55f4bf443ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:34.099 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.083+0000 7f55cfc7f000 1 -- 172.21.15.62:0/69968690 >> 172.21.15.62:0/69968690 conn(0x55f4bf46df90 msgr2=0x55f4bf470380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:34.099 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.083+0000 7f55cfc7f000 1 -- 172.21.15.62:0/69968690 shutdown_connections 2023-10-08T12:00:34.099 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.083+0000 7f55cfc7f000 1 -- 172.21.15.62:0/69968690 wait complete. 2023-10-08T12:00:34.099 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.083+0000 7f55cfc7f000 20 client.4752 trim_cache size 0 max 16384 2023-10-08T12:00:34.104 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.099+0000 7f55cfc7f000 1 Processor -- start 2023-10-08T12:00:34.104 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.099+0000 7f55cfc7f000 1 -- start start 2023-10-08T12:00:34.104 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.099+0000 7f55cfc7f000 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55f4bf4721e0 0x55f4bf478140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:34.104 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.099+0000 7f55cfc7f000 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f4bf472b00 0x55f4bf478680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:34.104 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.099+0000 7f55cfc7f000 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f4bf473420 0x55f4bf478bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:34.104 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.099+0000 7f55cfc7f000 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4bef48940 con 0x55f4bf472b00 2023-10-08T12:00:34.104 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.099+0000 7f55cfc7f000 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4bf293870 con 0x55f4bf473420 2023-10-08T12:00:34.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.099+0000 7f55cfc7f000 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f4bf24b4d0 con 0x55f4bf4721e0 2023-10-08T12:00:34.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.099+0000 7f55bdd9b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f4bf472b00 0x55f4bf478680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:34.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.099+0000 7f55bdd9b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f4bf472b00 0x55f4bf478680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:44294/0 (socket says 172.21.15.62:44294) 2023-10-08T12:00:34.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.099+0000 7f55bdd9b640 1 -- 172.21.15.62:0/1611829286 learned_addr learned my addr 172.21.15.62:0/1611829286 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:34.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.099+0000 7f55bdd9b640 1 -- 172.21.15.62:0/1611829286 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55f4bf4721e0 msgr2=0x55f4bf478140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:00:34.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.099+0000 7f55bdd9b640 1 --2- 172.21.15.62:0/1611829286 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55f4bf4721e0 0x55f4bf478140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:34.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.099+0000 7f55bdd9b640 1 -- 172.21.15.62:0/1611829286 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f4bf473420 msgr2=0x55f4bf478bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:00:34.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.099+0000 7f55bdd9b640 1 --2- 172.21.15.62:0/1611829286 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f4bf473420 0x55f4bf478bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:34.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.099+0000 7f55bdd9b640 1 -- 172.21.15.62:0/1611829286 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f4bf236760 con 0x55f4bf472b00 2023-10-08T12:00:34.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.099+0000 7f55bdd9b640 1 --2- 172.21.15.62:0/1611829286 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f4bf472b00 0x55f4bf478680 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f55b0007960 tx=0x7f55b0001990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd42f9867b0ec3b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:34.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.099+0000 7f55bcd99640 1 -- 172.21.15.62:0/1611829286 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b0001370 con 0x55f4bf472b00 2023-10-08T12:00:34.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.099+0000 7f55bcd99640 1 -- 172.21.15.62:0/1611829286 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f55b0004670 con 0x55f4bf472b00 2023-10-08T12:00:34.106 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.099+0000 7f55bcd99640 1 -- 172.21.15.62:0/1611829286 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b0005350 con 0x55f4bf472b00 2023-10-08T12:00:34.106 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.099+0000 7f55cfc7f000 1 -- 172.21.15.62:0/1611829286 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f4bf472b00 msgr2=0x55f4bf478680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:34.106 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.099+0000 7f55cfc7f000 1 --2- 172.21.15.62:0/1611829286 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f4bf472b00 0x55f4bf478680 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f55b0007960 tx=0x7f55b0001990 comp rx=0 tx=0).stop 2023-10-08T12:00:34.106 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.099+0000 7f55cfc7f000 1 -- 172.21.15.62:0/1611829286 shutdown_connections 2023-10-08T12:00:34.106 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.099+0000 7f55cfc7f000 1 --2- 172.21.15.62:0/1611829286 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f4bf473420 0x55f4bf478bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:34.106 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.099+0000 7f55cfc7f000 1 --2- 172.21.15.62:0/1611829286 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f4bf472b00 0x55f4bf478680 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:34.106 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.099+0000 7f55cfc7f000 1 --2- 172.21.15.62:0/1611829286 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55f4bf4721e0 0x55f4bf478140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:34.106 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.099+0000 7f55cfc7f000 1 -- 172.21.15.62:0/1611829286 >> 172.21.15.62:0/1611829286 conn(0x55f4bf46df90 msgr2=0x55f4bf475f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:34.106 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.099+0000 7f55cfc7f000 1 -- 172.21.15.62:0/1611829286 shutdown_connections 2023-10-08T12:00:34.106 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.099+0000 7f55cfc7f000 1 -- 172.21.15.62:0/1611829286 wait complete. 2023-10-08T12:00:34.110 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.099+0000 7f55cfc7f000 1 -- start start 2023-10-08T12:00:34.110 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.099+0000 7f55cfc7f000 1 Processor -- start 2023-10-08T12:00:34.110 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.099+0000 7f55cfc7f000 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f4bf4721e0 0x55f4bf48af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:34.110 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.099+0000 7f55cfc7f000 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f4bf472b00 0x55f4bf48b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:34.110 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.099+0000 7f55cfc7f000 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55f4bf473420 0x55f4bf488280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:34.111 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.099+0000 7f55cfc7f000 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4bf24d640 con 0x55f4bf472b00 2023-10-08T12:00:34.111 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.099+0000 7f55cfc7f000 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4bf28a670 con 0x55f4bf4721e0 2023-10-08T12:00:34.111 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.099+0000 7f55cfc7f000 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f4bf252a50 con 0x55f4bf473420 2023-10-08T12:00:34.111 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.099+0000 7f55cfc7f000 10 client.0 _ll_register_callbacks cb 0x55f4bf28e100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:00:34.111 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.099+0000 7f55bdd9b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f4bf472b00 0x55f4bf48b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:34.111 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.103+0000 7f55bdd9b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f4bf472b00 0x55f4bf48b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:44302/0 (socket says 172.21.15.62:44302) 2023-10-08T12:00:34.111 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.103+0000 7f55bdd9b640 1 -- 172.21.15.62:0/988292848 learned_addr learned my addr 172.21.15.62:0/988292848 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:34.111 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.103+0000 7f55bdd9b640 1 -- 172.21.15.62:0/988292848 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55f4bf473420 msgr2=0x55f4bf488280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:00:34.111 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.103+0000 7f55bdd9b640 1 --2- 172.21.15.62:0/988292848 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55f4bf473420 0x55f4bf488280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:34.111 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.103+0000 7f55c659c640 1 --2- 172.21.15.62:0/988292848 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f4bf4721e0 0x55f4bf48af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:34.112 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.103+0000 7f55bdd9b640 1 -- 172.21.15.62:0/988292848 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f4bf4721e0 msgr2=0x55f4bf48af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:00:34.112 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.103+0000 7f55bdd9b640 1 --2- 172.21.15.62:0/988292848 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f4bf4721e0 0x55f4bf48af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:34.112 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.103+0000 7f55bdd9b640 1 -- 172.21.15.62:0/988292848 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f4bf250460 con 0x55f4bf472b00 2023-10-08T12:00:34.112 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.103+0000 7f55bdd9b640 1 --2- 172.21.15.62:0/988292848 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f4bf472b00 0x55f4bf48b4c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f55b0004940 tx=0x7f55b0004fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=801d8bbb270d6403 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:34.112 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.103+0000 7f55a57fa640 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2023-10-08T12:00:34.112 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.103+0000 7f55a57fa640 1 -- 172.21.15.62:0/988292848 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b0007ca0 con 0x55f4bf472b00 2023-10-08T12:00:34.112 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.103+0000 7f55a57fa640 1 -- 172.21.15.62:0/988292848 <== mon.0 v2:172.21.15.62:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f55b003aac0 con 0x55f4bf472b00 2023-10-08T12:00:34.112 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.103+0000 7f55cfc7f000 1 -- 172.21.15.62:0/988292848 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f4bf2266f0 con 0x55f4bf472b00 2023-10-08T12:00:34.112 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.103+0000 7f55a57fa640 1 -- 172.21.15.62:0/988292848 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f55b003ac80 con 0x55f4bf472b00 2023-10-08T12:00:34.112 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.103+0000 7f55cfc7f000 10 client.4758 fetch_fsmap learned FSMap version 8 2023-10-08T12:00:34.112 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.103+0000 7f55cfc7f000 1 -- 172.21.15.62:0/988292848 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55f4bef87cc0 con 0x55f4bf472b00 2023-10-08T12:00:34.112 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.103+0000 7f55a57fa640 1 -- 172.21.15.62:0/988292848 <== mon.0 v2:172.21.15.62:3300/0 4 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x55f4bf2266f0 con 0x55f4bf472b00 2023-10-08T12:00:34.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.103+0000 7f55a57fa640 1 -- 172.21.15.62:0/988292848 <== mon.0 v2:172.21.15.62:3300/0 5 ==== fsmap(e 8) v1 ==== 2719+0+0 (secure 0 0 0) 0x7f55b000d870 con 0x55f4bf472b00 2023-10-08T12:00:34.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.103+0000 7f55cfc7f000 10 client.4758 fetch_fsmap finished waiting for FSMap version 8 2023-10-08T12:00:34.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.103+0000 7f55cfc7f000 10 client.4758 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-08T12:00:34.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.103+0000 7f55cfc7f000 20 client.4758 populate_metadata read hostname 'smithi062' 2023-10-08T12:00:34.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.103+0000 7f55cfc7f000 1 --2- 172.21.15.62:0/988292848 >> [v2:172.21.15.62:6832/2629384568,v1:172.21.15.62:6834/2629384568] conn(0x55f4bf488bb0 0x55f4bf488f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:34.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.103+0000 7f55cfc7f000 4 client.4758 mds_command: new command op to 4362 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-08T12:00:34.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.103+0000 7f55cfc7f000 1 -- 172.21.15.62:0/988292848 --> [v2:172.21.15.62:6832/2629384568,v1:172.21.15.62:6834/2629384568] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f4bf2876e0 con 0x55f4bf488bb0 2023-10-08T12:00:34.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.103+0000 7f55c659c640 1 --2- 172.21.15.62:0/988292848 >> [v2:172.21.15.62:6832/2629384568,v1:172.21.15.62:6834/2629384568] conn(0x55f4bf488bb0 0x55f4bf488f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:34.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.103+0000 7f55a57fa640 10 client.4758 ms_handle_connect on v2:172.21.15.62:6832/2629384568 2023-10-08T12:00:34.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.103+0000 7f55c659c640 1 --2- 172.21.15.62:0/988292848 >> [v2:172.21.15.62:6832/2629384568,v1:172.21.15.62:6834/2629384568] conn(0x55f4bf488bb0 0x55f4bf488f90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ad5bb4c20a0a6cb server_cookie=2101c5bcf2b34324 in_seq=0 out_seq=0 2023-10-08T12:00:34.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.103+0000 7f55a57fa640 1 -- 172.21.15.62:0/988292848 <== mds.0 v2:172.21.15.62:6832/2629384568 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x55f4bf2876e0 con 0x55f4bf488bb0 2023-10-08T12:00:34.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.103+0000 7f55a57fa640 10 client.4758 handle_command_reply: tid=0 2023-10-08T12:00:34.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.103+0000 7f55cfc7f000 1 client.4758 shutdown 2023-10-08T12:00:34.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.103+0000 7f55cfc7f000 1 -- 172.21.15.62:0/988292848 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f4bf472b00 msgr2=0x55f4bf48b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:34.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.103+0000 7f55cfc7f000 1 --2- 172.21.15.62:0/988292848 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f4bf472b00 0x55f4bf48b4c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f55b0004940 tx=0x7f55b0004fa0 comp rx=0 tx=0).stop 2023-10-08T12:00:34.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.103+0000 7f55cfc7f000 1 -- 172.21.15.62:0/988292848 shutdown_connections 2023-10-08T12:00:34.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.103+0000 7f55cfc7f000 1 --2- 172.21.15.62:0/988292848 >> [v2:172.21.15.62:6832/2629384568,v1:172.21.15.62:6834/2629384568] conn(0x55f4bf488bb0 0x55f4bf488f90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:34.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.103+0000 7f55cfc7f000 1 --2- 172.21.15.62:0/988292848 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55f4bf473420 0x55f4bf488280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:34.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.103+0000 7f55a57fa640 0 client.4758 ms_handle_reset on v2:172.21.15.62:6832/2629384568 2023-10-08T12:00:34.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.103+0000 7f55cfc7f000 1 --2- 172.21.15.62:0/988292848 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f4bf472b00 0x55f4bf48b4c0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:34.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.103+0000 7f55cfc7f000 1 --2- 172.21.15.62:0/988292848 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f4bf4721e0 0x55f4bf48af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:34.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.103+0000 7f55cfc7f000 1 -- 172.21.15.62:0/988292848 >> 172.21.15.62:0/988292848 conn(0x55f4bf46df90 msgr2=0x55f4bf4767a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:34.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.103+0000 7f55cfc7f000 1 -- 172.21.15.62:0/988292848 shutdown_connections 2023-10-08T12:00:34.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.103+0000 7f55cfc7f000 1 -- 172.21.15.62:0/988292848 wait complete. 2023-10-08T12:00:34.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.103+0000 7f55cfc7f000 20 client.4758 trim_cache size 0 max 16384 2023-10-08T12:00:34.115 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2023-10-08T12:00:34.115 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_fsid": "3e777930-c2c1-4f2b-a903-c07ee4ca2c52", 2023-10-08T12:00:34.115 INFO:teuthology.orchestra.run.smithi062.stdout: "whoami": 0, 2023-10-08T12:00:34.115 INFO:teuthology.orchestra.run.smithi062.stdout: "id": 4362, 2023-10-08T12:00:34.115 INFO:teuthology.orchestra.run.smithi062.stdout: "want_state": "up:active", 2023-10-08T12:00:34.116 INFO:teuthology.orchestra.run.smithi062.stdout: "state": "up:active", 2023-10-08T12:00:34.116 INFO:teuthology.orchestra.run.smithi062.stdout: "fs_name": "cephfs", 2023-10-08T12:00:34.116 INFO:teuthology.orchestra.run.smithi062.stdout: "rank_uptime": 13.523457179999999, 2023-10-08T12:00:34.116 INFO:teuthology.orchestra.run.smithi062.stdout: "mdsmap_epoch": 8, 2023-10-08T12:00:34.116 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_epoch": 20, 2023-10-08T12:00:34.116 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_epoch_barrier": 20, 2023-10-08T12:00:34.116 INFO:teuthology.orchestra.run.smithi062.stdout: "uptime": 20.652245193999999 2023-10-08T12:00:34.116 INFO:teuthology.orchestra.run.smithi062.stdout:} 2023-10-08T12:00:34.117 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.103+0000 7f55ccb36640 1 -- 172.21.15.62:0/2755854798 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f55a8066470 msgr2=0x7f55a8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:34.117 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.103+0000 7f55ccb36640 1 --2- 172.21.15.62:0/2755854798 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f55a8066470 0x7f55a8068930 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f55b80af000 tx=0x7f55b801af60 comp rx=0 tx=0).stop 2023-10-08T12:00:34.117 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.103+0000 7f55ccb36640 1 -- 172.21.15.62:0/2755854798 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f55c8143550 msgr2=0x7f55c8137aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:34.117 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.103+0000 7f55ccb36640 1 --2- 172.21.15.62:0/2755854798 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f55c8143550 0x7f55c8137aa0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f55c000cae0 tx=0x7f55c000a250 comp rx=0 tx=0).stop 2023-10-08T12:00:34.117 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.103+0000 7f55ccb36640 1 -- 172.21.15.62:0/2755854798 shutdown_connections 2023-10-08T12:00:34.117 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.103+0000 7f55ccb36640 1 --2- 172.21.15.62:0/2755854798 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f55a8066470 0x7f55a8068930 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:34.117 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.103+0000 7f55ccb36640 1 --2- 172.21.15.62:0/2755854798 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f55c80bb7a0 0x7f55c81e2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:34.117 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.103+0000 7f55ccb36640 1 --2- 172.21.15.62:0/2755854798 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f55c8143550 0x7f55c8137aa0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:34.118 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.103+0000 7f55ccb36640 1 --2- 172.21.15.62:0/2755854798 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f55c80bb310 0x7f55c8140e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:34.118 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.103+0000 7f55ccb36640 1 -- 172.21.15.62:0/2755854798 >> 172.21.15.62:0/2755854798 conn(0x7f55c80a0540 msgr2=0x7f55c8069790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:34.118 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.103+0000 7f55ccb36640 1 -- 172.21.15.62:0/2755854798 shutdown_connections 2023-10-08T12:00:34.118 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.103+0000 7f55ccb36640 1 -- 172.21.15.62:0/2755854798 wait complete. 2023-10-08T12:00:34.124 INFO:teuthology.run_tasks:Running task kclient... 2023-10-08T12:00:34.151 INFO:tasks.kclient:Mounting kernel clients... 2023-10-08T12:00:34.152 INFO:tasks.kclient:config is {'client.0': {}} 2023-10-08T12:00:34.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:00:34.152 DEBUG:teuthology.orchestra.run.smithi156:> ip netns list 2023-10-08T12:00:34.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:00:34.164 DEBUG:teuthology.orchestra.run.smithi156:> sudo ip link delete ceph-brx 2023-10-08T12:00:34.237 INFO:teuthology.orchestra.run.smithi156.stderr:Cannot find device "ceph-brx" 2023-10-08T12:00:34.239 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T12:00:34.239 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2023-10-08T12:00:34.240 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-08T12:00:34.240 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-08T12:00:34.240 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T12:00:34.370 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.363+0000 7fbd8c1ce640 1 -- 172.21.15.62:0/1675110071 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbd840b7b50 msgr2=0x7fbd840b68f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:34.370 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.363+0000 7fbd8c1ce640 1 --2- 172.21.15.62:0/1675110071 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbd840b7b50 0x7fbd840b68f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fbd8406cde0 tx=0x7fbd7401cd20 comp rx=0 tx=0).stop 2023-10-08T12:00:34.370 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.363+0000 7fbd8c1ce640 1 -- 172.21.15.62:0/1675110071 shutdown_connections 2023-10-08T12:00:34.370 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.363+0000 7fbd8c1ce640 1 --2- 172.21.15.62:0/1675110071 >> v2:172.21.15.130:3300/0 conn(0x7fbd840b6e30 0x7fbd8406b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:34.370 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.363+0000 7fbd8c1ce640 1 --2- 172.21.15.62:0/1675110071 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbd840b7b50 0x7fbd840b68f0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:34.370 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.363+0000 7fbd8c1ce640 1 -- 172.21.15.62:0/1675110071 >> 172.21.15.62:0/1675110071 conn(0x7fbd840b82f0 msgr2=0x7fbd840b8700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:34.370 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.367+0000 7fbd8c1ce640 1 -- 172.21.15.62:0/1675110071 shutdown_connections 2023-10-08T12:00:34.370 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.367+0000 7fbd8c1ce640 1 -- 172.21.15.62:0/1675110071 wait complete. 2023-10-08T12:00:34.372 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.367+0000 7fbd8c1ce640 1 Processor -- start 2023-10-08T12:00:34.372 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.367+0000 7fbd8c1ce640 1 -- start start 2023-10-08T12:00:34.373 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.367+0000 7fbd8c1ce640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbd8406bef0 0x7fbd840b1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:34.373 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.367+0000 7fbd8c1ce640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbd840b6e30 0x7fbd8413c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:34.373 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.367+0000 7fbd8c1ce640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbd840b7b50 0x7fbd8413cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:34.373 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.367+0000 7fbd8c1ce640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd84140890 con 0x7fbd8406bef0 2023-10-08T12:00:34.373 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.367+0000 7fbd8c1ce640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd841dfe70 con 0x7fbd840b6e30 2023-10-08T12:00:34.373 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.367+0000 7fbd8c1ce640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd84138b60 con 0x7fbd840b7b50 2023-10-08T12:00:34.373 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.367+0000 7fbd89f6a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbd8406bef0 0x7fbd840b1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:34.373 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.367+0000 7fbd89f6a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbd8406bef0 0x7fbd840b1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:44322/0 (socket says 172.21.15.62:44322) 2023-10-08T12:00:34.373 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.367+0000 7fbd89f6a640 1 -- 172.21.15.62:0/808458998 learned_addr learned my addr 172.21.15.62:0/808458998 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:34.373 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.367+0000 7fbd89769640 1 --2- 172.21.15.62:0/808458998 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbd840b6e30 0x7fbd8413c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:34.373 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.367+0000 7fbd89f6a640 1 -- 172.21.15.62:0/808458998 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbd840b7b50 msgr2=0x7fbd8413cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:34.374 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.367+0000 7fbd8a76b640 1 --2- 172.21.15.62:0/808458998 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbd840b7b50 0x7fbd8413cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:34.374 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.367+0000 7fbd89f6a640 1 --2- 172.21.15.62:0/808458998 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbd840b7b50 0x7fbd8413cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:34.374 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.367+0000 7fbd89f6a640 1 -- 172.21.15.62:0/808458998 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbd840b6e30 msgr2=0x7fbd8413c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:34.374 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.367+0000 7fbd89f6a640 1 --2- 172.21.15.62:0/808458998 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbd840b6e30 0x7fbd8413c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:34.374 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.367+0000 7fbd89f6a640 1 -- 172.21.15.62:0/808458998 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd740098e0 con 0x7fbd8406bef0 2023-10-08T12:00:34.374 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.367+0000 7fbd89769640 1 --2- 172.21.15.62:0/808458998 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbd840b6e30 0x7fbd8413c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:00:34.374 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.367+0000 7fbd89f6a640 1 --2- 172.21.15.62:0/808458998 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbd8406bef0 0x7fbd840b1920 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbd74000f90 tx=0x7fbd740a5be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:34.374 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.367+0000 7fbd827fc640 1 -- 172.21.15.62:0/808458998 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd740043f0 con 0x7fbd8406bef0 2023-10-08T12:00:34.374 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.367+0000 7fbd827fc640 1 -- 172.21.15.62:0/808458998 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fbd74004640 con 0x7fbd8406bef0 2023-10-08T12:00:34.374 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.367+0000 7fbd827fc640 1 -- 172.21.15.62:0/808458998 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd740ad440 con 0x7fbd8406bef0 2023-10-08T12:00:34.374 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.367+0000 7fbd8c1ce640 1 -- 172.21.15.62:0/808458998 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd841df610 con 0x7fbd8406bef0 2023-10-08T12:00:34.375 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.367+0000 7fbd8c1ce640 1 -- 172.21.15.62:0/808458998 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd841dfb90 con 0x7fbd8406bef0 2023-10-08T12:00:34.375 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.371+0000 7fbd8c1ce640 1 -- 172.21.15.62:0/808458998 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd8404da80 con 0x7fbd8406bef0 2023-10-08T12:00:34.375 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.371+0000 7fbd827fc640 1 -- 172.21.15.62:0/808458998 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fbd740b4040 con 0x7fbd8406bef0 2023-10-08T12:00:34.376 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.371+0000 7fbd827fc640 1 --2- 172.21.15.62:0/808458998 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fbd700664a0 0x7fbd70068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:34.376 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.371+0000 7fbd827fc640 1 -- 172.21.15.62:0/808458998 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbd7411ef80 con 0x7fbd8406bef0 2023-10-08T12:00:34.376 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.371+0000 7fbd89769640 1 --2- 172.21.15.62:0/808458998 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fbd700664a0 0x7fbd70068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:34.376 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.371+0000 7fbd89769640 1 --2- 172.21.15.62:0/808458998 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fbd700664a0 0x7fbd70068960 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbd78005fd0 tx=0x7fbd78005d40 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:34.379 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.375+0000 7fbd827fc640 1 -- 172.21.15.62:0/808458998 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbd740ec370 con 0x7fbd8406bef0 2023-10-08T12:00:34.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.567+0000 7fbd8c1ce640 1 -- 172.21.15.62:0/808458998 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fbd8404da80 con 0x7fbd8406bef0 2023-10-08T12:00:34.574 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.571+0000 7fbd827fc640 1 -- 172.21.15.62:0/808458998 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fbd740ef990 con 0x7fbd8406bef0 2023-10-08T12:00:34.574 INFO:teuthology.orchestra.run.smithi062.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T12:00:34.576 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.571+0000 7fbd8c1ce640 1 -- 172.21.15.62:0/808458998 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fbd700664a0 msgr2=0x7fbd70068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:34.577 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.571+0000 7fbd8c1ce640 1 --2- 172.21.15.62:0/808458998 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fbd700664a0 0x7fbd70068960 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbd78005fd0 tx=0x7fbd78005d40 comp rx=0 tx=0).stop 2023-10-08T12:00:34.577 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.571+0000 7fbd8c1ce640 1 -- 172.21.15.62:0/808458998 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbd8406bef0 msgr2=0x7fbd840b1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:34.577 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.571+0000 7fbd8c1ce640 1 --2- 172.21.15.62:0/808458998 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbd8406bef0 0x7fbd840b1920 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbd74000f90 tx=0x7fbd740a5be0 comp rx=0 tx=0).stop 2023-10-08T12:00:34.577 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.571+0000 7fbd8c1ce640 1 -- 172.21.15.62:0/808458998 shutdown_connections 2023-10-08T12:00:34.578 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.571+0000 7fbd8c1ce640 1 --2- 172.21.15.62:0/808458998 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fbd700664a0 0x7fbd70068960 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:34.578 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.571+0000 7fbd8c1ce640 1 --2- 172.21.15.62:0/808458998 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbd840b7b50 0x7fbd8413cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:34.578 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.571+0000 7fbd8c1ce640 1 --2- 172.21.15.62:0/808458998 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbd840b6e30 0x7fbd8413c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:34.578 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.571+0000 7fbd8c1ce640 1 --2- 172.21.15.62:0/808458998 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbd8406bef0 0x7fbd840b1920 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:34.578 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.571+0000 7fbd8c1ce640 1 -- 172.21.15.62:0/808458998 >> 172.21.15.62:0/808458998 conn(0x7fbd840b82f0 msgr2=0x7fbd841450d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:34.578 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.571+0000 7fbd8c1ce640 1 -- 172.21.15.62:0/808458998 shutdown_connections 2023-10-08T12:00:34.578 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:34.571+0000 7fbd8c1ce640 1 -- 172.21.15.62:0/808458998 wait complete. 2023-10-08T12:00:34.593 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-08T12:00:34.593 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T12:00:34.593 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi156.front.sepia.ceph.com 2023-10-08T12:00:34.593 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-08T12:00:34.593 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-08T12:00:34.593 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-08T12:00:34.593 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-08T12:00:34.593 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T12:00:34.593 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T12:00:34.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:00:34.594 DEBUG:teuthology.orchestra.run.smithi156:> ip addr 2023-10-08T12:00:34.603 INFO:teuthology.orchestra.run.smithi156.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T12:00:34.604 INFO:teuthology.orchestra.run.smithi156.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T12:00:34.604 INFO:teuthology.orchestra.run.smithi156.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T12:00:34.604 INFO:teuthology.orchestra.run.smithi156.stdout: valid_lft forever preferred_lft forever 2023-10-08T12:00:34.604 INFO:teuthology.orchestra.run.smithi156.stdout: inet6 ::1/128 scope host 2023-10-08T12:00:34.604 INFO:teuthology.orchestra.run.smithi156.stdout: valid_lft forever preferred_lft forever 2023-10-08T12:00:34.604 INFO:teuthology.orchestra.run.smithi156.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-08T12:00:34.604 INFO:teuthology.orchestra.run.smithi156.stdout: link/ether 0c:c4:7a:da:6a:c0 brd ff:ff:ff:ff:ff:ff 2023-10-08T12:00:34.605 INFO:teuthology.orchestra.run.smithi156.stdout: altname enp7s0f0 2023-10-08T12:00:34.605 INFO:teuthology.orchestra.run.smithi156.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-08T12:00:34.605 INFO:teuthology.orchestra.run.smithi156.stdout: link/ether 0c:c4:7a:da:6a:c1 brd ff:ff:ff:ff:ff:ff 2023-10-08T12:00:34.605 INFO:teuthology.orchestra.run.smithi156.stdout: altname enp7s0f1 2023-10-08T12:00:34.605 INFO:teuthology.orchestra.run.smithi156.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-08T12:00:34.605 INFO:teuthology.orchestra.run.smithi156.stdout: link/ether 0c:c4:7a:88:6d:fc brd ff:ff:ff:ff:ff:ff 2023-10-08T12:00:34.605 INFO:teuthology.orchestra.run.smithi156.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T12:00:34.605 INFO:teuthology.orchestra.run.smithi156.stdout: link/ether 0c:c4:7a:88:6d:fd brd ff:ff:ff:ff:ff:ff 2023-10-08T12:00:34.605 INFO:teuthology.orchestra.run.smithi156.stdout: inet 172.21.15.156/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-10-08T12:00:34.605 INFO:teuthology.orchestra.run.smithi156.stdout: valid_lft 42434sec preferred_lft 42434sec 2023-10-08T12:00:34.605 INFO:teuthology.orchestra.run.smithi156.stdout: inet6 fe80::ec4:7aff:fe88:6dfd/64 scope link 2023-10-08T12:00:34.606 INFO:teuthology.orchestra.run.smithi156.stdout: valid_lft forever preferred_lft forever 2023-10-08T12:00:34.606 INFO:teuthology.orchestra.run.smithi156.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-08T12:00:34.606 INFO:teuthology.orchestra.run.smithi156.stdout: link/ether 02:42:50:b6:93:f5 brd ff:ff:ff:ff:ff:ff 2023-10-08T12:00:34.606 INFO:teuthology.orchestra.run.smithi156.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-08T12:00:34.606 INFO:teuthology.orchestra.run.smithi156.stdout: valid_lft forever preferred_lft forever 2023-10-08T12:00:34.608 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-08T12:00:34.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:00:34.608 DEBUG:teuthology.orchestra.run.smithi156:> (cd / && exec bash -c ' 2023-10-08T12:00:34.609 DEBUG:teuthology.orchestra.run.smithi156:> set -e 2023-10-08T12:00:34.609 DEBUG:teuthology.orchestra.run.smithi156:> sudo ip link add name ceph-brx type bridge 2023-10-08T12:00:34.609 DEBUG:teuthology.orchestra.run.smithi156:> sudo ip addr flush dev ceph-brx 2023-10-08T12:00:34.609 DEBUG:teuthology.orchestra.run.smithi156:> sudo ip link set ceph-brx up 2023-10-08T12:00:34.610 DEBUG:teuthology.orchestra.run.smithi156:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-08T12:00:34.610 DEBUG:teuthology.orchestra.run.smithi156:> ') 2023-10-08T12:00:34.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:00:34.729 DEBUG:teuthology.orchestra.run.smithi156:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T12:00:34.748 INFO:teuthology.orchestra.run.smithi156.stdout:1 2023-10-08T12:00:34.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:00:34.751 DEBUG:teuthology.orchestra.run.smithi156:> route 2023-10-08T12:00:34.827 INFO:teuthology.orchestra.run.smithi156.stdout:Kernel IP routing table 2023-10-08T12:00:34.827 INFO:teuthology.orchestra.run.smithi156.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T12:00:34.827 INFO:teuthology.orchestra.run.smithi156.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-10-08T12:00:34.828 INFO:teuthology.orchestra.run.smithi156.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-08T12:00:34.828 INFO:teuthology.orchestra.run.smithi156.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-08T12:00:34.828 INFO:teuthology.orchestra.run.smithi156.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-08T12:00:34.828 INFO:teuthology.orchestra.run.smithi156.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-08T12:00:34.828 INFO:teuthology.orchestra.run.smithi156.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-08T12:00:34.828 INFO:teuthology.orchestra.run.smithi156.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-08T12:00:34.828 INFO:teuthology.orchestra.run.smithi156.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T12:00:34.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:00:34.829 DEBUG:teuthology.orchestra.run.smithi156:> (cd / && exec bash -c ' 2023-10-08T12:00:34.829 DEBUG:teuthology.orchestra.run.smithi156:> set -e 2023-10-08T12:00:34.829 DEBUG:teuthology.orchestra.run.smithi156:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-08T12:00:34.829 DEBUG:teuthology.orchestra.run.smithi156:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-08T12:00:34.829 DEBUG:teuthology.orchestra.run.smithi156:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-08T12:00:34.829 DEBUG:teuthology.orchestra.run.smithi156:> ') 2023-10-08T12:00:34.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:00:34.928 DEBUG:teuthology.orchestra.run.smithi156:> ip netns list 2023-10-08T12:00:34.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:00:34.938 DEBUG:teuthology.orchestra.run.smithi156:> ip netns list-id 2023-10-08T12:00:34.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:00:34.988 DEBUG:teuthology.orchestra.run.smithi156:> (cd / && exec bash -c ' 2023-10-08T12:00:34.988 DEBUG:teuthology.orchestra.run.smithi156:> set -e 2023-10-08T12:00:34.988 DEBUG:teuthology.orchestra.run.smithi156:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T12:00:34.988 DEBUG:teuthology.orchestra.run.smithi156:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-08T12:00:34.988 DEBUG:teuthology.orchestra.run.smithi156:> ') 2023-10-08T12:00:35.071 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-08T12:00:35.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:00:35.071 DEBUG:teuthology.orchestra.run.smithi156:> (cd / && exec bash -c ' 2023-10-08T12:00:35.072 DEBUG:teuthology.orchestra.run.smithi156:> set -e 2023-10-08T12:00:35.072 DEBUG:teuthology.orchestra.run.smithi156:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-08T12:00:35.072 DEBUG:teuthology.orchestra.run.smithi156:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-08T12:00:35.072 DEBUG:teuthology.orchestra.run.smithi156:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-08T12:00:35.072 DEBUG:teuthology.orchestra.run.smithi156:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-08T12:00:35.073 DEBUG:teuthology.orchestra.run.smithi156:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-08T12:00:35.073 DEBUG:teuthology.orchestra.run.smithi156:> ') 2023-10-08T12:00:35.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:00:35.239 DEBUG:teuthology.orchestra.run.smithi156:> (cd / && exec bash -c ' 2023-10-08T12:00:35.239 DEBUG:teuthology.orchestra.run.smithi156:> set -e 2023-10-08T12:00:35.239 DEBUG:teuthology.orchestra.run.smithi156:> sudo ip link set brx.0 up 2023-10-08T12:00:35.239 DEBUG:teuthology.orchestra.run.smithi156:> sudo ip link set dev brx.0 master ceph-brx 2023-10-08T12:00:35.239 DEBUG:teuthology.orchestra.run.smithi156:> ') 2023-10-08T12:00:35.280 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T12:00:35.281 DEBUG:teuthology.orchestra.run.smithi156:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-08T12:00:35.335 INFO:teuthology.orchestra.run.smithi156.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-08T12:00:35.336 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T12:00:35.336 DEBUG:teuthology.orchestra.run.smithi156:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-08T12:00:35.390 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-08T12:00:35.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:00:35.391 DEBUG:teuthology.orchestra.run.smithi156:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T12:00:35.511 INFO:teuthology.orchestra.run.smithi156.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T12:00:35.511 INFO:teuthology.orchestra.run.smithi156.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T12:00:35.629 INFO:teuthology.orchestra.run.smithi156.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T12:00:35.629 INFO:teuthology.orchestra.run.smithi156.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T12:00:35.629 INFO:teuthology.orchestra.run.smithi156.stdout:mount.ceph: resolved to: "172.21.15.62:3300,172.21.15.130:3300,172.21.15.130:3301" 2023-10-08T12:00:35.629 INFO:teuthology.orchestra.run.smithi156.stdout:mount.ceph: trying mount with new device syntax: 0@3e777930-c2c1-4f2b-a903-c07ee4ca2c52.cephfs=/ 2023-10-08T12:00:35.629 INFO:teuthology.orchestra.run.smithi156.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.62:3300/172.21.15.130:3300/172.21.15.130:3301" will pass to kernel 2023-10-08T12:00:35.633 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T12:00:35.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:00:35.633 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-08T12:00:35.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:00:35.655 DEBUG:teuthology.orchestra.run.smithi156:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-08T12:00:35.734 INFO:teuthology.orchestra.run.smithi156.stdout:client4558 2023-10-08T12:00:35.734 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-10-08T12:00:35.734 DEBUG:teuthology.orchestra.run.smithi156:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-08T12:00:35.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:00:35.783 DEBUG:teuthology.orchestra.run.smithi156:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-08T12:00:35.858 INFO:teuthology.orchestra.run.smithi156.stdout:client4558 2023-10-08T12:00:35.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:00:35.859 DEBUG:teuthology.orchestra.run.smithi156:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-08T12:00:35.929 INFO:teuthology.orchestra.run.smithi156.stdout:client4558 2023-10-08T12:00:35.930 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:00:35.930 DEBUG:teuthology.orchestra.run.smithi156:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/3e777930-c2c1-4f2b-a903-c07ee4ca2c52.client4558/status') 2023-10-08T12:00:36.002 INFO:teuthology.orchestra.run.smithi156.stdout:instance: client.4558 (3)172.21.15.156:0/3911350698 2023-10-08T12:00:36.002 INFO:teuthology.orchestra.run.smithi156.stdout:blocklisted: false 2023-10-08T12:00:36.002 INFO:teuthology.orchestra.run.smithi156.stderr:0+1 records in 2023-10-08T12:00:36.002 INFO:teuthology.orchestra.run.smithi156.stderr:0+1 records out 2023-10-08T12:00:36.002 INFO:teuthology.orchestra.run.smithi156.stderr:71 bytes copied, 5.1395e-05 s, 1.4 MB/s 2023-10-08T12:00:36.004 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-10-08T12:00:36.027 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:00:36.166 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.163+0000 7f4410c15640 1 -- 172.21.15.62:0/3255235308 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f440c0b99e0 msgr2=0x7f440c09d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:36.166 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.163+0000 7f4410c15640 1 --2- 172.21.15.62:0/3255235308 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f440c0b99e0 0x7f440c09d040 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f43fc009840 tx=0x7f43fc01c800 comp rx=0 tx=0).stop 2023-10-08T12:00:36.166 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.163+0000 7f4410c15640 1 -- 172.21.15.62:0/3255235308 shutdown_connections 2023-10-08T12:00:36.166 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.163+0000 7f4410c15640 1 --2- 172.21.15.62:0/3255235308 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f440c0b5170 0x7f440c0b56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:36.166 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.163+0000 7f4410c15640 1 --2- 172.21.15.62:0/3255235308 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f440c0b99e0 0x7f440c09d040 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:36.166 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.163+0000 7f4410c15640 1 -- 172.21.15.62:0/3255235308 >> 172.21.15.62:0/3255235308 conn(0x7f440c09c520 msgr2=0x7f440c09c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:36.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.163+0000 7f4410c15640 1 -- 172.21.15.62:0/3255235308 shutdown_connections 2023-10-08T12:00:36.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.163+0000 7f4410c15640 1 -- 172.21.15.62:0/3255235308 wait complete. 2023-10-08T12:00:36.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.163+0000 7f4410c15640 1 Processor -- start 2023-10-08T12:00:36.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.163+0000 7f4410c15640 1 -- start start 2023-10-08T12:00:36.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.163+0000 7f4410c15640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f440c0b5170 0x7f440c143a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:36.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.163+0000 7f4410c15640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f440c0b5c20 0x7f440c0b3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:36.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.163+0000 7f4410c15640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f440c0b99e0 0x7f440c1e03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:36.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.163+0000 7f4410c15640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f440c0b4420 con 0x7f440c0b99e0 2023-10-08T12:00:36.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.163+0000 7f4410c15640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f440c141630 con 0x7f440c0b5170 2023-10-08T12:00:36.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.163+0000 7f4410c15640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f440c144020 con 0x7f440c0b5c20 2023-10-08T12:00:36.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.163+0000 7f440ad9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f440c0b99e0 0x7f440c1e03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:36.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.163+0000 7f440ad9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f440c0b99e0 0x7f440c1e03c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43464/0 (socket says 172.21.15.62:43464) 2023-10-08T12:00:36.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.163+0000 7f440ad9d640 1 -- 172.21.15.62:0/1454159211 learned_addr learned my addr 172.21.15.62:0/1454159211 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:36.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.163+0000 7f440ad9d640 1 -- 172.21.15.62:0/1454159211 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f440c0b5c20 msgr2=0x7f440c0b3ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:36.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.163+0000 7f440ad9d640 1 --2- 172.21.15.62:0/1454159211 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f440c0b5c20 0x7f440c0b3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:36.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.163+0000 7f440ad9d640 1 -- 172.21.15.62:0/1454159211 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f440c0b5170 msgr2=0x7f440c143a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:36.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.163+0000 7f440a59c640 1 --2- 172.21.15.62:0/1454159211 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f440c0b5170 0x7f440c143a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:36.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.163+0000 7f440ad9d640 1 --2- 172.21.15.62:0/1454159211 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f440c0b5170 0x7f440c143a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:36.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.163+0000 7f440ad9d640 1 -- 172.21.15.62:0/1454159211 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43fc0094a0 con 0x7f440c0b99e0 2023-10-08T12:00:36.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.163+0000 7f440ad9d640 1 --2- 172.21.15.62:0/1454159211 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f440c0b99e0 0x7f440c1e03c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f440400cbf0 tx=0x7f440400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:36.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.163+0000 7f43faffd640 1 -- 172.21.15.62:0/1454159211 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f440400aa50 con 0x7f440c0b99e0 2023-10-08T12:00:36.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.163+0000 7f43faffd640 1 -- 172.21.15.62:0/1454159211 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f440400aca0 con 0x7f440c0b99e0 2023-10-08T12:00:36.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.163+0000 7f4410c15640 1 -- 172.21.15.62:0/1454159211 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f440c1e0900 con 0x7f440c0b99e0 2023-10-08T12:00:36.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.163+0000 7f43faffd640 1 -- 172.21.15.62:0/1454159211 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4404012680 con 0x7f440c0b99e0 2023-10-08T12:00:36.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.163+0000 7f4410c15640 1 -- 172.21.15.62:0/1454159211 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f440c1e3d20 con 0x7f440c0b99e0 2023-10-08T12:00:36.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.163+0000 7f4410c15640 1 -- 172.21.15.62:0/1454159211 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f440c04da80 con 0x7f440c0b99e0 2023-10-08T12:00:36.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.167+0000 7f43faffd640 1 -- 172.21.15.62:0/1454159211 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f440401b400 con 0x7f440c0b99e0 2023-10-08T12:00:36.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.167+0000 7f43faffd640 1 --2- 172.21.15.62:0/1454159211 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f43ec066470 0x7f43ec068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:36.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.167+0000 7f43faffd640 1 -- 172.21.15.62:0/1454159211 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4404084640 con 0x7f440c0b99e0 2023-10-08T12:00:36.172 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.167+0000 7f440a59c640 1 --2- 172.21.15.62:0/1454159211 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f43ec066470 0x7f43ec068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:36.172 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.167+0000 7f440a59c640 1 --2- 172.21.15.62:0/1454159211 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f43ec066470 0x7f43ec068930 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f43fc0af000 tx=0x7f43fc01b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:36.174 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.171+0000 7f43faffd640 1 -- 172.21.15.62:0/1454159211 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4404051ac0 con 0x7f440c0b99e0 2023-10-08T12:00:36.338 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.335+0000 7f4410c15640 1 -- 172.21.15.62:0/1454159211 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f440c0a0b00 con 0x7f440c0b99e0 2023-10-08T12:00:36.341 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.335+0000 7f43faffd640 1 -- 172.21.15.62:0/1454159211 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16481 (secure 0 0 0) 0x7f44040550e0 con 0x7f440c0b99e0 2023-10-08T12:00:36.341 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T12:00:36.341 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":20,"fsid":"3e777930-c2c1-4f2b-a903-c07ee4ca2c52","created":"2023-10-08T11:59:54.510229+0000","modified":"2023-10-08T12:00:21.580704+0000","last_up_change":"2023-10-08T12:00:06.783998+0000","last_in_change":"2023-10-08T11:59:57.847944+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:00:07.189433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:00:17.895548+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T12:00:18.871217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7bc3070a-7240-43d9-9ec3-397b68a37e2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6820","nonce":2227876905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6824","nonce":2227876905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6831","nonce":2227876905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6828","nonce":2227876905}]},"public_addr":"172.21.15.62:6820/2227876905","cluster_addr":"172.21.15.62:6824/2227876905","heartbeat_back_addr":"172.21.15.62:6831/2227876905","heartbeat_front_addr":"172.21.15.62:6828/2227876905","state":["exists","up"]},{"osd":1,"uuid":"5e0fa1f5-9ddc-4882-b460-5578bb571003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6801","nonce":315660906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6803","nonce":315660906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6808","nonce":315660906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6805","nonce":315660906}]},"public_addr":"172.21.15.62:6801/315660906","cluster_addr":"172.21.15.62:6803/315660906","heartbeat_back_addr":"172.21.15.62:6808/315660906","heartbeat_front_addr":"172.21.15.62:6805/315660906","state":["exists","up"]},{"osd":2,"uuid":"262b5ee9-4243-4309-a14f-88ad4e8bf812","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6807","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6809","nonce":3784842938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6811","nonce":3784842938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6815","nonce":3784842938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6813","nonce":3784842938}]},"public_addr":"172.21.15.62:6809/3784842938","cluster_addr":"172.21.15.62:6811/3784842938","heartbeat_back_addr":"172.21.15.62:6815/3784842938","heartbeat_front_addr":"172.21.15.62:6813/3784842938","state":["exists","up"]},{"osd":3,"uuid":"1770bdb8-c12b-43b1-aaab-1d6b6fd18f4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6817","nonce":3385303160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6821","nonce":3385303160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6827","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6829","nonce":3385303160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6823","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6825","nonce":3385303160}]},"public_addr":"172.21.15.62:6817/3385303160","cluster_addr":"172.21.15.62:6821/3385303160","heartbeat_back_addr":"172.21.15.62:6829/3385303160","heartbeat_front_addr":"172.21.15.62:6825/3385303160","state":["exists","up"]},{"osd":4,"uuid":"74c73631-9351-494a-8246-28ee86e9f862","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6807","nonce":1174056987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6809","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6811","nonce":1174056987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6820","nonce":1174056987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6813","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6816","nonce":1174056987}]},"public_addr":"172.21.15.130:6807/1174056987","cluster_addr":"172.21.15.130:6811/1174056987","heartbeat_back_addr":"172.21.15.130:6820/1174056987","heartbeat_front_addr":"172.21.15.130:6816/1174056987","state":["exists","up"]},{"osd":5,"uuid":"1040f389-272c-41d6-ae76-70c04d09afa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6801","nonce":561928414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6803","nonce":561928414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6815","nonce":561928414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6808","nonce":561928414}]},"public_addr":"172.21.15.130:6801/561928414","cluster_addr":"172.21.15.130:6803/561928414","heartbeat_back_addr":"172.21.15.130:6815/561928414","heartbeat_front_addr":"172.21.15.130:6808/561928414","state":["exists","up"]},{"osd":6,"uuid":"178553eb-03e1-4ab8-9826-4f5997e6da0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6810","nonce":2877303015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6817","nonce":2877303015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6823","nonce":2877303015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6819","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6821","nonce":2877303015}]},"public_addr":"172.21.15.130:6810/2877303015","cluster_addr":"172.21.15.130:6817/2877303015","heartbeat_back_addr":"172.21.15.130:6823/2877303015","heartbeat_front_addr":"172.21.15.130:6821/2877303015","state":["exists","up"]},{"osd":7,"uuid":"b6581c8f-30b1-4dfd-b7b6-94b579128835","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6825","nonce":680009774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6827","nonce":680009774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6831","nonce":680009774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6829","nonce":680009774}]},"public_addr":"172.21.15.130:6825/680009774","cluster_addr":"172.21.15.130:6827/680009774","heartbeat_back_addr":"172.21.15.130:6831/680009774","heartbeat_front_addr":"172.21.15.130:6829/680009774","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.505543+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.394383+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.456652+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.529168+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.235414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.392158+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.347556+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.432039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:00:36.343 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.339+0000 7f4410c15640 1 -- 172.21.15.62:0/1454159211 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f43ec066470 msgr2=0x7f43ec068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:36.343 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.339+0000 7f4410c15640 1 --2- 172.21.15.62:0/1454159211 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f43ec066470 0x7f43ec068930 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f43fc0af000 tx=0x7f43fc01b040 comp rx=0 tx=0).stop 2023-10-08T12:00:36.343 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.339+0000 7f4410c15640 1 -- 172.21.15.62:0/1454159211 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f440c0b99e0 msgr2=0x7f440c1e03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:36.343 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.339+0000 7f4410c15640 1 --2- 172.21.15.62:0/1454159211 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f440c0b99e0 0x7f440c1e03c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f440400cbf0 tx=0x7f440400cce0 comp rx=0 tx=0).stop 2023-10-08T12:00:36.343 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.339+0000 7f4410c15640 1 -- 172.21.15.62:0/1454159211 shutdown_connections 2023-10-08T12:00:36.344 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.339+0000 7f4410c15640 1 --2- 172.21.15.62:0/1454159211 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f43ec066470 0x7f43ec068930 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:36.344 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.339+0000 7f4410c15640 1 --2- 172.21.15.62:0/1454159211 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f440c0b5c20 0x7f440c0b3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:36.344 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.339+0000 7f4410c15640 1 --2- 172.21.15.62:0/1454159211 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f440c0b99e0 0x7f440c1e03c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:36.344 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.339+0000 7f4410c15640 1 --2- 172.21.15.62:0/1454159211 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f440c0b5170 0x7f440c143a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:36.344 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.339+0000 7f4410c15640 1 -- 172.21.15.62:0/1454159211 >> 172.21.15.62:0/1454159211 conn(0x7f440c09c520 msgr2=0x7f440c09b940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:36.345 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.339+0000 7f4410c15640 1 -- 172.21.15.62:0/1454159211 shutdown_connections 2023-10-08T12:00:36.345 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.339+0000 7f4410c15640 1 -- 172.21.15.62:0/1454159211 wait complete. 2023-10-08T12:00:36.360 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T12:00:07.189433+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T12:00:17.895548+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T12:00:18.871217+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T12:00:36.361 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T12:00:36.500 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.495+0000 7ff168420640 1 -- 172.21.15.62:0/1651075363 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff14c0039b0 msgr2=0x7ff14c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:36.501 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.495+0000 7ff168420640 1 --2- 172.21.15.62:0/1651075363 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff14c0039b0 0x7ff14c003d90 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff15c006f80 tx=0x7ff15c01cf60 comp rx=0 tx=0).stop 2023-10-08T12:00:36.501 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.495+0000 7ff1669bd640 1 -- 172.21.15.62:0/1651075363 reap_dead start 2023-10-08T12:00:36.501 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.495+0000 7ff168420640 1 -- 172.21.15.62:0/1651075363 shutdown_connections 2023-10-08T12:00:36.501 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.495+0000 7ff168420640 1 -- 172.21.15.62:0/1651075363 >> 172.21.15.62:0/1651075363 conn(0x7ff1600bb370 msgr2=0x7ff1600bb780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:36.501 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.495+0000 7ff168420640 1 -- 172.21.15.62:0/1651075363 shutdown_connections 2023-10-08T12:00:36.501 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.495+0000 7ff168420640 1 -- 172.21.15.62:0/1651075363 wait complete. 2023-10-08T12:00:36.502 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.499+0000 7ff168420640 1 Processor -- start 2023-10-08T12:00:36.502 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.499+0000 7ff168420640 1 -- start start 2023-10-08T12:00:36.503 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.499+0000 7ff168420640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff14c0039b0 0x7ff16014bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:36.504 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.499+0000 7ff168420640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff160140e80 0x7ff1601e2e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:36.504 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.499+0000 7ff168420640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff1601e3390 0x7ff160138840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:36.504 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.499+0000 7ff168420640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1601e0240 con 0x7ff160140e80 2023-10-08T12:00:36.504 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.499+0000 7ff168420640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1601df290 con 0x7ff14c0039b0 2023-10-08T12:00:36.504 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.499+0000 7ff168420640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff16014c070 con 0x7ff1601e3390 2023-10-08T12:00:36.504 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.499+0000 7ff1659bb640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff160140e80 0x7ff1601e2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:36.504 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.499+0000 7ff1659bb640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff160140e80 0x7ff1601e2e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43484/0 (socket says 172.21.15.62:43484) 2023-10-08T12:00:36.504 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.499+0000 7ff1659bb640 1 -- 172.21.15.62:0/679115728 learned_addr learned my addr 172.21.15.62:0/679115728 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:36.504 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.499+0000 7ff1661bc640 1 --2- 172.21.15.62:0/679115728 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff14c0039b0 0x7ff16014bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:36.504 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.499+0000 7ff1669bd640 1 --2- 172.21.15.62:0/679115728 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff1601e3390 0x7ff160138840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:36.505 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.499+0000 7ff1659bb640 1 -- 172.21.15.62:0/679115728 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff1601e3390 msgr2=0x7ff160138840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:36.505 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.499+0000 7ff1659bb640 1 --2- 172.21.15.62:0/679115728 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff1601e3390 0x7ff160138840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:36.505 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.499+0000 7ff1659bb640 1 -- 172.21.15.62:0/679115728 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff14c0039b0 msgr2=0x7ff16014bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:36.505 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.499+0000 7ff1659bb640 1 --2- 172.21.15.62:0/679115728 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff14c0039b0 0x7ff16014bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:36.505 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.499+0000 7ff1659bb640 1 -- 172.21.15.62:0/679115728 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff160141310 con 0x7ff160140e80 2023-10-08T12:00:36.505 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.499+0000 7ff1669bd640 1 --2- 172.21.15.62:0/679115728 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff1601e3390 0x7ff160138840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:00:36.505 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.499+0000 7ff1659bb640 1 --2- 172.21.15.62:0/679115728 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff160140e80 0x7ff1601e2e50 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff154011b10 tx=0x7ff154009ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:36.505 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.499+0000 7ff152ffd640 1 -- 172.21.15.62:0/679115728 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff15400fea0 con 0x7ff160140e80 2023-10-08T12:00:36.506 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.499+0000 7ff152ffd640 1 -- 172.21.15.62:0/679115728 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff154004050 con 0x7ff160140e80 2023-10-08T12:00:36.506 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.499+0000 7ff152ffd640 1 -- 172.21.15.62:0/679115728 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff154004460 con 0x7ff160140e80 2023-10-08T12:00:36.506 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.499+0000 7ff168420640 1 -- 172.21.15.62:0/679115728 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1601415f0 con 0x7ff160140e80 2023-10-08T12:00:36.506 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.499+0000 7ff168420640 1 -- 172.21.15.62:0/679115728 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1600b3890 con 0x7ff160140e80 2023-10-08T12:00:36.507 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.499+0000 7ff168420640 1 -- 172.21.15.62:0/679115728 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1601e2790 con 0x7ff160140e80 2023-10-08T12:00:36.507 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.499+0000 7ff152ffd640 1 -- 172.21.15.62:0/679115728 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff154003600 con 0x7ff160140e80 2023-10-08T12:00:36.507 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.503+0000 7ff152ffd640 1 --2- 172.21.15.62:0/679115728 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7ff144066470 0x7ff144068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:36.508 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.503+0000 7ff152ffd640 1 -- 172.21.15.62:0/679115728 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff154084b80 con 0x7ff160140e80 2023-10-08T12:00:36.508 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.503+0000 7ff1661bc640 1 --2- 172.21.15.62:0/679115728 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7ff144066470 0x7ff144068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:36.508 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.503+0000 7ff1661bc640 1 --2- 172.21.15.62:0/679115728 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7ff144066470 0x7ff144068930 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff15c0ac000 tx=0x7ff15c019d00 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:36.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.507+0000 7ff152ffd640 1 -- 172.21.15.62:0/679115728 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff1601e2790 con 0x7ff160140e80 2023-10-08T12:00:36.670 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.667+0000 7ff168420640 1 -- 172.21.15.62:0/679115728 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff1601e2790 con 0x7ff160140e80 2023-10-08T12:00:36.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.667+0000 7ff152ffd640 1 -- 172.21.15.62:0/679115728 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff1601e2790 con 0x7ff160140e80 2023-10-08T12:00:36.671 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2023-10-08T12:00:36.673 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.667+0000 7ff168420640 1 -- 172.21.15.62:0/679115728 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7ff144066470 msgr2=0x7ff144068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:36.673 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.667+0000 7ff168420640 1 --2- 172.21.15.62:0/679115728 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7ff144066470 0x7ff144068930 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff15c0ac000 tx=0x7ff15c019d00 comp rx=0 tx=0).stop 2023-10-08T12:00:36.673 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.667+0000 7ff168420640 1 -- 172.21.15.62:0/679115728 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff160140e80 msgr2=0x7ff1601e2e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:36.673 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.667+0000 7ff168420640 1 --2- 172.21.15.62:0/679115728 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff160140e80 0x7ff1601e2e50 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff154011b10 tx=0x7ff154009ea0 comp rx=0 tx=0).stop 2023-10-08T12:00:36.674 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.667+0000 7ff168420640 1 -- 172.21.15.62:0/679115728 shutdown_connections 2023-10-08T12:00:36.674 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.667+0000 7ff168420640 1 --2- 172.21.15.62:0/679115728 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7ff144066470 0x7ff144068930 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:36.674 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.667+0000 7ff168420640 1 --2- 172.21.15.62:0/679115728 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff1601e3390 0x7ff160138840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:36.674 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.667+0000 7ff168420640 1 --2- 172.21.15.62:0/679115728 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff160140e80 0x7ff1601e2e50 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:36.674 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.667+0000 7ff168420640 1 --2- 172.21.15.62:0/679115728 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff14c0039b0 0x7ff16014bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:36.674 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.667+0000 7ff168420640 1 -- 172.21.15.62:0/679115728 >> 172.21.15.62:0/679115728 conn(0x7ff1600bb370 msgr2=0x7ff16013bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:36.674 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.667+0000 7ff168420640 1 -- 172.21.15.62:0/679115728 shutdown_connections 2023-10-08T12:00:36.674 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.667+0000 7ff168420640 1 -- 172.21.15.62:0/679115728 wait complete. 2023-10-08T12:00:36.690 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T12:00:36.823 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.819+0000 7fd382e42640 1 -- 172.21.15.62:0/3787543603 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd37c0b7090 msgr2=0x7fd37c065780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:36.823 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.819+0000 7fd382e42640 1 --2- 172.21.15.62:0/3787543603 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd37c0b7090 0x7fd37c065780 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd37c0bc0f0 tx=0x7fd36c01c850 comp rx=0 tx=0).stop 2023-10-08T12:00:36.823 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.819+0000 7fd382e42640 1 -- 172.21.15.62:0/3787543603 shutdown_connections 2023-10-08T12:00:36.823 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.819+0000 7fd382e42640 1 --2- 172.21.15.62:0/3787543603 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd37c0b0fe0 0x7fd37c0b1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:36.823 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.819+0000 7fd382e42640 1 --2- 172.21.15.62:0/3787543603 >> v2:172.21.15.130:3300/0 conn(0x7fd37c0b7470 0x7fd37c0b0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:36.823 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.819+0000 7fd382e42640 1 --2- 172.21.15.62:0/3787543603 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd37c0b7090 0x7fd37c065780 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:36.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.819+0000 7fd382e42640 1 -- 172.21.15.62:0/3787543603 >> 172.21.15.62:0/3787543603 conn(0x7fd37c0bb030 msgr2=0x7fd37c0bb440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:36.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.819+0000 7fd382e42640 1 -- 172.21.15.62:0/3787543603 shutdown_connections 2023-10-08T12:00:36.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.819+0000 7fd382e42640 1 -- 172.21.15.62:0/3787543603 wait complete. 2023-10-08T12:00:36.826 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.819+0000 7fd382e42640 1 Processor -- start 2023-10-08T12:00:36.826 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.819+0000 7fd382e42640 1 -- start start 2023-10-08T12:00:36.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.819+0000 7fd382e42640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd37c0b0fe0 0x7fd37c1e53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:36.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.819+0000 7fd382e42640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd37c0b7090 0x7fd37c06b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:36.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.819+0000 7fd382e42640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd37c0b7470 0x7fd37c1e2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:36.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.819+0000 7fd382e42640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd37c06b900 con 0x7fd37c0b7470 2023-10-08T12:00:36.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.819+0000 7fd382e42640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd37c1e59d0 con 0x7fd37c0b0fe0 2023-10-08T12:00:36.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.819+0000 7fd382e42640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd37c1e5cb0 con 0x7fd37c0b7090 2023-10-08T12:00:36.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.819+0000 7fd3813df640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd37c0b7470 0x7fd37c1e2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:36.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.819+0000 7fd3813df640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd37c0b7470 0x7fd37c1e2110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43506/0 (socket says 172.21.15.62:43506) 2023-10-08T12:00:36.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.819+0000 7fd3813df640 1 -- 172.21.15.62:0/2064464890 learned_addr learned my addr 172.21.15.62:0/2064464890 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:36.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.819+0000 7fd37bfff640 1 --2- 172.21.15.62:0/2064464890 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd37c0b7090 0x7fd37c06b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:36.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.819+0000 7fd380bde640 1 --2- 172.21.15.62:0/2064464890 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd37c0b0fe0 0x7fd37c1e53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:36.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.819+0000 7fd3813df640 1 -- 172.21.15.62:0/2064464890 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd37c0b7090 msgr2=0x7fd37c06b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:36.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.819+0000 7fd3813df640 1 --2- 172.21.15.62:0/2064464890 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd37c0b7090 0x7fd37c06b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:36.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.819+0000 7fd3813df640 1 -- 172.21.15.62:0/2064464890 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd37c0b0fe0 msgr2=0x7fd37c1e53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:36.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.819+0000 7fd3813df640 1 --2- 172.21.15.62:0/2064464890 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd37c0b0fe0 0x7fd37c1e53b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:36.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.819+0000 7fd3813df640 1 -- 172.21.15.62:0/2064464890 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd36c009560 con 0x7fd37c0b7470 2023-10-08T12:00:36.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.819+0000 7fd380bde640 1 --2- 172.21.15.62:0/2064464890 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd37c0b0fe0 0x7fd37c1e53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:00:36.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.819+0000 7fd3813df640 1 --2- 172.21.15.62:0/2064464890 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd37c0b7470 0x7fd37c1e2110 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd37400ccb0 tx=0x7fd37400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:36.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.819+0000 7fd3797fa640 1 -- 172.21.15.62:0/2064464890 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd374004b30 con 0x7fd37c0b7470 2023-10-08T12:00:36.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.819+0000 7fd3797fa640 1 -- 172.21.15.62:0/2064464890 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd374004da0 con 0x7fd37c0b7470 2023-10-08T12:00:36.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.819+0000 7fd382e42640 1 -- 172.21.15.62:0/2064464890 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd37c1e5f90 con 0x7fd37c0b7470 2023-10-08T12:00:36.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.819+0000 7fd3797fa640 1 -- 172.21.15.62:0/2064464890 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd374005280 con 0x7fd37c0b7470 2023-10-08T12:00:36.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.819+0000 7fd382e42640 1 -- 172.21.15.62:0/2064464890 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd37c06bdb0 con 0x7fd37c0b7470 2023-10-08T12:00:36.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.823+0000 7fd382e42640 1 -- 172.21.15.62:0/2064464890 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd37c1e1e30 con 0x7fd37c0b7470 2023-10-08T12:00:36.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.823+0000 7fd3797fa640 1 -- 172.21.15.62:0/2064464890 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd3740053e0 con 0x7fd37c0b7470 2023-10-08T12:00:36.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.823+0000 7fd3797fa640 1 --2- 172.21.15.62:0/2064464890 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fd368066470 0x7fd368068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:36.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.823+0000 7fd3797fa640 1 -- 172.21.15.62:0/2064464890 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd3740846d0 con 0x7fd37c0b7470 2023-10-08T12:00:36.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.823+0000 7fd380bde640 1 --2- 172.21.15.62:0/2064464890 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fd368066470 0x7fd368068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:36.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.823+0000 7fd380bde640 1 --2- 172.21.15.62:0/2064464890 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fd368066470 0x7fd368068930 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd36c0af000 tx=0x7fd36c01b090 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:36.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.827+0000 7fd3797fa640 1 -- 172.21.15.62:0/2064464890 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd37c1e1e30 con 0x7fd37c0b7470 2023-10-08T12:00:36.984 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.979+0000 7fd382e42640 1 -- 172.21.15.62:0/2064464890 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd37c1e1e30 con 0x7fd37c0b7470 2023-10-08T12:00:36.985 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.979+0000 7fd3797fa640 1 -- 172.21.15.62:0/2064464890 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd37401d020 con 0x7fd37c0b7470 2023-10-08T12:00:36.985 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-10-08T12:00:36.987 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.983+0000 7fd382e42640 1 -- 172.21.15.62:0/2064464890 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fd368066470 msgr2=0x7fd368068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:36.987 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.983+0000 7fd382e42640 1 --2- 172.21.15.62:0/2064464890 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fd368066470 0x7fd368068930 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd36c0af000 tx=0x7fd36c01b090 comp rx=0 tx=0).stop 2023-10-08T12:00:36.987 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.983+0000 7fd382e42640 1 -- 172.21.15.62:0/2064464890 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd37c0b7470 msgr2=0x7fd37c1e2110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:36.988 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.983+0000 7fd382e42640 1 --2- 172.21.15.62:0/2064464890 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd37c0b7470 0x7fd37c1e2110 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd37400ccb0 tx=0x7fd37400a620 comp rx=0 tx=0).stop 2023-10-08T12:00:36.988 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.983+0000 7fd382e42640 1 -- 172.21.15.62:0/2064464890 shutdown_connections 2023-10-08T12:00:36.988 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.983+0000 7fd382e42640 1 --2- 172.21.15.62:0/2064464890 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fd368066470 0x7fd368068930 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:36.988 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.983+0000 7fd382e42640 1 --2- 172.21.15.62:0/2064464890 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd37c0b7090 0x7fd37c06b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:36.988 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.983+0000 7fd382e42640 1 --2- 172.21.15.62:0/2064464890 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd37c0b7470 0x7fd37c1e2110 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:36.988 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.983+0000 7fd382e42640 1 --2- 172.21.15.62:0/2064464890 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd37c0b0fe0 0x7fd37c1e53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:36.988 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.983+0000 7fd382e42640 1 -- 172.21.15.62:0/2064464890 >> 172.21.15.62:0/2064464890 conn(0x7fd37c0bb030 msgr2=0x7fd37c144100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:36.988 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.983+0000 7fd382e42640 1 -- 172.21.15.62:0/2064464890 shutdown_connections 2023-10-08T12:00:36.988 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:36.983+0000 7fd382e42640 1 -- 172.21.15.62:0/2064464890 wait complete. 2023-10-08T12:00:37.004 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T12:00:37.139 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.135+0000 7fe4c7e2d640 1 -- 172.21.15.62:0/1429433467 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4ac0042e0 msgr2=0x7fe4ac0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:37.140 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.135+0000 7fe4c7e2d640 1 --2- 172.21.15.62:0/1429433467 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4ac0042e0 0x7fe4ac0047d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe4b0009b60 tx=0x7fe4b001d250 comp rx=0 tx=0).stop 2023-10-08T12:00:37.140 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.135+0000 7fe4c63ca640 1 -- 172.21.15.62:0/1429433467 reap_dead start 2023-10-08T12:00:37.140 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.135+0000 7fe4c7e2d640 1 -- 172.21.15.62:0/1429433467 shutdown_connections 2023-10-08T12:00:37.140 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.135+0000 7fe4c7e2d640 1 -- 172.21.15.62:0/1429433467 >> 172.21.15.62:0/1429433467 conn(0x7fe4c009d610 msgr2=0x7fe4c009da20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:37.140 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.135+0000 7fe4c7e2d640 1 -- 172.21.15.62:0/1429433467 shutdown_connections 2023-10-08T12:00:37.140 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.135+0000 7fe4c7e2d640 1 -- 172.21.15.62:0/1429433467 wait complete. 2023-10-08T12:00:37.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.135+0000 7fe4c7e2d640 1 Processor -- start 2023-10-08T12:00:37.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.135+0000 7fe4c7e2d640 1 -- start start 2023-10-08T12:00:37.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.135+0000 7fe4c7e2d640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe4ac0042e0 0x7fe4c00b4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:37.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.135+0000 7fe4c7e2d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe4c00b3170 0x7fe4c00a0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:37.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.135+0000 7fe4c7e2d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4c00a0560 0x7fe4c01478b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:37.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.135+0000 7fe4c7e2d640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c009af50 con 0x7fe4c00a0560 2023-10-08T12:00:37.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.135+0000 7fe4c7e2d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c00b4e60 con 0x7fe4c00b3170 2023-10-08T12:00:37.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.135+0000 7fe4c7e2d640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c009fb90 con 0x7fe4ac0042e0 2023-10-08T12:00:37.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.135+0000 7fe4c63ca640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4c00a0560 0x7fe4c01478b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:37.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.135+0000 7fe4c63ca640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4c00a0560 0x7fe4c01478b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43524/0 (socket says 172.21.15.62:43524) 2023-10-08T12:00:37.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.135+0000 7fe4c63ca640 1 -- 172.21.15.62:0/214020684 learned_addr learned my addr 172.21.15.62:0/214020684 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:37.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.135+0000 7fe4c53c8640 1 --2- 172.21.15.62:0/214020684 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe4c00b3170 0x7fe4c00a0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:37.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.135+0000 7fe4c5bc9640 1 --2- 172.21.15.62:0/214020684 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe4ac0042e0 0x7fe4c00b4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:37.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.139+0000 7fe4c63ca640 1 -- 172.21.15.62:0/214020684 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe4ac0042e0 msgr2=0x7fe4c00b4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:37.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.139+0000 7fe4c63ca640 1 --2- 172.21.15.62:0/214020684 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe4ac0042e0 0x7fe4c00b4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:37.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.139+0000 7fe4c63ca640 1 -- 172.21.15.62:0/214020684 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe4c00b3170 msgr2=0x7fe4c00a0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:37.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.139+0000 7fe4c63ca640 1 --2- 172.21.15.62:0/214020684 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe4c00b3170 0x7fe4c00a0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:37.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.139+0000 7fe4c63ca640 1 -- 172.21.15.62:0/214020684 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4c00a09e0 con 0x7fe4c00a0560 2023-10-08T12:00:37.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.139+0000 7fe4c63ca640 1 --2- 172.21.15.62:0/214020684 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4c00a0560 0x7fe4c01478b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe4c014b420 tx=0x7fe4b800eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:37.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.139+0000 7fe4b67fc640 1 -- 172.21.15.62:0/214020684 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b8004d30 con 0x7fe4c00a0560 2023-10-08T12:00:37.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.139+0000 7fe4b67fc640 1 -- 172.21.15.62:0/214020684 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe4b800cad0 con 0x7fe4c00a0560 2023-10-08T12:00:37.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.139+0000 7fe4c7e2d640 1 -- 172.21.15.62:0/214020684 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4c00b36c0 con 0x7fe4c00a0560 2023-10-08T12:00:37.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.139+0000 7fe4b67fc640 1 -- 172.21.15.62:0/214020684 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b800cee0 con 0x7fe4c00a0560 2023-10-08T12:00:37.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.139+0000 7fe4c7e2d640 1 -- 172.21.15.62:0/214020684 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4c00b3c80 con 0x7fe4c00a0560 2023-10-08T12:00:37.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.139+0000 7fe4c7e2d640 1 -- 172.21.15.62:0/214020684 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4c009fd20 con 0x7fe4c00a0560 2023-10-08T12:00:37.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.139+0000 7fe4b67fc640 1 -- 172.21.15.62:0/214020684 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe4b8010430 con 0x7fe4c00a0560 2023-10-08T12:00:37.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.139+0000 7fe4b67fc640 1 --2- 172.21.15.62:0/214020684 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fe4a40664a0 0x7fe4a4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:37.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.139+0000 7fe4b67fc640 1 -- 172.21.15.62:0/214020684 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe4b8014070 con 0x7fe4c00a0560 2023-10-08T12:00:37.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.139+0000 7fe4c5bc9640 1 --2- 172.21.15.62:0/214020684 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fe4a40664a0 0x7fe4a4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:37.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.139+0000 7fe4c5bc9640 1 --2- 172.21.15.62:0/214020684 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fe4a40664a0 0x7fe4a4068960 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc000f70 tx=0x7fe4bc001520 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:37.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.143+0000 7fe4b67fc640 1 -- 172.21.15.62:0/214020684 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe4b80515f0 con 0x7fe4c00a0560 2023-10-08T12:00:37.306 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.303+0000 7fe4c7e2d640 1 -- 172.21.15.62:0/214020684 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe4c004da80 con 0x7fe4c00a0560 2023-10-08T12:00:37.307 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.303+0000 7fe4b67fc640 1 -- 172.21.15.62:0/214020684 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe4b8054c10 con 0x7fe4c00a0560 2023-10-08T12:00:37.307 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 64 2023-10-08T12:00:37.310 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.303+0000 7fe4c7e2d640 1 -- 172.21.15.62:0/214020684 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fe4a40664a0 msgr2=0x7fe4a4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:37.310 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.303+0000 7fe4c7e2d640 1 --2- 172.21.15.62:0/214020684 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fe4a40664a0 0x7fe4a4068960 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc000f70 tx=0x7fe4bc001520 comp rx=0 tx=0).stop 2023-10-08T12:00:37.310 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.303+0000 7fe4c7e2d640 1 -- 172.21.15.62:0/214020684 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4c00a0560 msgr2=0x7fe4c01478b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:37.310 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.303+0000 7fe4c7e2d640 1 --2- 172.21.15.62:0/214020684 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4c00a0560 0x7fe4c01478b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe4c014b420 tx=0x7fe4b800eec0 comp rx=0 tx=0).stop 2023-10-08T12:00:37.310 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.307+0000 7fe4c7e2d640 1 -- 172.21.15.62:0/214020684 shutdown_connections 2023-10-08T12:00:37.310 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.307+0000 7fe4c7e2d640 1 --2- 172.21.15.62:0/214020684 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fe4a40664a0 0x7fe4a4068960 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:37.310 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.307+0000 7fe4c7e2d640 1 --2- 172.21.15.62:0/214020684 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4c00a0560 0x7fe4c01478b0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:37.310 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.307+0000 7fe4c7e2d640 1 --2- 172.21.15.62:0/214020684 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe4c00b3170 0x7fe4c00a0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:37.310 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.307+0000 7fe4c7e2d640 1 --2- 172.21.15.62:0/214020684 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe4ac0042e0 0x7fe4c00b4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:37.311 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.307+0000 7fe4c7e2d640 1 -- 172.21.15.62:0/214020684 >> 172.21.15.62:0/214020684 conn(0x7fe4c009d610 msgr2=0x7fe4c00b82d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:37.311 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.307+0000 7fe4c7e2d640 1 -- 172.21.15.62:0/214020684 shutdown_connections 2023-10-08T12:00:37.311 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.307+0000 7fe4c7e2d640 1 -- 172.21.15.62:0/214020684 wait complete. 2023-10-08T12:00:37.327 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:00:37.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.443+0000 7f78545ec640 1 -- 172.21.15.62:0/2424319629 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f784c14b060 msgr2=0x7f784c151890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:37.448 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.443+0000 7f78545ec640 1 --2- 172.21.15.62:0/2424319629 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f784c14b060 0x7f784c151890 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7844009bc0 tx=0x7f784401caf0 comp rx=0 tx=0).stop 2023-10-08T12:00:37.448 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.443+0000 7f78545ec640 1 -- 172.21.15.62:0/2424319629 shutdown_connections 2023-10-08T12:00:37.448 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.443+0000 7f78545ec640 1 --2- 172.21.15.62:0/2424319629 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f784c14b060 0x7f784c151890 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:37.448 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.443+0000 7f78545ec640 1 --2- 172.21.15.62:0/2424319629 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f784c0b0a10 0x7f784c14ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:37.448 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.443+0000 7f78545ec640 1 -- 172.21.15.62:0/2424319629 >> 172.21.15.62:0/2424319629 conn(0x7f784c0b82f0 msgr2=0x7f784c0b8700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:37.448 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.443+0000 7f78545ec640 1 -- 172.21.15.62:0/2424319629 shutdown_connections 2023-10-08T12:00:37.448 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.443+0000 7f78545ec640 1 -- 172.21.15.62:0/2424319629 wait complete. 2023-10-08T12:00:37.450 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.443+0000 7f78545ec640 1 Processor -- start 2023-10-08T12:00:37.450 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.443+0000 7f78545ec640 1 -- start start 2023-10-08T12:00:37.450 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.443+0000 7f78545ec640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f784c0699f0 0x7f784c1436a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:37.450 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.443+0000 7f78545ec640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f784c0b0a10 0x7f784c098470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:37.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.443+0000 7f78545ec640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f784c14b060 0x7f784c0991d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:37.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.443+0000 7f78545ec640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f784c09a920 con 0x7f784c14b060 2023-10-08T12:00:37.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.443+0000 7f78545ec640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f784c143be0 con 0x7f784c0b0a10 2023-10-08T12:00:37.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.443+0000 7f78545ec640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f784c09a0c0 con 0x7f784c0699f0 2023-10-08T12:00:37.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.443+0000 7f7852b89640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f784c14b060 0x7f784c0991d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:37.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.443+0000 7f7852b89640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f784c14b060 0x7f784c0991d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43530/0 (socket says 172.21.15.62:43530) 2023-10-08T12:00:37.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.443+0000 7f7852b89640 1 -- 172.21.15.62:0/2330129634 learned_addr learned my addr 172.21.15.62:0/2330129634 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:37.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.447+0000 7f7852388640 1 --2- 172.21.15.62:0/2330129634 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f784c0699f0 0x7f784c1436a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:37.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.447+0000 7f7851b87640 1 --2- 172.21.15.62:0/2330129634 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f784c0b0a10 0x7f784c098470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:37.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.447+0000 7f7852b89640 1 -- 172.21.15.62:0/2330129634 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f784c0699f0 msgr2=0x7f784c1436a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:37.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.447+0000 7f7852b89640 1 --2- 172.21.15.62:0/2330129634 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f784c0699f0 0x7f784c1436a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:37.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.447+0000 7f7852b89640 1 -- 172.21.15.62:0/2330129634 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f784c0b0a10 msgr2=0x7f784c098470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:37.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.447+0000 7f7852b89640 1 --2- 172.21.15.62:0/2330129634 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f784c0b0a10 0x7f784c098470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:37.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.447+0000 7f7852b89640 1 -- 172.21.15.62:0/2330129634 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f783c0094a0 con 0x7f784c14b060 2023-10-08T12:00:37.452 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.447+0000 7f7851b87640 1 --2- 172.21.15.62:0/2330129634 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f784c0b0a10 0x7f784c098470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:00:37.452 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.447+0000 7f7852388640 1 --2- 172.21.15.62:0/2330129634 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f784c0699f0 0x7f784c1436a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:00:37.452 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.447+0000 7f7852b89640 1 --2- 172.21.15.62:0/2330129634 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f784c14b060 0x7f784c0991d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f784401a720 tx=0x7f7844009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:37.452 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.447+0000 7f7842ffd640 1 -- 172.21.15.62:0/2330129634 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7844004c50 con 0x7f784c14b060 2023-10-08T12:00:37.452 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.447+0000 7f7842ffd640 1 -- 172.21.15.62:0/2330129634 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7844004db0 con 0x7f784c14b060 2023-10-08T12:00:37.452 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.447+0000 7f78545ec640 1 -- 172.21.15.62:0/2330129634 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7844009820 con 0x7f784c14b060 2023-10-08T12:00:37.452 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.447+0000 7f7842ffd640 1 -- 172.21.15.62:0/2330129634 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7844004260 con 0x7f784c14b060 2023-10-08T12:00:37.452 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.447+0000 7f78545ec640 1 -- 172.21.15.62:0/2330129634 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f784c09a360 con 0x7f784c14b060 2023-10-08T12:00:37.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.447+0000 7f78545ec640 1 -- 172.21.15.62:0/2330129634 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f784c097df0 con 0x7f784c14b060 2023-10-08T12:00:37.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.447+0000 7f7842ffd640 1 -- 172.21.15.62:0/2330129634 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f78440b4040 con 0x7f784c14b060 2023-10-08T12:00:37.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.447+0000 7f7842ffd640 1 --2- 172.21.15.62:0/2330129634 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f78300664a0 0x7f7830068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:37.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.447+0000 7f7842ffd640 1 -- 172.21.15.62:0/2330129634 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f784411e640 con 0x7f784c14b060 2023-10-08T12:00:37.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.447+0000 7f7852388640 1 --2- 172.21.15.62:0/2330129634 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f78300664a0 0x7f7830068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:37.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.447+0000 7f7852388640 1 --2- 172.21.15.62:0/2330129634 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f78300664a0 0x7f7830068960 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f78480046c0 tx=0x7f7848009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:37.456 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.451+0000 7f7842ffd640 1 -- 172.21.15.62:0/2330129634 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f784c097df0 con 0x7f784c14b060 2023-10-08T12:00:37.610 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.607+0000 7f78545ec640 1 -- 172.21.15.62:0/2330129634 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f784c097df0 con 0x7f784c14b060 2023-10-08T12:00:37.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.607+0000 7f7842ffd640 1 -- 172.21.15.62:0/2330129634 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16481 (secure 0 0 0) 0x7f784c097df0 con 0x7f784c14b060 2023-10-08T12:00:37.612 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T12:00:37.612 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":20,"fsid":"3e777930-c2c1-4f2b-a903-c07ee4ca2c52","created":"2023-10-08T11:59:54.510229+0000","modified":"2023-10-08T12:00:21.580704+0000","last_up_change":"2023-10-08T12:00:06.783998+0000","last_in_change":"2023-10-08T11:59:57.847944+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:00:07.189433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:00:17.895548+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T12:00:18.871217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7bc3070a-7240-43d9-9ec3-397b68a37e2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6820","nonce":2227876905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6824","nonce":2227876905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6831","nonce":2227876905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6828","nonce":2227876905}]},"public_addr":"172.21.15.62:6820/2227876905","cluster_addr":"172.21.15.62:6824/2227876905","heartbeat_back_addr":"172.21.15.62:6831/2227876905","heartbeat_front_addr":"172.21.15.62:6828/2227876905","state":["exists","up"]},{"osd":1,"uuid":"5e0fa1f5-9ddc-4882-b460-5578bb571003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6801","nonce":315660906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6803","nonce":315660906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6808","nonce":315660906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6805","nonce":315660906}]},"public_addr":"172.21.15.62:6801/315660906","cluster_addr":"172.21.15.62:6803/315660906","heartbeat_back_addr":"172.21.15.62:6808/315660906","heartbeat_front_addr":"172.21.15.62:6805/315660906","state":["exists","up"]},{"osd":2,"uuid":"262b5ee9-4243-4309-a14f-88ad4e8bf812","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6807","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6809","nonce":3784842938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6811","nonce":3784842938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6815","nonce":3784842938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6813","nonce":3784842938}]},"public_addr":"172.21.15.62:6809/3784842938","cluster_addr":"172.21.15.62:6811/3784842938","heartbeat_back_addr":"172.21.15.62:6815/3784842938","heartbeat_front_addr":"172.21.15.62:6813/3784842938","state":["exists","up"]},{"osd":3,"uuid":"1770bdb8-c12b-43b1-aaab-1d6b6fd18f4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6817","nonce":3385303160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6821","nonce":3385303160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6827","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6829","nonce":3385303160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6823","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6825","nonce":3385303160}]},"public_addr":"172.21.15.62:6817/3385303160","cluster_addr":"172.21.15.62:6821/3385303160","heartbeat_back_addr":"172.21.15.62:6829/3385303160","heartbeat_front_addr":"172.21.15.62:6825/3385303160","state":["exists","up"]},{"osd":4,"uuid":"74c73631-9351-494a-8246-28ee86e9f862","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6807","nonce":1174056987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6809","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6811","nonce":1174056987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6820","nonce":1174056987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6813","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6816","nonce":1174056987}]},"public_addr":"172.21.15.130:6807/1174056987","cluster_addr":"172.21.15.130:6811/1174056987","heartbeat_back_addr":"172.21.15.130:6820/1174056987","heartbeat_front_addr":"172.21.15.130:6816/1174056987","state":["exists","up"]},{"osd":5,"uuid":"1040f389-272c-41d6-ae76-70c04d09afa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6801","nonce":561928414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6803","nonce":561928414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6815","nonce":561928414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6808","nonce":561928414}]},"public_addr":"172.21.15.130:6801/561928414","cluster_addr":"172.21.15.130:6803/561928414","heartbeat_back_addr":"172.21.15.130:6815/561928414","heartbeat_front_addr":"172.21.15.130:6808/561928414","state":["exists","up"]},{"osd":6,"uuid":"178553eb-03e1-4ab8-9826-4f5997e6da0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6810","nonce":2877303015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6817","nonce":2877303015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6823","nonce":2877303015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6819","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6821","nonce":2877303015}]},"public_addr":"172.21.15.130:6810/2877303015","cluster_addr":"172.21.15.130:6817/2877303015","heartbeat_back_addr":"172.21.15.130:6823/2877303015","heartbeat_front_addr":"172.21.15.130:6821/2877303015","state":["exists","up"]},{"osd":7,"uuid":"b6581c8f-30b1-4dfd-b7b6-94b579128835","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6825","nonce":680009774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6827","nonce":680009774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6831","nonce":680009774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6829","nonce":680009774}]},"public_addr":"172.21.15.130:6825/680009774","cluster_addr":"172.21.15.130:6827/680009774","heartbeat_back_addr":"172.21.15.130:6831/680009774","heartbeat_front_addr":"172.21.15.130:6829/680009774","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.505543+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.394383+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.456652+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.529168+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.235414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.392158+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.347556+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.432039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:00:37.614 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.611+0000 7f78545ec640 1 -- 172.21.15.62:0/2330129634 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f78300664a0 msgr2=0x7f7830068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:37.614 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.611+0000 7f78545ec640 1 --2- 172.21.15.62:0/2330129634 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f78300664a0 0x7f7830068960 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f78480046c0 tx=0x7f7848009040 comp rx=0 tx=0).stop 2023-10-08T12:00:37.614 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.611+0000 7f78545ec640 1 -- 172.21.15.62:0/2330129634 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f784c14b060 msgr2=0x7f784c0991d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:37.614 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.611+0000 7f78545ec640 1 --2- 172.21.15.62:0/2330129634 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f784c14b060 0x7f784c0991d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f784401a720 tx=0x7f7844009260 comp rx=0 tx=0).stop 2023-10-08T12:00:37.614 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.611+0000 7f78545ec640 1 -- 172.21.15.62:0/2330129634 shutdown_connections 2023-10-08T12:00:37.615 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.611+0000 7f78545ec640 1 --2- 172.21.15.62:0/2330129634 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f78300664a0 0x7f7830068960 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:37.615 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.611+0000 7f78545ec640 1 --2- 172.21.15.62:0/2330129634 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f784c14b060 0x7f784c0991d0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:37.615 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.611+0000 7f78545ec640 1 --2- 172.21.15.62:0/2330129634 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f784c0b0a10 0x7f784c098470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:37.615 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.611+0000 7f78545ec640 1 --2- 172.21.15.62:0/2330129634 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f784c0699f0 0x7f784c1436a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:37.615 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.611+0000 7f78545ec640 1 -- 172.21.15.62:0/2330129634 >> 172.21.15.62:0/2330129634 conn(0x7f784c0b82f0 msgr2=0x7f784c09b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:37.615 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.611+0000 7f78545ec640 1 -- 172.21.15.62:0/2330129634 shutdown_connections 2023-10-08T12:00:37.615 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.611+0000 7f78545ec640 1 -- 172.21.15.62:0/2330129634 wait complete. 2023-10-08T12:00:37.630 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T12:00:07.189433+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T12:00:17.895548+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T12:00:18.871217+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T12:00:37.630 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T12:00:37.753 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.747+0000 7fcb0dfb7640 1 -- 172.21.15.62:0/4171620850 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcb0806b1c0 msgr2=0x7fcb080b5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:37.753 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.747+0000 7fcb0dfb7640 1 --2- 172.21.15.62:0/4171620850 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcb0806b1c0 0x7fcb080b5a70 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fcb08066910 tx=0x7fcaf801db00 comp rx=0 tx=0).stop 2023-10-08T12:00:37.753 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.747+0000 7fcb0dfb7640 1 -- 172.21.15.62:0/4171620850 shutdown_connections 2023-10-08T12:00:37.753 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.747+0000 7fcb0dfb7640 1 --2- 172.21.15.62:0/4171620850 >> v2:172.21.15.130:3300/0 conn(0x7fcb080b9900 0x7fcb0814fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:37.753 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.747+0000 7fcb0dfb7640 1 --2- 172.21.15.62:0/4171620850 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcb0806b1c0 0x7fcb080b5a70 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:37.753 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.747+0000 7fcb0dfb7640 1 -- 172.21.15.62:0/4171620850 >> 172.21.15.62:0/4171620850 conn(0x7fcb0809c520 msgr2=0x7fcb0809c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:37.754 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.747+0000 7fcb0dfb7640 1 -- 172.21.15.62:0/4171620850 shutdown_connections 2023-10-08T12:00:37.754 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.747+0000 7fcb0dfb7640 1 -- 172.21.15.62:0/4171620850 wait complete. 2023-10-08T12:00:37.756 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.751+0000 7fcb0dfb7640 1 Processor -- start 2023-10-08T12:00:37.756 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.751+0000 7fcb0dfb7640 1 -- start start 2023-10-08T12:00:37.756 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.751+0000 7fcb0dfb7640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcb0806b1c0 0x7fcb0806e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:37.756 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.751+0000 7fcb0dfb7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcb080b9900 0x7fcb0809e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:37.756 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.751+0000 7fcb0dfb7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcb080ba340 0x7fcb080a0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:37.756 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.751+0000 7fcb0dfb7640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb080a0b20 con 0x7fcb080ba340 2023-10-08T12:00:37.756 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.751+0000 7fcb0dfb7640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0809eeb0 con 0x7fcb080b9900 2023-10-08T12:00:37.756 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.751+0000 7fcb0dfb7640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb081e25c0 con 0x7fcb0806b1c0 2023-10-08T12:00:37.756 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.751+0000 7fcb07fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcb080ba340 0x7fcb080a0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:37.757 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.751+0000 7fcb07fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcb080ba340 0x7fcb080a0280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43548/0 (socket says 172.21.15.62:43548) 2023-10-08T12:00:37.757 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.751+0000 7fcb07fff640 1 -- 172.21.15.62:0/751798007 learned_addr learned my addr 172.21.15.62:0/751798007 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:37.757 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.751+0000 7fcb077fe640 1 --2- 172.21.15.62:0/751798007 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcb0806b1c0 0x7fcb0806e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:37.757 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.751+0000 7fcb06ffd640 1 --2- 172.21.15.62:0/751798007 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcb080b9900 0x7fcb0809e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:37.757 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.751+0000 7fcb07fff640 1 -- 172.21.15.62:0/751798007 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcb0806b1c0 msgr2=0x7fcb0806e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:37.757 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.751+0000 7fcb07fff640 1 --2- 172.21.15.62:0/751798007 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcb0806b1c0 0x7fcb0806e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:37.757 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.751+0000 7fcb07fff640 1 -- 172.21.15.62:0/751798007 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcb080b9900 msgr2=0x7fcb0809e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:37.757 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.751+0000 7fcb07fff640 1 --2- 172.21.15.62:0/751798007 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcb080b9900 0x7fcb0809e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:37.757 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.751+0000 7fcb07fff640 1 -- 172.21.15.62:0/751798007 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaf800a670 con 0x7fcb080ba340 2023-10-08T12:00:37.757 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.751+0000 7fcb07fff640 1 --2- 172.21.15.62:0/751798007 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcb080ba340 0x7fcb080a0280 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fcb0000ccb0 tx=0x7fcb0000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:37.757 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.751+0000 7fcaeffff640 1 -- 172.21.15.62:0/751798007 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb00004b30 con 0x7fcb080ba340 2023-10-08T12:00:37.757 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.751+0000 7fcaeffff640 1 -- 172.21.15.62:0/751798007 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fcb00004da0 con 0x7fcb080ba340 2023-10-08T12:00:37.758 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.751+0000 7fcb0dfb7640 1 -- 172.21.15.62:0/751798007 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb081e28a0 con 0x7fcb080ba340 2023-10-08T12:00:37.758 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.751+0000 7fcaeffff640 1 -- 172.21.15.62:0/751798007 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb00005280 con 0x7fcb080ba340 2023-10-08T12:00:37.758 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.751+0000 7fcb0dfb7640 1 -- 172.21.15.62:0/751798007 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb080a07c0 con 0x7fcb080ba340 2023-10-08T12:00:37.759 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.751+0000 7fcb0dfb7640 1 -- 172.21.15.62:0/751798007 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb0804da80 con 0x7fcb080ba340 2023-10-08T12:00:37.759 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.751+0000 7fcaeffff640 1 -- 172.21.15.62:0/751798007 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fcb000053e0 con 0x7fcb080ba340 2023-10-08T12:00:37.759 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.755+0000 7fcaeffff640 1 --2- 172.21.15.62:0/751798007 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fcaf4066470 0x7fcaf4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:37.759 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.755+0000 7fcaeffff640 1 -- 172.21.15.62:0/751798007 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcb000849e0 con 0x7fcb080ba340 2023-10-08T12:00:37.759 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.755+0000 7fcb077fe640 1 --2- 172.21.15.62:0/751798007 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fcaf4066470 0x7fcaf4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:37.759 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.755+0000 7fcb077fe640 1 --2- 172.21.15.62:0/751798007 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fcaf4066470 0x7fcaf4068930 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fcaf80b0000 tx=0x7fcaf801c340 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:37.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.759+0000 7fcaeffff640 1 -- 172.21.15.62:0/751798007 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fcb00051e70 con 0x7fcb080ba340 2023-10-08T12:00:37.921 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.915+0000 7fcb0dfb7640 1 -- 172.21.15.62:0/751798007 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcb081e2d50 con 0x7fcb080ba340 2023-10-08T12:00:37.921 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.919+0000 7fcaeffff640 1 -- 172.21.15.62:0/751798007 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcb0001d020 con 0x7fcb080ba340 2023-10-08T12:00:37.922 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2023-10-08T12:00:37.924 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.919+0000 7fcb0dfb7640 1 -- 172.21.15.62:0/751798007 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fcaf4066470 msgr2=0x7fcaf4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:37.924 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.919+0000 7fcb0dfb7640 1 --2- 172.21.15.62:0/751798007 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fcaf4066470 0x7fcaf4068930 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fcaf80b0000 tx=0x7fcaf801c340 comp rx=0 tx=0).stop 2023-10-08T12:00:37.924 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.919+0000 7fcb0dfb7640 1 -- 172.21.15.62:0/751798007 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcb080ba340 msgr2=0x7fcb080a0280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:37.924 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.919+0000 7fcb0dfb7640 1 --2- 172.21.15.62:0/751798007 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcb080ba340 0x7fcb080a0280 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fcb0000ccb0 tx=0x7fcb0000a620 comp rx=0 tx=0).stop 2023-10-08T12:00:37.924 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.919+0000 7fcb0dfb7640 1 -- 172.21.15.62:0/751798007 shutdown_connections 2023-10-08T12:00:37.924 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.919+0000 7fcb0dfb7640 1 --2- 172.21.15.62:0/751798007 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fcaf4066470 0x7fcaf4068930 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:37.924 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.919+0000 7fcb0dfb7640 1 --2- 172.21.15.62:0/751798007 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcb080ba340 0x7fcb080a0280 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:37.924 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.919+0000 7fcb0dfb7640 1 --2- 172.21.15.62:0/751798007 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcb080b9900 0x7fcb0809e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:37.924 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.919+0000 7fcb0dfb7640 1 --2- 172.21.15.62:0/751798007 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcb0806b1c0 0x7fcb0806e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:37.924 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.919+0000 7fcb0dfb7640 1 -- 172.21.15.62:0/751798007 >> 172.21.15.62:0/751798007 conn(0x7fcb0809c520 msgr2=0x7fcb080b5430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:37.925 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.919+0000 7fcb0dfb7640 1 -- 172.21.15.62:0/751798007 shutdown_connections 2023-10-08T12:00:37.925 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:37.919+0000 7fcb0dfb7640 1 -- 172.21.15.62:0/751798007 wait complete. 2023-10-08T12:00:37.941 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T12:00:38.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.071+0000 7f249df9e640 1 -- 172.21.15.62:0/3524823115 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2484004d10 msgr2=0x7f2484005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:38.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.071+0000 7f249df9e640 1 --2- 172.21.15.62:0/3524823115 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2484004d10 0x7f2484005190 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2490009ee0 tx=0x7f249001d590 comp rx=0 tx=0).stop 2023-10-08T12:00:38.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.071+0000 7f2497fff640 1 -- 172.21.15.62:0/3524823115 reap_dead start 2023-10-08T12:00:38.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.071+0000 7f249df9e640 1 -- 172.21.15.62:0/3524823115 shutdown_connections 2023-10-08T12:00:38.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.071+0000 7f249df9e640 1 -- 172.21.15.62:0/3524823115 >> 172.21.15.62:0/3524823115 conn(0x7f24980a0540 msgr2=0x7f24980a0950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:38.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.071+0000 7f249df9e640 1 -- 172.21.15.62:0/3524823115 shutdown_connections 2023-10-08T12:00:38.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.071+0000 7f249df9e640 1 -- 172.21.15.62:0/3524823115 wait complete. 2023-10-08T12:00:38.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.071+0000 7f249df9e640 1 Processor -- start 2023-10-08T12:00:38.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.071+0000 7f249df9e640 1 -- start start 2023-10-08T12:00:38.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.071+0000 7f249df9e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2484004d10 0x7f24981e2da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:38.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.071+0000 7f249df9e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f249814e060 0x7f24980a3470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:38.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.071+0000 7f249df9e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f249814b5a0 0x7f2498150e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:38.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.071+0000 7f249df9e640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24981e2910 con 0x7f249814b5a0 2023-10-08T12:00:38.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.071+0000 7f249df9e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24981e25e0 con 0x7f2484004d10 2023-10-08T12:00:38.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.071+0000 7f249df9e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f249814be30 con 0x7f249814e060 2023-10-08T12:00:38.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.071+0000 7f2497fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f249814b5a0 0x7f2498150e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:38.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.071+0000 7f2497fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f249814b5a0 0x7f2498150e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43568/0 (socket says 172.21.15.62:43568) 2023-10-08T12:00:38.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.071+0000 7f2497fff640 1 -- 172.21.15.62:0/3188298624 learned_addr learned my addr 172.21.15.62:0/3188298624 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:38.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.071+0000 7f24977fe640 1 --2- 172.21.15.62:0/3188298624 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2484004d10 0x7f24981e2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:38.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.071+0000 7f248ffff640 1 --2- 172.21.15.62:0/3188298624 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f249814e060 0x7f24980a3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:38.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.071+0000 7f2497fff640 1 -- 172.21.15.62:0/3188298624 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f249814e060 msgr2=0x7f24980a3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:38.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.071+0000 7f2497fff640 1 --2- 172.21.15.62:0/3188298624 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f249814e060 0x7f24980a3470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:38.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.071+0000 7f2497fff640 1 -- 172.21.15.62:0/3188298624 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2484004d10 msgr2=0x7f24981e2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:38.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.071+0000 7f2497fff640 1 --2- 172.21.15.62:0/3188298624 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2484004d10 0x7f24981e2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:38.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.071+0000 7f2497fff640 1 -- 172.21.15.62:0/3188298624 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f249814bb50 con 0x7f249814b5a0 2023-10-08T12:00:38.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.071+0000 7f248ffff640 1 --2- 172.21.15.62:0/3188298624 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f249814e060 0x7f24980a3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:00:38.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.071+0000 7f2497fff640 1 --2- 172.21.15.62:0/3188298624 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f249814b5a0 0x7f2498150e90 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f249001d000 tx=0x7f2490004ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:38.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.071+0000 7f2494ff9640 1 -- 172.21.15.62:0/3188298624 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24900b6070 con 0x7f249814b5a0 2023-10-08T12:00:38.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.071+0000 7f2494ff9640 1 -- 172.21.15.62:0/3188298624 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f24900a99a0 con 0x7f249814b5a0 2023-10-08T12:00:38.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.071+0000 7f249df9e640 1 -- 172.21.15.62:0/3188298624 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24981e32e0 con 0x7f249814b5a0 2023-10-08T12:00:38.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.071+0000 7f2494ff9640 1 -- 172.21.15.62:0/3188298624 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24900a9d50 con 0x7f249814b5a0 2023-10-08T12:00:38.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.071+0000 7f249df9e640 1 -- 172.21.15.62:0/3188298624 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24981df1c0 con 0x7f249814b5a0 2023-10-08T12:00:38.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.075+0000 7f249df9e640 1 -- 172.21.15.62:0/3188298624 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24981e34a0 con 0x7f249814b5a0 2023-10-08T12:00:38.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.075+0000 7f2494ff9640 1 -- 172.21.15.62:0/3188298624 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f24900a7040 con 0x7f249814b5a0 2023-10-08T12:00:38.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.075+0000 7f2494ff9640 1 --2- 172.21.15.62:0/3188298624 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f24780664a0 0x7f2478068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:38.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.075+0000 7f2494ff9640 1 -- 172.21.15.62:0/3188298624 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f249011e7b0 con 0x7f249814b5a0 2023-10-08T12:00:38.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.075+0000 7f24977fe640 1 --2- 172.21.15.62:0/3188298624 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f24780664a0 0x7f2478068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:38.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.075+0000 7f24977fe640 1 --2- 172.21.15.62:0/3188298624 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f24780664a0 0x7f2478068960 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2488009bc0 tx=0x7f24880091e0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:38.083 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.079+0000 7f2494ff9640 1 -- 172.21.15.62:0/3188298624 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f24900ebcc0 con 0x7f249814b5a0 2023-10-08T12:00:38.237 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.231+0000 7f249df9e640 1 -- 172.21.15.62:0/3188298624 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f24981e2750 con 0x7f249814b5a0 2023-10-08T12:00:38.237 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.231+0000 7f2494ff9640 1 -- 172.21.15.62:0/3188298624 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f24900c0020 con 0x7f249814b5a0 2023-10-08T12:00:38.238 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-10-08T12:00:38.239 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.235+0000 7f249df9e640 1 -- 172.21.15.62:0/3188298624 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f24780664a0 msgr2=0x7f2478068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:38.239 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.235+0000 7f249df9e640 1 --2- 172.21.15.62:0/3188298624 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f24780664a0 0x7f2478068960 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2488009bc0 tx=0x7f24880091e0 comp rx=0 tx=0).stop 2023-10-08T12:00:38.239 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.235+0000 7f249df9e640 1 -- 172.21.15.62:0/3188298624 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f249814b5a0 msgr2=0x7f2498150e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:38.240 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.235+0000 7f249df9e640 1 --2- 172.21.15.62:0/3188298624 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f249814b5a0 0x7f2498150e90 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f249001d000 tx=0x7f2490004ef0 comp rx=0 tx=0).stop 2023-10-08T12:00:38.240 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.235+0000 7f249df9e640 1 -- 172.21.15.62:0/3188298624 shutdown_connections 2023-10-08T12:00:38.241 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.235+0000 7f249df9e640 1 --2- 172.21.15.62:0/3188298624 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f24780664a0 0x7f2478068960 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:38.241 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.235+0000 7f249df9e640 1 --2- 172.21.15.62:0/3188298624 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f249814e060 0x7f24980a3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:38.241 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.235+0000 7f249df9e640 1 --2- 172.21.15.62:0/3188298624 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f249814b5a0 0x7f2498150e90 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:38.241 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.235+0000 7f249df9e640 1 --2- 172.21.15.62:0/3188298624 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2484004d10 0x7f24981e2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:38.241 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.235+0000 7f249df9e640 1 -- 172.21.15.62:0/3188298624 >> 172.21.15.62:0/3188298624 conn(0x7f24980a0540 msgr2=0x7f24980bc670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:38.242 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.235+0000 7f249df9e640 1 -- 172.21.15.62:0/3188298624 shutdown_connections 2023-10-08T12:00:38.242 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.235+0000 7f249df9e640 1 -- 172.21.15.62:0/3188298624 wait complete. 2023-10-08T12:00:38.257 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T12:00:38.390 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.387+0000 7f19befdd640 1 -- 172.21.15.62:0/4219422041 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f19b80a0af0 msgr2=0x7f19b81515a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:38.390 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.387+0000 7f19befdd640 1 --2- 172.21.15.62:0/4219422041 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f19b80a0af0 0x7f19b81515a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f19b814b2b0 tx=0x7f19b001c750 comp rx=0 tx=0).stop 2023-10-08T12:00:38.391 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.387+0000 7f19befdd640 1 -- 172.21.15.62:0/4219422041 shutdown_connections 2023-10-08T12:00:38.391 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.387+0000 7f19befdd640 1 --2- 172.21.15.62:0/4219422041 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f19b80a0af0 0x7f19b81515a0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:38.391 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.387+0000 7f19befdd640 1 --2- 172.21.15.62:0/4219422041 >> v2:172.21.15.130:3300/0 conn(0x7f19b806c460 0x7f19b80a05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:38.391 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.387+0000 7f19befdd640 1 -- 172.21.15.62:0/4219422041 >> 172.21.15.62:0/4219422041 conn(0x7f19b80bb030 msgr2=0x7f19b80bb440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:38.391 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.387+0000 7f19befdd640 1 -- 172.21.15.62:0/4219422041 shutdown_connections 2023-10-08T12:00:38.391 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.387+0000 7f19befdd640 1 -- 172.21.15.62:0/4219422041 wait complete. 2023-10-08T12:00:38.393 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.387+0000 7f19befdd640 1 Processor -- start 2023-10-08T12:00:38.393 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.387+0000 7f19befdd640 1 -- start start 2023-10-08T12:00:38.393 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.387+0000 7f19befdd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f19b80a0af0 0x7f19b80b4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:38.393 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.387+0000 7f19befdd640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f19b8141030 0x7f19b80b59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:38.393 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.387+0000 7f19befdd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f19b80b5f30 0x7f19b8148c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:38.393 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.387+0000 7f19befdd640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b80b42a0 con 0x7f19b80b5f30 2023-10-08T12:00:38.394 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.387+0000 7f19befdd640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b814a030 con 0x7f19b80a0af0 2023-10-08T12:00:38.394 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.387+0000 7f19befdd640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19b814ac90 con 0x7f19b8141030 2023-10-08T12:00:38.394 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.387+0000 7f19bd57a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f19b80b5f30 0x7f19b8148c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:38.394 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.387+0000 7f19bd57a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f19b80b5f30 0x7f19b8148c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43586/0 (socket says 172.21.15.62:43586) 2023-10-08T12:00:38.394 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.387+0000 7f19bd57a640 1 -- 172.21.15.62:0/2423473225 learned_addr learned my addr 172.21.15.62:0/2423473225 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:38.394 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.387+0000 7f19bcd79640 1 --2- 172.21.15.62:0/2423473225 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f19b80a0af0 0x7f19b80b4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:38.394 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.387+0000 7f19b7fff640 1 --2- 172.21.15.62:0/2423473225 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f19b8141030 0x7f19b80b59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:38.394 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.387+0000 7f19bd57a640 1 -- 172.21.15.62:0/2423473225 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f19b8141030 msgr2=0x7f19b80b59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:38.394 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.387+0000 7f19bd57a640 1 --2- 172.21.15.62:0/2423473225 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f19b8141030 0x7f19b80b59f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:38.394 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.387+0000 7f19bd57a640 1 -- 172.21.15.62:0/2423473225 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f19b80a0af0 msgr2=0x7f19b80b4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:38.394 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.387+0000 7f19bd57a640 1 --2- 172.21.15.62:0/2423473225 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f19b80a0af0 0x7f19b80b4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:38.394 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.387+0000 7f19bd57a640 1 -- 172.21.15.62:0/2423473225 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b00094a0 con 0x7f19b80b5f30 2023-10-08T12:00:38.395 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.387+0000 7f19b7fff640 1 --2- 172.21.15.62:0/2423473225 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f19b8141030 0x7f19b80b59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:00:38.395 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.387+0000 7f19bcd79640 1 --2- 172.21.15.62:0/2423473225 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f19b80a0af0 0x7f19b80b4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:00:38.395 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.387+0000 7f19bd57a640 1 --2- 172.21.15.62:0/2423473225 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f19b80b5f30 0x7f19b8148c50 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f19b0019360 tx=0x7f19b00a6660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:38.395 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.387+0000 7f19b57fa640 1 -- 172.21.15.62:0/2423473225 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b00b5070 con 0x7f19b80b5f30 2023-10-08T12:00:38.395 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.387+0000 7f19b57fa640 1 -- 172.21.15.62:0/2423473225 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f19b0004030 con 0x7f19b80b5f30 2023-10-08T12:00:38.395 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.387+0000 7f19b57fa640 1 -- 172.21.15.62:0/2423473225 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b00043c0 con 0x7f19b80b5f30 2023-10-08T12:00:38.395 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.387+0000 7f19befdd640 1 -- 172.21.15.62:0/2423473225 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19b814aee0 con 0x7f19b80b5f30 2023-10-08T12:00:38.395 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.387+0000 7f19befdd640 1 -- 172.21.15.62:0/2423473225 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19b80b66e0 con 0x7f19b80b5f30 2023-10-08T12:00:38.396 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.391+0000 7f19befdd640 1 -- 172.21.15.62:0/2423473225 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19b8148970 con 0x7f19b80b5f30 2023-10-08T12:00:38.396 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.391+0000 7f19b57fa640 1 -- 172.21.15.62:0/2423473225 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f19b00050c0 con 0x7f19b80b5f30 2023-10-08T12:00:38.396 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.391+0000 7f19b57fa640 1 --2- 172.21.15.62:0/2423473225 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f19980664a0 0x7f1998068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:38.396 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.391+0000 7f19b57fa640 1 -- 172.21.15.62:0/2423473225 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f19b011dfe0 con 0x7f19b80b5f30 2023-10-08T12:00:38.396 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.391+0000 7f19bcd79640 1 --2- 172.21.15.62:0/2423473225 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f19980664a0 0x7f1998068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:38.396 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.391+0000 7f19bcd79640 1 --2- 172.21.15.62:0/2423473225 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f19980664a0 0x7f1998068960 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f19a0000f70 tx=0x7f19a0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:38.398 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.395+0000 7f19b57fa640 1 -- 172.21.15.62:0/2423473225 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f19b8148970 con 0x7f19b80b5f30 2023-10-08T12:00:38.557 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.551+0000 7f19befdd640 1 -- 172.21.15.62:0/2423473225 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f19b8148970 con 0x7f19b80b5f30 2023-10-08T12:00:38.557 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.551+0000 7f19b57fa640 1 -- 172.21.15.62:0/2423473225 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f19b8148970 con 0x7f19b80b5f30 2023-10-08T12:00:38.557 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 64 2023-10-08T12:00:38.560 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.555+0000 7f19befdd640 1 -- 172.21.15.62:0/2423473225 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f19980664a0 msgr2=0x7f1998068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:38.560 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.555+0000 7f19befdd640 1 --2- 172.21.15.62:0/2423473225 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f19980664a0 0x7f1998068960 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f19a0000f70 tx=0x7f19a0009040 comp rx=0 tx=0).stop 2023-10-08T12:00:38.560 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.555+0000 7f19befdd640 1 -- 172.21.15.62:0/2423473225 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f19b80b5f30 msgr2=0x7f19b8148c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:38.560 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.555+0000 7f19befdd640 1 --2- 172.21.15.62:0/2423473225 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f19b80b5f30 0x7f19b8148c50 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f19b0019360 tx=0x7f19b00a6660 comp rx=0 tx=0).stop 2023-10-08T12:00:38.560 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.555+0000 7f19befdd640 1 -- 172.21.15.62:0/2423473225 shutdown_connections 2023-10-08T12:00:38.560 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.555+0000 7f19befdd640 1 --2- 172.21.15.62:0/2423473225 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f19980664a0 0x7f1998068960 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:38.560 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.555+0000 7f19befdd640 1 --2- 172.21.15.62:0/2423473225 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f19b8141030 0x7f19b80b59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:38.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.555+0000 7f19befdd640 1 --2- 172.21.15.62:0/2423473225 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f19b80b5f30 0x7f19b8148c50 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:38.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.555+0000 7f19befdd640 1 --2- 172.21.15.62:0/2423473225 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f19b80a0af0 0x7f19b80b4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:38.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.555+0000 7f19befdd640 1 -- 172.21.15.62:0/2423473225 >> 172.21.15.62:0/2423473225 conn(0x7f19b80bb030 msgr2=0x7f19b813c740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:38.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.555+0000 7f19befdd640 1 -- 172.21.15.62:0/2423473225 shutdown_connections 2023-10-08T12:00:38.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.555+0000 7f19befdd640 1 -- 172.21.15.62:0/2423473225 wait complete. 2023-10-08T12:00:38.577 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:00:38.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.703+0000 7ff3257a3640 1 -- 172.21.15.62:0/3711342792 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff320151850 msgr2=0x7ff320153c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:38.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.703+0000 7ff3257a3640 1 --2- 172.21.15.62:0/3711342792 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff320151850 0x7ff320153c40 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff320072f60 tx=0x7ff31801cd30 comp rx=0 tx=0).stop 2023-10-08T12:00:38.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.703+0000 7ff3257a3640 1 -- 172.21.15.62:0/3711342792 shutdown_connections 2023-10-08T12:00:38.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.703+0000 7ff3257a3640 1 --2- 172.21.15.62:0/3711342792 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff320151850 0x7ff320153c40 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:38.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.703+0000 7ff3257a3640 1 --2- 172.21.15.62:0/3711342792 >> v2:172.21.15.130:3300/0 conn(0x7ff3200b8630 0x7ff3200ba590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:38.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.703+0000 7ff3257a3640 1 -- 172.21.15.62:0/3711342792 >> 172.21.15.62:0/3711342792 conn(0x7ff32009e540 msgr2=0x7ff32009e950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:38.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.703+0000 7ff3257a3640 1 -- 172.21.15.62:0/3711342792 shutdown_connections 2023-10-08T12:00:38.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.703+0000 7ff3257a3640 1 -- 172.21.15.62:0/3711342792 wait complete. 2023-10-08T12:00:38.709 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.703+0000 7ff3257a3640 1 Processor -- start 2023-10-08T12:00:38.710 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.703+0000 7ff3257a3640 1 -- start start 2023-10-08T12:00:38.710 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.703+0000 7ff3257a3640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3200b8630 0x7ff320142860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:38.710 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.703+0000 7ff3257a3640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff3200bb140 0x7ff3200b2330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:38.710 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.703+0000 7ff3257a3640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff320151850 0x7ff32013d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:38.710 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.703+0000 7ff3257a3640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3200a1640 con 0x7ff3200b8630 2023-10-08T12:00:38.710 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.703+0000 7ff3257a3640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff320142da0 con 0x7ff320151850 2023-10-08T12:00:38.710 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.703+0000 7ff3257a3640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3200b2870 con 0x7ff3200bb140 2023-10-08T12:00:38.710 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.703+0000 7ff31effd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3200b8630 0x7ff320142860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:38.710 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.703+0000 7ff31effd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3200b8630 0x7ff320142860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43600/0 (socket says 172.21.15.62:43600) 2023-10-08T12:00:38.710 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.703+0000 7ff31effd640 1 -- 172.21.15.62:0/124790963 learned_addr learned my addr 172.21.15.62:0/124790963 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:38.710 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.703+0000 7ff31e7fc640 1 --2- 172.21.15.62:0/124790963 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff3200bb140 0x7ff3200b2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:38.711 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.703+0000 7ff31f7fe640 1 --2- 172.21.15.62:0/124790963 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff320151850 0x7ff32013d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:38.711 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.703+0000 7ff31effd640 1 -- 172.21.15.62:0/124790963 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff3200bb140 msgr2=0x7ff3200b2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:38.711 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.703+0000 7ff31effd640 1 --2- 172.21.15.62:0/124790963 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff3200bb140 0x7ff3200b2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:38.711 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.703+0000 7ff31effd640 1 -- 172.21.15.62:0/124790963 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff320151850 msgr2=0x7ff32013d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:38.711 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.703+0000 7ff31effd640 1 --2- 172.21.15.62:0/124790963 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff320151850 0x7ff32013d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:38.711 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.703+0000 7ff31effd640 1 -- 172.21.15.62:0/124790963 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3180098e0 con 0x7ff3200b8630 2023-10-08T12:00:38.711 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.703+0000 7ff31f7fe640 1 --2- 172.21.15.62:0/124790963 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff320151850 0x7ff32013d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:00:38.711 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.703+0000 7ff31effd640 1 --2- 172.21.15.62:0/124790963 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3200b8630 0x7ff320142860 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff30800d9b0 tx=0x7ff30800de70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:38.711 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.703+0000 7ff3177fe640 1 -- 172.21.15.62:0/124790963 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff308009bd0 con 0x7ff3200b8630 2023-10-08T12:00:38.711 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.703+0000 7ff3177fe640 1 -- 172.21.15.62:0/124790963 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff308009e20 con 0x7ff3200b8630 2023-10-08T12:00:38.711 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.703+0000 7ff3257a3640 1 -- 172.21.15.62:0/124790963 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff32014a250 con 0x7ff3200b8630 2023-10-08T12:00:38.711 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.703+0000 7ff3177fe640 1 -- 172.21.15.62:0/124790963 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3080106c0 con 0x7ff3200b8630 2023-10-08T12:00:38.712 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.703+0000 7ff3257a3640 1 -- 172.21.15.62:0/124790963 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3200b1b30 con 0x7ff3200b8630 2023-10-08T12:00:38.712 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.707+0000 7ff3257a3640 1 -- 172.21.15.62:0/124790963 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff32004da80 con 0x7ff3200b8630 2023-10-08T12:00:38.712 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.707+0000 7ff3177fe640 1 -- 172.21.15.62:0/124790963 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff308010820 con 0x7ff3200b8630 2023-10-08T12:00:38.713 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.707+0000 7ff3177fe640 1 --2- 172.21.15.62:0/124790963 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7ff3000664a0 0x7ff300068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:38.713 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.707+0000 7ff3177fe640 1 -- 172.21.15.62:0/124790963 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff308084240 con 0x7ff3200b8630 2023-10-08T12:00:38.713 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.707+0000 7ff31e7fc640 1 --2- 172.21.15.62:0/124790963 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7ff3000664a0 0x7ff300068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:38.713 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.707+0000 7ff31e7fc640 1 --2- 172.21.15.62:0/124790963 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7ff3000664a0 0x7ff300068960 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff3201435a0 tx=0x7ff310009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:38.715 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.711+0000 7ff3177fe640 1 -- 172.21.15.62:0/124790963 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff3080551e0 con 0x7ff3200b8630 2023-10-08T12:00:38.870 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.867+0000 7ff3257a3640 1 -- 172.21.15.62:0/124790963 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff3200b78f0 con 0x7ff3200b8630 2023-10-08T12:00:38.873 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.867+0000 7ff3177fe640 1 -- 172.21.15.62:0/124790963 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16481 (secure 0 0 0) 0x7ff308054d70 con 0x7ff3200b8630 2023-10-08T12:00:38.873 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T12:00:38.873 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":20,"fsid":"3e777930-c2c1-4f2b-a903-c07ee4ca2c52","created":"2023-10-08T11:59:54.510229+0000","modified":"2023-10-08T12:00:21.580704+0000","last_up_change":"2023-10-08T12:00:06.783998+0000","last_in_change":"2023-10-08T11:59:57.847944+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:00:07.189433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:00:17.895548+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T12:00:18.871217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7bc3070a-7240-43d9-9ec3-397b68a37e2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6820","nonce":2227876905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6824","nonce":2227876905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6831","nonce":2227876905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6828","nonce":2227876905}]},"public_addr":"172.21.15.62:6820/2227876905","cluster_addr":"172.21.15.62:6824/2227876905","heartbeat_back_addr":"172.21.15.62:6831/2227876905","heartbeat_front_addr":"172.21.15.62:6828/2227876905","state":["exists","up"]},{"osd":1,"uuid":"5e0fa1f5-9ddc-4882-b460-5578bb571003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6801","nonce":315660906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6803","nonce":315660906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6808","nonce":315660906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6805","nonce":315660906}]},"public_addr":"172.21.15.62:6801/315660906","cluster_addr":"172.21.15.62:6803/315660906","heartbeat_back_addr":"172.21.15.62:6808/315660906","heartbeat_front_addr":"172.21.15.62:6805/315660906","state":["exists","up"]},{"osd":2,"uuid":"262b5ee9-4243-4309-a14f-88ad4e8bf812","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6807","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6809","nonce":3784842938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6811","nonce":3784842938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6815","nonce":3784842938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6813","nonce":3784842938}]},"public_addr":"172.21.15.62:6809/3784842938","cluster_addr":"172.21.15.62:6811/3784842938","heartbeat_back_addr":"172.21.15.62:6815/3784842938","heartbeat_front_addr":"172.21.15.62:6813/3784842938","state":["exists","up"]},{"osd":3,"uuid":"1770bdb8-c12b-43b1-aaab-1d6b6fd18f4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6817","nonce":3385303160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6821","nonce":3385303160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6827","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6829","nonce":3385303160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6823","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6825","nonce":3385303160}]},"public_addr":"172.21.15.62:6817/3385303160","cluster_addr":"172.21.15.62:6821/3385303160","heartbeat_back_addr":"172.21.15.62:6829/3385303160","heartbeat_front_addr":"172.21.15.62:6825/3385303160","state":["exists","up"]},{"osd":4,"uuid":"74c73631-9351-494a-8246-28ee86e9f862","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6807","nonce":1174056987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6809","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6811","nonce":1174056987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6820","nonce":1174056987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6813","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6816","nonce":1174056987}]},"public_addr":"172.21.15.130:6807/1174056987","cluster_addr":"172.21.15.130:6811/1174056987","heartbeat_back_addr":"172.21.15.130:6820/1174056987","heartbeat_front_addr":"172.21.15.130:6816/1174056987","state":["exists","up"]},{"osd":5,"uuid":"1040f389-272c-41d6-ae76-70c04d09afa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6801","nonce":561928414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6803","nonce":561928414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6815","nonce":561928414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6808","nonce":561928414}]},"public_addr":"172.21.15.130:6801/561928414","cluster_addr":"172.21.15.130:6803/561928414","heartbeat_back_addr":"172.21.15.130:6815/561928414","heartbeat_front_addr":"172.21.15.130:6808/561928414","state":["exists","up"]},{"osd":6,"uuid":"178553eb-03e1-4ab8-9826-4f5997e6da0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6810","nonce":2877303015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6817","nonce":2877303015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6823","nonce":2877303015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6819","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6821","nonce":2877303015}]},"public_addr":"172.21.15.130:6810/2877303015","cluster_addr":"172.21.15.130:6817/2877303015","heartbeat_back_addr":"172.21.15.130:6823/2877303015","heartbeat_front_addr":"172.21.15.130:6821/2877303015","state":["exists","up"]},{"osd":7,"uuid":"b6581c8f-30b1-4dfd-b7b6-94b579128835","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6825","nonce":680009774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6827","nonce":680009774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6831","nonce":680009774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6829","nonce":680009774}]},"public_addr":"172.21.15.130:6825/680009774","cluster_addr":"172.21.15.130:6827/680009774","heartbeat_back_addr":"172.21.15.130:6831/680009774","heartbeat_front_addr":"172.21.15.130:6829/680009774","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.505543+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.394383+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.456652+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.529168+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.235414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.392158+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.347556+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.432039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:00:38.875 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.871+0000 7ff3257a3640 1 -- 172.21.15.62:0/124790963 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7ff3000664a0 msgr2=0x7ff300068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:38.875 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.871+0000 7ff3257a3640 1 --2- 172.21.15.62:0/124790963 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7ff3000664a0 0x7ff300068960 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff3201435a0 tx=0x7ff310009040 comp rx=0 tx=0).stop 2023-10-08T12:00:38.875 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.871+0000 7ff3257a3640 1 -- 172.21.15.62:0/124790963 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3200b8630 msgr2=0x7ff320142860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:38.875 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.871+0000 7ff3257a3640 1 --2- 172.21.15.62:0/124790963 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3200b8630 0x7ff320142860 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff30800d9b0 tx=0x7ff30800de70 comp rx=0 tx=0).stop 2023-10-08T12:00:38.875 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.871+0000 7ff3257a3640 1 -- 172.21.15.62:0/124790963 shutdown_connections 2023-10-08T12:00:38.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.871+0000 7ff3257a3640 1 --2- 172.21.15.62:0/124790963 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7ff3000664a0 0x7ff300068960 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:38.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.871+0000 7ff3257a3640 1 --2- 172.21.15.62:0/124790963 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff3200bb140 0x7ff3200b2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:38.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.871+0000 7ff3257a3640 1 --2- 172.21.15.62:0/124790963 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff320151850 0x7ff32013d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:38.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.871+0000 7ff3257a3640 1 --2- 172.21.15.62:0/124790963 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3200b8630 0x7ff320142860 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:38.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.871+0000 7ff3257a3640 1 -- 172.21.15.62:0/124790963 >> 172.21.15.62:0/124790963 conn(0x7ff32009e540 msgr2=0x7ff32009dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:38.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.871+0000 7ff3257a3640 1 -- 172.21.15.62:0/124790963 shutdown_connections 2023-10-08T12:00:38.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:38.871+0000 7ff3257a3640 1 -- 172.21.15.62:0/124790963 wait complete. 2023-10-08T12:00:38.891 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T12:00:07.189433+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T12:00:17.895548+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T12:00:18.871217+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T12:00:38.893 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T12:00:39.011 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.007+0000 7fb9dd606640 1 -- 172.21.15.62:0/980891528 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9d806cbd0 msgr2=0x7fb9d8070280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:39.011 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.007+0000 7fb9dd606640 1 --2- 172.21.15.62:0/980891528 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9d806cbd0 0x7fb9d8070280 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc009900 tx=0x7fb9cc01c730 comp rx=0 tx=0).stop 2023-10-08T12:00:39.011 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.007+0000 7fb9dd606640 1 -- 172.21.15.62:0/980891528 shutdown_connections 2023-10-08T12:00:39.012 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.007+0000 7fb9dd606640 1 --2- 172.21.15.62:0/980891528 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9d806cbd0 0x7fb9d8070280 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:39.012 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.007+0000 7fb9dd606640 1 -- 172.21.15.62:0/980891528 >> 172.21.15.62:0/980891528 conn(0x7fb9d809e910 msgr2=0x7fb9d809ed20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:39.012 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.007+0000 7fb9dd606640 1 -- 172.21.15.62:0/980891528 shutdown_connections 2023-10-08T12:00:39.012 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.007+0000 7fb9dd606640 1 -- 172.21.15.62:0/980891528 wait complete. 2023-10-08T12:00:39.014 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.007+0000 7fb9dd606640 1 Processor -- start 2023-10-08T12:00:39.014 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.007+0000 7fb9dd606640 1 -- start start 2023-10-08T12:00:39.014 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.007+0000 7fb9dd606640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb9d806cbd0 0x7fb9d8144f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:39.014 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.007+0000 7fb9dd606640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb9d80707c0 0x7fb9d81454a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:39.015 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.007+0000 7fb9dd606640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9d80b8f10 0x7fb9d81e34a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:39.015 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.007+0000 7fb9dd606640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d8147c20 con 0x7fb9d80b8f10 2023-10-08T12:00:39.015 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.007+0000 7fb9dd606640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d8146fc0 con 0x7fb9d80707c0 2023-10-08T12:00:39.015 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.007+0000 7fb9dd606640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d81472a0 con 0x7fb9d806cbd0 2023-10-08T12:00:39.015 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.007+0000 7fb9d77fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9d80b8f10 0x7fb9d81e34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:39.015 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.007+0000 7fb9d77fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9d80b8f10 0x7fb9d81e34a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43606/0 (socket says 172.21.15.62:43606) 2023-10-08T12:00:39.015 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.007+0000 7fb9d77fe640 1 -- 172.21.15.62:0/3262428218 learned_addr learned my addr 172.21.15.62:0/3262428218 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:39.015 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.007+0000 7fb9d6ffd640 1 --2- 172.21.15.62:0/3262428218 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb9d806cbd0 0x7fb9d8144f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:39.015 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.007+0000 7fb9d77fe640 1 -- 172.21.15.62:0/3262428218 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb9d806cbd0 msgr2=0x7fb9d8144f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:39.015 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.007+0000 7fb9d67fc640 1 --2- 172.21.15.62:0/3262428218 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb9d80707c0 0x7fb9d81454a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:39.016 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.007+0000 7fb9d77fe640 1 --2- 172.21.15.62:0/3262428218 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb9d806cbd0 0x7fb9d8144f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:39.016 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.007+0000 7fb9d77fe640 1 -- 172.21.15.62:0/3262428218 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb9d80707c0 msgr2=0x7fb9d81454a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:39.016 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.007+0000 7fb9d77fe640 1 --2- 172.21.15.62:0/3262428218 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb9d80707c0 0x7fb9d81454a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:39.016 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.007+0000 7fb9d77fe640 1 -- 172.21.15.62:0/3262428218 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9cc009560 con 0x7fb9d80b8f10 2023-10-08T12:00:39.016 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.007+0000 7fb9d6ffd640 1 --2- 172.21.15.62:0/3262428218 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb9d806cbd0 0x7fb9d8144f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:00:39.016 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.007+0000 7fb9d77fe640 1 --2- 172.21.15.62:0/3262428218 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9d80b8f10 0x7fb9d81e34a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb9d000c780 tx=0x7fb9d000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:39.016 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.007+0000 7fb9bf7fe640 1 -- 172.21.15.62:0/3262428218 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d0004b70 con 0x7fb9d80b8f10 2023-10-08T12:00:39.016 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.007+0000 7fb9bf7fe640 1 -- 172.21.15.62:0/3262428218 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb9d000ce90 con 0x7fb9d80b8f10 2023-10-08T12:00:39.016 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.007+0000 7fb9bf7fe640 1 -- 172.21.15.62:0/3262428218 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d000aab0 con 0x7fb9d80b8f10 2023-10-08T12:00:39.016 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.007+0000 7fb9dd606640 1 -- 172.21.15.62:0/3262428218 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9d8147580 con 0x7fb9d80b8f10 2023-10-08T12:00:39.016 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.007+0000 7fb9dd606640 1 -- 172.21.15.62:0/3262428218 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9d814d780 con 0x7fb9d80b8f10 2023-10-08T12:00:39.016 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.011+0000 7fb9dd606640 1 -- 172.21.15.62:0/3262428218 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9d8066a30 con 0x7fb9d80b8f10 2023-10-08T12:00:39.017 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.011+0000 7fb9bf7fe640 1 -- 172.21.15.62:0/3262428218 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb9d000ac10 con 0x7fb9d80b8f10 2023-10-08T12:00:39.017 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.011+0000 7fb9bf7fe640 1 --2- 172.21.15.62:0/3262428218 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fb9c40664a0 0x7fb9c4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:39.017 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.011+0000 7fb9bf7fe640 1 -- 172.21.15.62:0/3262428218 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb9d0084300 con 0x7fb9d80b8f10 2023-10-08T12:00:39.018 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.011+0000 7fb9d6ffd640 1 --2- 172.21.15.62:0/3262428218 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fb9c40664a0 0x7fb9c4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:39.018 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.011+0000 7fb9d6ffd640 1 --2- 172.21.15.62:0/3262428218 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fb9c40664a0 0x7fb9c4068960 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb9c8001650 tx=0x7fb9c8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:39.019 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.015+0000 7fb9bf7fe640 1 -- 172.21.15.62:0/3262428218 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb9d0051760 con 0x7fb9d80b8f10 2023-10-08T12:00:39.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.167+0000 7fb9dd606640 1 -- 172.21.15.62:0/3262428218 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb9d804da80 con 0x7fb9d80b8f10 2023-10-08T12:00:39.172 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.167+0000 7fb9bf7fe640 1 -- 172.21.15.62:0/3262428218 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb9d0054d80 con 0x7fb9d80b8f10 2023-10-08T12:00:39.172 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2023-10-08T12:00:39.174 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.171+0000 7fb9dd606640 1 -- 172.21.15.62:0/3262428218 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fb9c40664a0 msgr2=0x7fb9c4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:39.174 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.171+0000 7fb9dd606640 1 --2- 172.21.15.62:0/3262428218 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fb9c40664a0 0x7fb9c4068960 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb9c8001650 tx=0x7fb9c8009040 comp rx=0 tx=0).stop 2023-10-08T12:00:39.174 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.171+0000 7fb9dd606640 1 -- 172.21.15.62:0/3262428218 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9d80b8f10 msgr2=0x7fb9d81e34a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:39.174 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.171+0000 7fb9dd606640 1 --2- 172.21.15.62:0/3262428218 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9d80b8f10 0x7fb9d81e34a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb9d000c780 tx=0x7fb9d000cc40 comp rx=0 tx=0).stop 2023-10-08T12:00:39.174 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.171+0000 7fb9dd606640 1 -- 172.21.15.62:0/3262428218 shutdown_connections 2023-10-08T12:00:39.174 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.171+0000 7fb9dd606640 1 --2- 172.21.15.62:0/3262428218 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fb9c40664a0 0x7fb9c4068960 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:39.175 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.171+0000 7fb9dd606640 1 --2- 172.21.15.62:0/3262428218 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9d80b8f10 0x7fb9d81e34a0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:39.175 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.171+0000 7fb9dd606640 1 --2- 172.21.15.62:0/3262428218 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb9d80707c0 0x7fb9d81454a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:39.175 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.171+0000 7fb9dd606640 1 --2- 172.21.15.62:0/3262428218 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb9d806cbd0 0x7fb9d8144f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:39.175 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.171+0000 7fb9dd606640 1 -- 172.21.15.62:0/3262428218 >> 172.21.15.62:0/3262428218 conn(0x7fb9d809e910 msgr2=0x7fb9d8152660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:39.175 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.171+0000 7fb9dd606640 1 -- 172.21.15.62:0/3262428218 shutdown_connections 2023-10-08T12:00:39.175 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.171+0000 7fb9dd606640 1 -- 172.21.15.62:0/3262428218 wait complete. 2023-10-08T12:00:39.191 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T12:00:39.314 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.311+0000 7fe25fd74640 1 -- 172.21.15.62:0/234559142 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2580ba340 msgr2=0x7fe2580b91f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:39.314 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.311+0000 7fe25fd74640 1 --2- 172.21.15.62:0/234559142 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2580ba340 0x7fe2580b91f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe24c009900 tx=0x7fe24c01c7f0 comp rx=0 tx=0).stop 2023-10-08T12:00:39.315 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.311+0000 7fe25fd74640 1 -- 172.21.15.62:0/234559142 shutdown_connections 2023-10-08T12:00:39.315 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.311+0000 7fe25fd74640 1 --2- 172.21.15.62:0/234559142 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2580ba340 0x7fe2580b91f0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:39.315 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.311+0000 7fe25fd74640 1 --2- 172.21.15.62:0/234559142 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe25806b1c0 0x7fe2580b5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:39.315 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.311+0000 7fe25fd74640 1 -- 172.21.15.62:0/234559142 >> 172.21.15.62:0/234559142 conn(0x7fe25809c520 msgr2=0x7fe25809c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:39.315 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.311+0000 7fe25fd74640 1 -- 172.21.15.62:0/234559142 shutdown_connections 2023-10-08T12:00:39.315 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.311+0000 7fe25fd74640 1 -- 172.21.15.62:0/234559142 wait complete. 2023-10-08T12:00:39.317 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.311+0000 7fe25fd74640 1 Processor -- start 2023-10-08T12:00:39.317 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.311+0000 7fe25fd74640 1 -- start start 2023-10-08T12:00:39.318 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.311+0000 7fe25fd74640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe25806b1c0 0x7fe2580707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:39.318 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.311+0000 7fe25fd74640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe25806b5a0 0x7fe2581e3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:39.318 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.311+0000 7fe25fd74640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2580ba340 0x7fe2581e6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:39.318 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.311+0000 7fe25fd74640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe258097f20 con 0x7fe2580ba340 2023-10-08T12:00:39.318 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.311+0000 7fe25fd74640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe258070d10 con 0x7fe25806b1c0 2023-10-08T12:00:39.318 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.311+0000 7fe25fd74640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe25814dec0 con 0x7fe25806b5a0 2023-10-08T12:00:39.318 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.311+0000 7fe25e311640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2580ba340 0x7fe2581e6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:39.318 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.311+0000 7fe25e311640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2580ba340 0x7fe2581e6440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43634/0 (socket says 172.21.15.62:43634) 2023-10-08T12:00:39.319 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.311+0000 7fe25e311640 1 -- 172.21.15.62:0/3287944830 learned_addr learned my addr 172.21.15.62:0/3287944830 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:39.319 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.311+0000 7fe25d30f640 1 --2- 172.21.15.62:0/3287944830 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe25806b5a0 0x7fe2581e3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:39.319 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.311+0000 7fe25db10640 1 --2- 172.21.15.62:0/3287944830 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe25806b1c0 0x7fe2580707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:39.319 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.311+0000 7fe25e311640 1 -- 172.21.15.62:0/3287944830 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe25806b5a0 msgr2=0x7fe2581e3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:39.319 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.311+0000 7fe25e311640 1 --2- 172.21.15.62:0/3287944830 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe25806b5a0 0x7fe2581e3100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:39.319 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.311+0000 7fe25e311640 1 -- 172.21.15.62:0/3287944830 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe25806b1c0 msgr2=0x7fe2580707d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:39.319 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.311+0000 7fe25e311640 1 --2- 172.21.15.62:0/3287944830 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe25806b1c0 0x7fe2580707d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:39.319 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.311+0000 7fe25e311640 1 -- 172.21.15.62:0/3287944830 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe24c009560 con 0x7fe2580ba340 2023-10-08T12:00:39.319 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.311+0000 7fe25db10640 1 --2- 172.21.15.62:0/3287944830 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe25806b1c0 0x7fe2580707d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:00:39.319 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.311+0000 7fe25d30f640 1 --2- 172.21.15.62:0/3287944830 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe25806b5a0 0x7fe2581e3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:00:39.320 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.311+0000 7fe25e311640 1 --2- 172.21.15.62:0/3287944830 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2580ba340 0x7fe2581e6440 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe25000c410 tx=0x7fe25000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:39.320 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.311+0000 7fe2567fc640 1 -- 172.21.15.62:0/3287944830 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe250003600 con 0x7fe2580ba340 2023-10-08T12:00:39.320 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.311+0000 7fe2567fc640 1 -- 172.21.15.62:0/3287944830 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe250003760 con 0x7fe2580ba340 2023-10-08T12:00:39.320 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.311+0000 7fe25fd74640 1 -- 172.21.15.62:0/3287944830 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe25809b270 con 0x7fe2580ba340 2023-10-08T12:00:39.320 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.311+0000 7fe2567fc640 1 -- 172.21.15.62:0/3287944830 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe250003bb0 con 0x7fe2580ba340 2023-10-08T12:00:39.320 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.311+0000 7fe25fd74640 1 -- 172.21.15.62:0/3287944830 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe258098100 con 0x7fe2580ba340 2023-10-08T12:00:39.320 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.311+0000 7fe25fd74640 1 -- 172.21.15.62:0/3287944830 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe25804da80 con 0x7fe2580ba340 2023-10-08T12:00:39.321 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.315+0000 7fe2567fc640 1 -- 172.21.15.62:0/3287944830 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe250003d10 con 0x7fe2580ba340 2023-10-08T12:00:39.321 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.315+0000 7fe2567fc640 1 --2- 172.21.15.62:0/3287944830 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fe244066470 0x7fe244068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:39.322 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.315+0000 7fe2567fc640 1 -- 172.21.15.62:0/3287944830 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe2500835c0 con 0x7fe2580ba340 2023-10-08T12:00:39.322 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.315+0000 7fe25db10640 1 --2- 172.21.15.62:0/3287944830 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fe244066470 0x7fe244068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:39.322 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.315+0000 7fe25db10640 1 --2- 172.21.15.62:0/3287944830 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fe244066470 0x7fe244068930 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe248007eb0 tx=0x7fe2480073c0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:39.323 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.319+0000 7fe2567fc640 1 -- 172.21.15.62:0/3287944830 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe250050a40 con 0x7fe2580ba340 2023-10-08T12:00:39.472 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.467+0000 7fe25fd74640 1 -- 172.21.15.62:0/3287944830 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe25809d3c0 con 0x7fe2580ba340 2023-10-08T12:00:39.473 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.467+0000 7fe2567fc640 1 -- 172.21.15.62:0/3287944830 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe250054060 con 0x7fe2580ba340 2023-10-08T12:00:39.473 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-10-08T12:00:39.475 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.471+0000 7fe25fd74640 1 -- 172.21.15.62:0/3287944830 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fe244066470 msgr2=0x7fe244068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:39.475 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.471+0000 7fe25fd74640 1 --2- 172.21.15.62:0/3287944830 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fe244066470 0x7fe244068930 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe248007eb0 tx=0x7fe2480073c0 comp rx=0 tx=0).stop 2023-10-08T12:00:39.476 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.471+0000 7fe25fd74640 1 -- 172.21.15.62:0/3287944830 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2580ba340 msgr2=0x7fe2581e6440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:39.476 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.471+0000 7fe25fd74640 1 --2- 172.21.15.62:0/3287944830 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2580ba340 0x7fe2581e6440 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe25000c410 tx=0x7fe25000c8d0 comp rx=0 tx=0).stop 2023-10-08T12:00:39.476 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.471+0000 7fe25fd74640 1 -- 172.21.15.62:0/3287944830 shutdown_connections 2023-10-08T12:00:39.476 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.471+0000 7fe25fd74640 1 --2- 172.21.15.62:0/3287944830 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fe244066470 0x7fe244068930 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:39.476 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.471+0000 7fe25fd74640 1 --2- 172.21.15.62:0/3287944830 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe25806b5a0 0x7fe2581e3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:39.477 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.471+0000 7fe25fd74640 1 --2- 172.21.15.62:0/3287944830 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2580ba340 0x7fe2581e6440 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:39.477 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.471+0000 7fe25fd74640 1 --2- 172.21.15.62:0/3287944830 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe25806b1c0 0x7fe2580707d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:39.477 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.471+0000 7fe25fd74640 1 -- 172.21.15.62:0/3287944830 >> 172.21.15.62:0/3287944830 conn(0x7fe25809c520 msgr2=0x7fe258141890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:39.477 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.471+0000 7fe25fd74640 1 -- 172.21.15.62:0/3287944830 shutdown_connections 2023-10-08T12:00:39.477 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.471+0000 7fe25fd74640 1 -- 172.21.15.62:0/3287944830 wait complete. 2023-10-08T12:00:39.491 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T12:00:39.609 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.603+0000 7fafccf6b640 1 -- 172.21.15.62:0/1151677526 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fafc80b99e0 msgr2=0x7fafc809d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:39.610 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.603+0000 7fafccf6b640 1 --2- 172.21.15.62:0/1151677526 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fafc80b99e0 0x7fafc809d040 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fafc8073430 tx=0x7fafb801c810 comp rx=0 tx=0).stop 2023-10-08T12:00:39.610 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.603+0000 7fafccf6b640 1 -- 172.21.15.62:0/1151677526 shutdown_connections 2023-10-08T12:00:39.610 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.603+0000 7fafccf6b640 1 --2- 172.21.15.62:0/1151677526 >> v2:172.21.15.130:3300/0 conn(0x7fafc80b5480 0x7fafc80b5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:39.610 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.603+0000 7fafccf6b640 1 --2- 172.21.15.62:0/1151677526 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fafc80b99e0 0x7fafc809d040 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:39.610 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.603+0000 7fafccf6b640 1 -- 172.21.15.62:0/1151677526 >> 172.21.15.62:0/1151677526 conn(0x7fafc809c520 msgr2=0x7fafc809c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:39.610 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.603+0000 7fafccf6b640 1 -- 172.21.15.62:0/1151677526 shutdown_connections 2023-10-08T12:00:39.610 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.603+0000 7fafccf6b640 1 -- 172.21.15.62:0/1151677526 wait complete. 2023-10-08T12:00:39.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.607+0000 7fafccf6b640 1 Processor -- start 2023-10-08T12:00:39.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.607+0000 7fafccf6b640 1 -- start start 2023-10-08T12:00:39.613 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.607+0000 7fafccf6b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fafc80b5480 0x7fafc8145e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:39.613 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.607+0000 7fafccf6b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fafc80b99e0 0x7fafc8148910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:39.613 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.607+0000 7fafccf6b640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fafc8149a10 0x7fafc8148e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:39.613 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.607+0000 7fafccf6b640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc81463a0 con 0x7fafc80b99e0 2023-10-08T12:00:39.613 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.607+0000 7fafccf6b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc8144550 con 0x7fafc80b5480 2023-10-08T12:00:39.613 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.607+0000 7fafccf6b640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafc81456e0 con 0x7fafc8149a10 2023-10-08T12:00:39.613 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.607+0000 7fafc5d9b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fafc80b99e0 0x7fafc8148910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:39.613 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.607+0000 7fafc5d9b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fafc80b99e0 0x7fafc8148910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43650/0 (socket says 172.21.15.62:43650) 2023-10-08T12:00:39.613 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.607+0000 7fafc5d9b640 1 -- 172.21.15.62:0/1640524874 learned_addr learned my addr 172.21.15.62:0/1640524874 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:39.614 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.607+0000 7fafc5d9b640 1 -- 172.21.15.62:0/1640524874 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fafc8149a10 msgr2=0x7fafc8148e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:39.614 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.607+0000 7fafc659c640 1 --2- 172.21.15.62:0/1640524874 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fafc80b5480 0x7fafc8145e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:39.614 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.607+0000 7fafc5d9b640 1 --2- 172.21.15.62:0/1640524874 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fafc8149a10 0x7fafc8148e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:39.614 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.607+0000 7fafc5d9b640 1 -- 172.21.15.62:0/1640524874 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fafc80b5480 msgr2=0x7fafc8145e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:39.614 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.607+0000 7fafc5d9b640 1 --2- 172.21.15.62:0/1640524874 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fafc80b5480 0x7fafc8145e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:39.614 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.607+0000 7fafc5d9b640 1 -- 172.21.15.62:0/1640524874 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafb8009560 con 0x7fafc80b99e0 2023-10-08T12:00:39.614 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.607+0000 7fafc5d9b640 1 --2- 172.21.15.62:0/1640524874 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fafc80b99e0 0x7fafc8148910 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fafb000cc60 tx=0x7fafb000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:39.614 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.607+0000 7fafbeffd640 1 -- 172.21.15.62:0/1640524874 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb000f650 con 0x7fafc80b99e0 2023-10-08T12:00:39.614 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.607+0000 7fafbeffd640 1 -- 172.21.15.62:0/1640524874 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fafb000f8a0 con 0x7fafc80b99e0 2023-10-08T12:00:39.615 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.607+0000 7fafccf6b640 1 -- 172.21.15.62:0/1640524874 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafc80b5a30 con 0x7fafc80b99e0 2023-10-08T12:00:39.615 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.607+0000 7fafbeffd640 1 -- 172.21.15.62:0/1640524874 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb000fcb0 con 0x7fafc80b99e0 2023-10-08T12:00:39.615 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.607+0000 7fafccf6b640 1 -- 172.21.15.62:0/1640524874 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafc81441e0 con 0x7fafc80b99e0 2023-10-08T12:00:39.616 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.607+0000 7fafccf6b640 1 -- 172.21.15.62:0/1640524874 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafc804da80 con 0x7fafc80b99e0 2023-10-08T12:00:39.616 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.607+0000 7fafbeffd640 1 -- 172.21.15.62:0/1640524874 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fafb0018400 con 0x7fafc80b99e0 2023-10-08T12:00:39.616 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.611+0000 7fafbeffd640 1 --2- 172.21.15.62:0/1640524874 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fafa80664a0 0x7fafa8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:39.616 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.611+0000 7fafbeffd640 1 -- 172.21.15.62:0/1640524874 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fafb00849f0 con 0x7fafc80b99e0 2023-10-08T12:00:39.616 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.611+0000 7fafc659c640 1 --2- 172.21.15.62:0/1640524874 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fafa80664a0 0x7fafa8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:39.616 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.611+0000 7fafc659c640 1 --2- 172.21.15.62:0/1640524874 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fafa80664a0 0x7fafa8068960 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fafb80af000 tx=0x7fafb801b050 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:39.617 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.615+0000 7fafbeffd640 1 -- 172.21.15.62:0/1640524874 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fafb0051f00 con 0x7fafc80b99e0 2023-10-08T12:00:39.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.759+0000 7fafccf6b640 1 -- 172.21.15.62:0/1640524874 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fafc80ba3a0 con 0x7fafc80b99e0 2023-10-08T12:00:39.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.763+0000 7fafbeffd640 1 -- 172.21.15.62:0/1640524874 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fafb001d0a0 con 0x7fafc80b99e0 2023-10-08T12:00:39.766 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 64 2023-10-08T12:00:39.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.763+0000 7fafccf6b640 1 -- 172.21.15.62:0/1640524874 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fafa80664a0 msgr2=0x7fafa8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:39.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.763+0000 7fafccf6b640 1 --2- 172.21.15.62:0/1640524874 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fafa80664a0 0x7fafa8068960 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fafb80af000 tx=0x7fafb801b050 comp rx=0 tx=0).stop 2023-10-08T12:00:39.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.763+0000 7fafccf6b640 1 -- 172.21.15.62:0/1640524874 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fafc80b99e0 msgr2=0x7fafc8148910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:39.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.763+0000 7fafccf6b640 1 --2- 172.21.15.62:0/1640524874 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fafc80b99e0 0x7fafc8148910 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fafb000cc60 tx=0x7fafb000a620 comp rx=0 tx=0).stop 2023-10-08T12:00:39.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.763+0000 7fafccf6b640 1 -- 172.21.15.62:0/1640524874 shutdown_connections 2023-10-08T12:00:39.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.763+0000 7fafccf6b640 1 --2- 172.21.15.62:0/1640524874 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fafa80664a0 0x7fafa8068960 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:39.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.763+0000 7fafccf6b640 1 --2- 172.21.15.62:0/1640524874 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fafc8149a10 0x7fafc8148e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:39.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.763+0000 7fafccf6b640 1 --2- 172.21.15.62:0/1640524874 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fafc80b99e0 0x7fafc8148910 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:39.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.763+0000 7fafccf6b640 1 --2- 172.21.15.62:0/1640524874 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fafc80b5480 0x7fafc8145e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:39.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.763+0000 7fafccf6b640 1 -- 172.21.15.62:0/1640524874 >> 172.21.15.62:0/1640524874 conn(0x7fafc809c520 msgr2=0x7fafc813fbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:39.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.763+0000 7fafccf6b640 1 -- 172.21.15.62:0/1640524874 shutdown_connections 2023-10-08T12:00:39.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.763+0000 7fafccf6b640 1 -- 172.21.15.62:0/1640524874 wait complete. 2023-10-08T12:00:39.784 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:00:39.899 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.895+0000 7f52dccc0640 1 -- 172.21.15.62:0/540513682 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f52d806a520 msgr2=0x7f52d8149be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:39.899 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.895+0000 7f52dccc0640 1 --2- 172.21.15.62:0/540513682 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f52d806a520 0x7f52d8149be0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f52c8009840 tx=0x7f52c801c6e0 comp rx=0 tx=0).stop 2023-10-08T12:00:39.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.895+0000 7f52dccc0640 1 -- 172.21.15.62:0/540513682 shutdown_connections 2023-10-08T12:00:39.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.895+0000 7f52dccc0640 1 --2- 172.21.15.62:0/540513682 >> v2:172.21.15.130:3300/0 conn(0x7f52d80bc670 0x7f52d8069790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:39.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.895+0000 7f52dccc0640 1 --2- 172.21.15.62:0/540513682 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f52d806a520 0x7f52d8149be0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:39.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.895+0000 7f52dccc0640 1 -- 172.21.15.62:0/540513682 >> 172.21.15.62:0/540513682 conn(0x7f52d80a0540 msgr2=0x7f52d80a0950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:39.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.895+0000 7f52dccc0640 1 -- 172.21.15.62:0/540513682 shutdown_connections 2023-10-08T12:00:39.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.895+0000 7f52dccc0640 1 -- 172.21.15.62:0/540513682 wait complete. 2023-10-08T12:00:39.903 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.895+0000 7f52dccc0640 1 Processor -- start 2023-10-08T12:00:39.903 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.895+0000 7f52dccc0640 1 -- start start 2023-10-08T12:00:39.903 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.895+0000 7f52dccc0640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f52d806a520 0x7f52d8141b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:39.903 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.895+0000 7f52dccc0640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52d80bc670 0x7f52d80b7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:39.904 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.895+0000 7f52dccc0640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f52d80bdba0 0x7f52d81e2910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:39.904 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.895+0000 7f52dccc0640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d8142070 con 0x7f52d80bc670 2023-10-08T12:00:39.904 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.895+0000 7f52dccc0640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d81e2480 con 0x7f52d806a520 2023-10-08T12:00:39.904 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.895+0000 7f52dccc0640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52d80b8020 con 0x7f52d80bdba0 2023-10-08T12:00:39.904 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.895+0000 7f52cffff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52d80bc670 0x7f52d80b7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:39.904 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.895+0000 7f52cffff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52d80bc670 0x7f52d80b7ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43660/0 (socket says 172.21.15.62:43660) 2023-10-08T12:00:39.904 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.895+0000 7f52cffff640 1 -- 172.21.15.62:0/558258182 learned_addr learned my addr 172.21.15.62:0/558258182 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:39.904 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.895+0000 7f52d659c640 1 --2- 172.21.15.62:0/558258182 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f52d806a520 0x7f52d8141b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:39.904 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.895+0000 7f52d6d9d640 1 --2- 172.21.15.62:0/558258182 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f52d80bdba0 0x7f52d81e2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:39.904 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.895+0000 7f52cffff640 1 -- 172.21.15.62:0/558258182 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f52d80bdba0 msgr2=0x7f52d81e2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:39.905 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.895+0000 7f52cffff640 1 --2- 172.21.15.62:0/558258182 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f52d80bdba0 0x7f52d81e2910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:39.905 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.895+0000 7f52cffff640 1 -- 172.21.15.62:0/558258182 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f52d806a520 msgr2=0x7f52d8141b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:39.905 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.895+0000 7f52cffff640 1 --2- 172.21.15.62:0/558258182 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f52d806a520 0x7f52d8141b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:39.905 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.895+0000 7f52cffff640 1 -- 172.21.15.62:0/558258182 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c80094a0 con 0x7f52d80bc670 2023-10-08T12:00:39.905 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.895+0000 7f52cffff640 1 --2- 172.21.15.62:0/558258182 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52d80bc670 0x7f52d80b7ae0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f52c000e9f0 tx=0x7f52c000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:39.905 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.899+0000 7f52ceffd640 1 -- 172.21.15.62:0/558258182 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c0009710 con 0x7f52d80bc670 2023-10-08T12:00:39.905 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.899+0000 7f52ceffd640 1 -- 172.21.15.62:0/558258182 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f52c000ce70 con 0x7f52d80bc670 2023-10-08T12:00:39.905 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.899+0000 7f52dccc0640 1 -- 172.21.15.62:0/558258182 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52d80b8aa0 con 0x7f52d80bc670 2023-10-08T12:00:39.905 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.899+0000 7f52ceffd640 1 -- 172.21.15.62:0/558258182 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c0010690 con 0x7f52d80bc670 2023-10-08T12:00:39.905 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.899+0000 7f52dccc0640 1 -- 172.21.15.62:0/558258182 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52d80a3690 con 0x7f52d80bc670 2023-10-08T12:00:39.905 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.899+0000 7f52dccc0640 1 -- 172.21.15.62:0/558258182 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52d80a3500 con 0x7f52d80bc670 2023-10-08T12:00:39.905 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.899+0000 7f52ceffd640 1 -- 172.21.15.62:0/558258182 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f52c00107f0 con 0x7f52d80bc670 2023-10-08T12:00:39.906 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.899+0000 7f52ceffd640 1 --2- 172.21.15.62:0/558258182 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f52b8066470 0x7f52b8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:39.906 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.899+0000 7f52ceffd640 1 -- 172.21.15.62:0/558258182 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f52c0014070 con 0x7f52d80bc670 2023-10-08T12:00:39.906 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.899+0000 7f52d659c640 1 --2- 172.21.15.62:0/558258182 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f52b8066470 0x7f52b8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:39.906 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.899+0000 7f52d659c640 1 --2- 172.21.15.62:0/558258182 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f52b8066470 0x7f52b8068930 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f52c80af000 tx=0x7f52c801af20 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:39.907 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:39.903+0000 7f52ceffd640 1 -- 172.21.15.62:0/558258182 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f52c0050090 con 0x7f52d80bc670 2023-10-08T12:00:40.060 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.055+0000 7f52dccc0640 1 -- 172.21.15.62:0/558258182 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f52d806a090 con 0x7f52d80bc670 2023-10-08T12:00:40.063 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.059+0000 7f52ceffd640 1 -- 172.21.15.62:0/558258182 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16481 (secure 0 0 0) 0x7f52c0055a70 con 0x7f52d80bc670 2023-10-08T12:00:40.063 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T12:00:40.064 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":20,"fsid":"3e777930-c2c1-4f2b-a903-c07ee4ca2c52","created":"2023-10-08T11:59:54.510229+0000","modified":"2023-10-08T12:00:21.580704+0000","last_up_change":"2023-10-08T12:00:06.783998+0000","last_in_change":"2023-10-08T11:59:57.847944+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:00:07.189433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:00:17.895548+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T12:00:18.871217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7bc3070a-7240-43d9-9ec3-397b68a37e2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6820","nonce":2227876905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6824","nonce":2227876905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6831","nonce":2227876905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6828","nonce":2227876905}]},"public_addr":"172.21.15.62:6820/2227876905","cluster_addr":"172.21.15.62:6824/2227876905","heartbeat_back_addr":"172.21.15.62:6831/2227876905","heartbeat_front_addr":"172.21.15.62:6828/2227876905","state":["exists","up"]},{"osd":1,"uuid":"5e0fa1f5-9ddc-4882-b460-5578bb571003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6801","nonce":315660906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6803","nonce":315660906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6808","nonce":315660906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6805","nonce":315660906}]},"public_addr":"172.21.15.62:6801/315660906","cluster_addr":"172.21.15.62:6803/315660906","heartbeat_back_addr":"172.21.15.62:6808/315660906","heartbeat_front_addr":"172.21.15.62:6805/315660906","state":["exists","up"]},{"osd":2,"uuid":"262b5ee9-4243-4309-a14f-88ad4e8bf812","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6807","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6809","nonce":3784842938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6811","nonce":3784842938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6815","nonce":3784842938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6813","nonce":3784842938}]},"public_addr":"172.21.15.62:6809/3784842938","cluster_addr":"172.21.15.62:6811/3784842938","heartbeat_back_addr":"172.21.15.62:6815/3784842938","heartbeat_front_addr":"172.21.15.62:6813/3784842938","state":["exists","up"]},{"osd":3,"uuid":"1770bdb8-c12b-43b1-aaab-1d6b6fd18f4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6817","nonce":3385303160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6821","nonce":3385303160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6827","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6829","nonce":3385303160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6823","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6825","nonce":3385303160}]},"public_addr":"172.21.15.62:6817/3385303160","cluster_addr":"172.21.15.62:6821/3385303160","heartbeat_back_addr":"172.21.15.62:6829/3385303160","heartbeat_front_addr":"172.21.15.62:6825/3385303160","state":["exists","up"]},{"osd":4,"uuid":"74c73631-9351-494a-8246-28ee86e9f862","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6807","nonce":1174056987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6809","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6811","nonce":1174056987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6820","nonce":1174056987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6813","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6816","nonce":1174056987}]},"public_addr":"172.21.15.130:6807/1174056987","cluster_addr":"172.21.15.130:6811/1174056987","heartbeat_back_addr":"172.21.15.130:6820/1174056987","heartbeat_front_addr":"172.21.15.130:6816/1174056987","state":["exists","up"]},{"osd":5,"uuid":"1040f389-272c-41d6-ae76-70c04d09afa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6801","nonce":561928414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6803","nonce":561928414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6815","nonce":561928414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6808","nonce":561928414}]},"public_addr":"172.21.15.130:6801/561928414","cluster_addr":"172.21.15.130:6803/561928414","heartbeat_back_addr":"172.21.15.130:6815/561928414","heartbeat_front_addr":"172.21.15.130:6808/561928414","state":["exists","up"]},{"osd":6,"uuid":"178553eb-03e1-4ab8-9826-4f5997e6da0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6810","nonce":2877303015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6817","nonce":2877303015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6823","nonce":2877303015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6819","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6821","nonce":2877303015}]},"public_addr":"172.21.15.130:6810/2877303015","cluster_addr":"172.21.15.130:6817/2877303015","heartbeat_back_addr":"172.21.15.130:6823/2877303015","heartbeat_front_addr":"172.21.15.130:6821/2877303015","state":["exists","up"]},{"osd":7,"uuid":"b6581c8f-30b1-4dfd-b7b6-94b579128835","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6825","nonce":680009774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6827","nonce":680009774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6831","nonce":680009774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6829","nonce":680009774}]},"public_addr":"172.21.15.130:6825/680009774","cluster_addr":"172.21.15.130:6827/680009774","heartbeat_back_addr":"172.21.15.130:6831/680009774","heartbeat_front_addr":"172.21.15.130:6829/680009774","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.505543+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.394383+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.456652+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.529168+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.235414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.392158+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.347556+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.432039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:00:40.066 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.059+0000 7f52dccc0640 1 -- 172.21.15.62:0/558258182 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f52b8066470 msgr2=0x7f52b8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:40.066 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.059+0000 7f52dccc0640 1 --2- 172.21.15.62:0/558258182 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f52b8066470 0x7f52b8068930 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f52c80af000 tx=0x7f52c801af20 comp rx=0 tx=0).stop 2023-10-08T12:00:40.066 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.059+0000 7f52dccc0640 1 -- 172.21.15.62:0/558258182 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52d80bc670 msgr2=0x7f52d80b7ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:40.066 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.059+0000 7f52dccc0640 1 --2- 172.21.15.62:0/558258182 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52d80bc670 0x7f52d80b7ae0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f52c000e9f0 tx=0x7f52c000eeb0 comp rx=0 tx=0).stop 2023-10-08T12:00:40.066 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.063+0000 7f52dccc0640 1 -- 172.21.15.62:0/558258182 shutdown_connections 2023-10-08T12:00:40.066 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.063+0000 7f52dccc0640 1 --2- 172.21.15.62:0/558258182 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f52b8066470 0x7f52b8068930 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:40.066 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.063+0000 7f52dccc0640 1 --2- 172.21.15.62:0/558258182 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f52d80bdba0 0x7f52d81e2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:40.066 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.063+0000 7f52dccc0640 1 --2- 172.21.15.62:0/558258182 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52d80bc670 0x7f52d80b7ae0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:40.066 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.063+0000 7f52dccc0640 1 --2- 172.21.15.62:0/558258182 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f52d806a520 0x7f52d8141b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:40.066 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.063+0000 7f52dccc0640 1 -- 172.21.15.62:0/558258182 >> 172.21.15.62:0/558258182 conn(0x7f52d80a0540 msgr2=0x7f52d80a0920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:40.067 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.063+0000 7f52dccc0640 1 -- 172.21.15.62:0/558258182 shutdown_connections 2023-10-08T12:00:40.067 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.063+0000 7f52dccc0640 1 -- 172.21.15.62:0/558258182 wait complete. 2023-10-08T12:00:40.081 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T12:00:07.189433+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T12:00:17.895548+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T12:00:18.871217+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T12:00:40.082 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T12:00:40.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.207+0000 7f280fdda640 1 -- 172.21.15.62:0/381242009 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f280814a7f0 msgr2=0x7f28081526e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:40.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.207+0000 7f280fdda640 1 --2- 172.21.15.62:0/381242009 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f280814a7f0 0x7f28081526e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2800009840 tx=0x7f280001c7c0 comp rx=0 tx=0).stop 2023-10-08T12:00:40.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.207+0000 7f280fdda640 1 -- 172.21.15.62:0/381242009 shutdown_connections 2023-10-08T12:00:40.212 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.207+0000 7f280fdda640 1 --2- 172.21.15.62:0/381242009 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f280814a7f0 0x7f28081526e0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:40.212 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.207+0000 7f280fdda640 1 -- 172.21.15.62:0/381242009 >> 172.21.15.62:0/381242009 conn(0x7f280809e700 msgr2=0x7f280809eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:40.212 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.207+0000 7f280fdda640 1 -- 172.21.15.62:0/381242009 shutdown_connections 2023-10-08T12:00:40.212 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.207+0000 7f280fdda640 1 -- 172.21.15.62:0/381242009 wait complete. 2023-10-08T12:00:40.214 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.207+0000 7f280fdda640 1 Processor -- start 2023-10-08T12:00:40.214 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.207+0000 7f280fdda640 1 -- start start 2023-10-08T12:00:40.214 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.207+0000 7f280fdda640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28080719c0 0x7f2808144f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:40.214 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.207+0000 7f280fdda640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f280814a3a0 0x7f2808145d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:40.214 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.207+0000 7f280fdda640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f280814a7f0 0x7f28081e3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:40.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.207+0000 7f280fdda640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2808145440 con 0x7f28080719c0 2023-10-08T12:00:40.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.207+0000 7f280fdda640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28081e3360 con 0x7f280814a3a0 2023-10-08T12:00:40.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.207+0000 7f280fdda640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28080a1200 con 0x7f280814a7f0 2023-10-08T12:00:40.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.207+0000 7f280db76640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28080719c0 0x7f2808144f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:40.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.207+0000 7f280db76640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28080719c0 0x7f2808144f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43670/0 (socket says 172.21.15.62:43670) 2023-10-08T12:00:40.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.207+0000 7f280db76640 1 -- 172.21.15.62:0/1097567778 learned_addr learned my addr 172.21.15.62:0/1097567778 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:40.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.207+0000 7f280e377640 1 --2- 172.21.15.62:0/1097567778 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f280814a7f0 0x7f28081e3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:40.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.207+0000 7f280d375640 1 --2- 172.21.15.62:0/1097567778 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f280814a3a0 0x7f2808145d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:40.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.207+0000 7f280db76640 1 -- 172.21.15.62:0/1097567778 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f280814a7f0 msgr2=0x7f28081e3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:40.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.207+0000 7f280db76640 1 --2- 172.21.15.62:0/1097567778 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f280814a7f0 0x7f28081e3b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:40.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.207+0000 7f280db76640 1 -- 172.21.15.62:0/1097567778 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f280814a3a0 msgr2=0x7f2808145d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:40.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.207+0000 7f280db76640 1 --2- 172.21.15.62:0/1097567778 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f280814a3a0 0x7f2808145d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:40.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.207+0000 7f280db76640 1 -- 172.21.15.62:0/1097567778 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28000094a0 con 0x7f28080719c0 2023-10-08T12:00:40.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.207+0000 7f280db76640 1 --2- 172.21.15.62:0/1097567778 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28080719c0 0x7f2808144f00 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f280400c7c0 tx=0x7f280400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:40.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.211+0000 7f27fe7fc640 1 -- 172.21.15.62:0/1097567778 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f280400aa50 con 0x7f28080719c0 2023-10-08T12:00:40.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.211+0000 7f27fe7fc640 1 -- 172.21.15.62:0/1097567778 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f280400aca0 con 0x7f28080719c0 2023-10-08T12:00:40.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.211+0000 7f280fdda640 1 -- 172.21.15.62:0/1097567778 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28081e3620 con 0x7f28080719c0 2023-10-08T12:00:40.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.211+0000 7f27fe7fc640 1 -- 172.21.15.62:0/1097567778 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2804012680 con 0x7f28080719c0 2023-10-08T12:00:40.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.211+0000 7f280fdda640 1 -- 172.21.15.62:0/1097567778 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28081e4080 con 0x7f28080719c0 2023-10-08T12:00:40.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.211+0000 7f280fdda640 1 -- 172.21.15.62:0/1097567778 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28080b8620 con 0x7f28080719c0 2023-10-08T12:00:40.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.211+0000 7f27fe7fc640 1 -- 172.21.15.62:0/1097567778 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f280401b400 con 0x7f28080719c0 2023-10-08T12:00:40.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.211+0000 7f27fe7fc640 1 --2- 172.21.15.62:0/1097567778 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f27ec066470 0x7f27ec068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:40.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.211+0000 7f27fe7fc640 1 -- 172.21.15.62:0/1097567778 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f28040846c0 con 0x7f28080719c0 2023-10-08T12:00:40.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.211+0000 7f280d375640 1 --2- 172.21.15.62:0/1097567778 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f27ec066470 0x7f27ec068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:40.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.211+0000 7f280d375640 1 --2- 172.21.15.62:0/1097567778 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f27ec066470 0x7f27ec068930 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f27f8007fd0 tx=0x7f27f8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:40.219 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.215+0000 7f27fe7fc640 1 -- 172.21.15.62:0/1097567778 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2804051b40 con 0x7f28080719c0 2023-10-08T12:00:40.373 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.367+0000 7f280fdda640 1 -- 172.21.15.62:0/1097567778 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2808066a30 con 0x7f28080719c0 2023-10-08T12:00:40.374 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.371+0000 7f27fe7fc640 1 -- 172.21.15.62:0/1097567778 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2804055160 con 0x7f28080719c0 2023-10-08T12:00:40.374 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2023-10-08T12:00:40.376 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.371+0000 7f280fdda640 1 -- 172.21.15.62:0/1097567778 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f27ec066470 msgr2=0x7f27ec068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:40.377 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.371+0000 7f280fdda640 1 --2- 172.21.15.62:0/1097567778 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f27ec066470 0x7f27ec068930 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f27f8007fd0 tx=0x7f27f8009040 comp rx=0 tx=0).stop 2023-10-08T12:00:40.377 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.371+0000 7f280fdda640 1 -- 172.21.15.62:0/1097567778 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28080719c0 msgr2=0x7f2808144f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:40.377 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.371+0000 7f280fdda640 1 --2- 172.21.15.62:0/1097567778 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28080719c0 0x7f2808144f00 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f280400c7c0 tx=0x7f280400cc80 comp rx=0 tx=0).stop 2023-10-08T12:00:40.377 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.371+0000 7f280fdda640 1 -- 172.21.15.62:0/1097567778 shutdown_connections 2023-10-08T12:00:40.377 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.371+0000 7f280fdda640 1 --2- 172.21.15.62:0/1097567778 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f27ec066470 0x7f27ec068930 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:40.377 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.371+0000 7f280fdda640 1 --2- 172.21.15.62:0/1097567778 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f280814a7f0 0x7f28081e3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:40.377 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.371+0000 7f280fdda640 1 --2- 172.21.15.62:0/1097567778 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f280814a3a0 0x7f2808145d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:40.378 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.371+0000 7f280fdda640 1 --2- 172.21.15.62:0/1097567778 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28080719c0 0x7f2808144f00 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:40.378 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.371+0000 7f280fdda640 1 -- 172.21.15.62:0/1097567778 >> 172.21.15.62:0/1097567778 conn(0x7f280809e700 msgr2=0x7f28080b9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:40.378 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.371+0000 7f280fdda640 1 -- 172.21.15.62:0/1097567778 shutdown_connections 2023-10-08T12:00:40.378 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.371+0000 7f280fdda640 1 -- 172.21.15.62:0/1097567778 wait complete. 2023-10-08T12:00:40.392 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T12:00:40.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.507+0000 7f92504cd640 1 -- 172.21.15.62:0/541090434 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9248071410 msgr2=0x7f92480b6ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:40.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.507+0000 7f92504cd640 1 --2- 172.21.15.62:0/541090434 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9248071410 0x7f92480b6ad0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9248071fb0 tx=0x7f924401c860 comp rx=0 tx=0).stop 2023-10-08T12:00:40.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.507+0000 7f92504cd640 1 -- 172.21.15.62:0/541090434 shutdown_connections 2023-10-08T12:00:40.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.507+0000 7f92504cd640 1 --2- 172.21.15.62:0/541090434 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9248071410 0x7f92480b6ad0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:40.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.507+0000 7f92504cd640 1 --2- 172.21.15.62:0/541090434 >> v2:172.21.15.130:3300/0 conn(0x7f9248147920 0x7f92480b8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:40.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.507+0000 7f92504cd640 1 -- 172.21.15.62:0/541090434 >> 172.21.15.62:0/541090434 conn(0x7f924809c520 msgr2=0x7f924809c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:40.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.507+0000 7f92504cd640 1 -- 172.21.15.62:0/541090434 shutdown_connections 2023-10-08T12:00:40.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.507+0000 7f92504cd640 1 -- 172.21.15.62:0/541090434 wait complete. 2023-10-08T12:00:40.513 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.507+0000 7f92504cd640 1 Processor -- start 2023-10-08T12:00:40.514 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.507+0000 7f92504cd640 1 -- start start 2023-10-08T12:00:40.514 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.507+0000 7f92504cd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9248071410 0x7f92481e38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:40.514 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.507+0000 7f92504cd640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f92480b9260 0x7f924814a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:40.514 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.507+0000 7f92504cd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9248147920 0x7f92481452e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:40.515 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.507+0000 7f92504cd640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f924809deb0 con 0x7f9248071410 2023-10-08T12:00:40.515 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.507+0000 7f92504cd640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f924814abc0 con 0x7f9248147920 2023-10-08T12:00:40.515 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.507+0000 7f92504cd640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9248144b20 con 0x7f92480b9260 2023-10-08T12:00:40.516 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.507+0000 7f924e269640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9248071410 0x7f92481e38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:40.516 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.507+0000 7f924e269640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9248071410 0x7f92481e38b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43698/0 (socket says 172.21.15.62:43698) 2023-10-08T12:00:40.516 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.507+0000 7f924e269640 1 -- 172.21.15.62:0/244877505 learned_addr learned my addr 172.21.15.62:0/244877505 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:40.516 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.507+0000 7f924e269640 1 -- 172.21.15.62:0/244877505 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f92480b9260 msgr2=0x7f924814a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:40.517 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.507+0000 7f924e269640 1 --2- 172.21.15.62:0/244877505 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f92480b9260 0x7f924814a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:40.517 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.507+0000 7f924e269640 1 -- 172.21.15.62:0/244877505 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9248147920 msgr2=0x7f92481452e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:40.517 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.507+0000 7f924e269640 1 --2- 172.21.15.62:0/244877505 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9248147920 0x7f92481452e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:40.517 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.507+0000 7f924e269640 1 -- 172.21.15.62:0/244877505 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9244009560 con 0x7f9248071410 2023-10-08T12:00:40.518 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.507+0000 7f924e269640 1 --2- 172.21.15.62:0/244877505 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9248071410 0x7f92481e38b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f924000c7c0 tx=0x7f924000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:40.518 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.507+0000 7f923affd640 1 -- 172.21.15.62:0/244877505 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f924000aa50 con 0x7f9248071410 2023-10-08T12:00:40.519 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.507+0000 7f923affd640 1 -- 172.21.15.62:0/244877505 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f924000aca0 con 0x7f9248071410 2023-10-08T12:00:40.519 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.507+0000 7f92504cd640 1 -- 172.21.15.62:0/244877505 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92481e3f30 con 0x7f9248071410 2023-10-08T12:00:40.519 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.507+0000 7f923affd640 1 -- 172.21.15.62:0/244877505 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9240012680 con 0x7f9248071410 2023-10-08T12:00:40.519 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.507+0000 7f92504cd640 1 -- 172.21.15.62:0/244877505 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9248144dc0 con 0x7f9248071410 2023-10-08T12:00:40.520 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.507+0000 7f92504cd640 1 -- 172.21.15.62:0/244877505 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92480b5be0 con 0x7f9248071410 2023-10-08T12:00:40.520 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.511+0000 7f923affd640 1 -- 172.21.15.62:0/244877505 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f924001b400 con 0x7f9248071410 2023-10-08T12:00:40.521 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.511+0000 7f923affd640 1 --2- 172.21.15.62:0/244877505 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f922c0664a0 0x7f922c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:40.521 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.511+0000 7f923affd640 1 -- 172.21.15.62:0/244877505 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f92400842b0 con 0x7f9248071410 2023-10-08T12:00:40.521 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.511+0000 7f924da68640 1 --2- 172.21.15.62:0/244877505 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f922c0664a0 0x7f922c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:40.521 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.511+0000 7f924da68640 1 --2- 172.21.15.62:0/244877505 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f922c0664a0 0x7f922c068960 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f924806c690 tx=0x7f923c005b60 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:40.521 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.515+0000 7f923affd640 1 -- 172.21.15.62:0/244877505 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f92400517c0 con 0x7f9248071410 2023-10-08T12:00:40.666 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.663+0000 7f92504cd640 1 -- 172.21.15.62:0/244877505 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9248144fe0 con 0x7f9248071410 2023-10-08T12:00:40.666 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.663+0000 7f923affd640 1 -- 172.21.15.62:0/244877505 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9240054de0 con 0x7f9248071410 2023-10-08T12:00:40.667 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-10-08T12:00:40.669 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.663+0000 7f92504cd640 1 -- 172.21.15.62:0/244877505 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f922c0664a0 msgr2=0x7f922c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:40.669 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.663+0000 7f92504cd640 1 --2- 172.21.15.62:0/244877505 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f922c0664a0 0x7f922c068960 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f924806c690 tx=0x7f923c005b60 comp rx=0 tx=0).stop 2023-10-08T12:00:40.669 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.663+0000 7f92504cd640 1 -- 172.21.15.62:0/244877505 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9248071410 msgr2=0x7f92481e38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:40.669 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.663+0000 7f92504cd640 1 --2- 172.21.15.62:0/244877505 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9248071410 0x7f92481e38b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f924000c7c0 tx=0x7f924000cc80 comp rx=0 tx=0).stop 2023-10-08T12:00:40.669 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.663+0000 7f92504cd640 1 -- 172.21.15.62:0/244877505 shutdown_connections 2023-10-08T12:00:40.669 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.663+0000 7f92504cd640 1 --2- 172.21.15.62:0/244877505 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f922c0664a0 0x7f922c068960 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:40.669 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.663+0000 7f92504cd640 1 --2- 172.21.15.62:0/244877505 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f92480b9260 0x7f924814a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:40.669 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.663+0000 7f92504cd640 1 --2- 172.21.15.62:0/244877505 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9248147920 0x7f92481452e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:40.669 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.663+0000 7f92504cd640 1 --2- 172.21.15.62:0/244877505 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9248071410 0x7f92481e38b0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:40.670 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.663+0000 7f92504cd640 1 -- 172.21.15.62:0/244877505 >> 172.21.15.62:0/244877505 conn(0x7f924809c520 msgr2=0x7f924809b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:40.670 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.663+0000 7f92504cd640 1 -- 172.21.15.62:0/244877505 shutdown_connections 2023-10-08T12:00:40.670 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.663+0000 7f92504cd640 1 -- 172.21.15.62:0/244877505 wait complete. 2023-10-08T12:00:40.684 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T12:00:40.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.811+0000 7f0f7d828640 1 -- 172.21.15.62:0/4266792900 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0f600062a0 msgr2=0x7f0f6000caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:40.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.811+0000 7f0f7d828640 1 --2- 172.21.15.62:0/4266792900 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0f600062a0 0x7f0f6000caa0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f0f70001da0 tx=0x7f0f7001cb20 comp rx=0 tx=0).stop 2023-10-08T12:00:40.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.811+0000 7f0f7d828640 1 -- 172.21.15.62:0/4266792900 shutdown_connections 2023-10-08T12:00:40.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.811+0000 7f0f7d828640 1 --2- 172.21.15.62:0/4266792900 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0f600062a0 0x7f0f6000caa0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:40.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.811+0000 7f0f7d828640 1 -- 172.21.15.62:0/4266792900 >> 172.21.15.62:0/4266792900 conn(0x7f0f7809c520 msgr2=0x7f0f7809c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:40.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.811+0000 7f0f7d828640 1 -- 172.21.15.62:0/4266792900 shutdown_connections 2023-10-08T12:00:40.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.811+0000 7f0f7d828640 1 -- 172.21.15.62:0/4266792900 wait complete. 2023-10-08T12:00:40.818 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.811+0000 7f0f7d828640 1 Processor -- start 2023-10-08T12:00:40.818 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.811+0000 7f0f7d828640 1 -- start start 2023-10-08T12:00:40.818 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.811+0000 7f0f7d828640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0f600062a0 0x7f0f7813e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:40.818 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.811+0000 7f0f7d828640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0f78099490 0x7f0f781df8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:40.819 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.811+0000 7f0f7d828640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0f78140530 0x7f0f78140990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:40.819 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.811+0000 7f0f7d828640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7813e150 con 0x7f0f600062a0 2023-10-08T12:00:40.819 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.811+0000 7f0f7d828640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f781df420 con 0x7f0f78140530 2023-10-08T12:00:40.819 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.811+0000 7f0f7d828640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f780998f0 con 0x7f0f78099490 2023-10-08T12:00:40.819 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.811+0000 7f0f76ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0f600062a0 0x7f0f7813e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:40.819 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.811+0000 7f0f76ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0f600062a0 0x7f0f7813e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43720/0 (socket says 172.21.15.62:43720) 2023-10-08T12:00:40.819 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.811+0000 7f0f76ffd640 1 -- 172.21.15.62:0/4078366980 learned_addr learned my addr 172.21.15.62:0/4078366980 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:40.819 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.811+0000 7f0f767fc640 1 --2- 172.21.15.62:0/4078366980 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0f78099490 0x7f0f781df8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:40.819 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.811+0000 7f0f777fe640 1 --2- 172.21.15.62:0/4078366980 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0f78140530 0x7f0f78140990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:40.819 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.815+0000 7f0f76ffd640 1 -- 172.21.15.62:0/4078366980 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0f78099490 msgr2=0x7f0f781df8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:40.819 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.815+0000 7f0f76ffd640 1 --2- 172.21.15.62:0/4078366980 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0f78099490 0x7f0f781df8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:40.819 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.815+0000 7f0f76ffd640 1 -- 172.21.15.62:0/4078366980 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0f78140530 msgr2=0x7f0f78140990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:40.820 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.815+0000 7f0f76ffd640 1 --2- 172.21.15.62:0/4078366980 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0f78140530 0x7f0f78140990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:40.820 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.815+0000 7f0f76ffd640 1 -- 172.21.15.62:0/4078366980 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f7813d7a0 con 0x7f0f600062a0 2023-10-08T12:00:40.820 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.815+0000 7f0f76ffd640 1 --2- 172.21.15.62:0/4078366980 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0f600062a0 0x7f0f7813e460 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0f68000fc0 tx=0x7f0f6800df90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:40.820 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.815+0000 7f0f5ffff640 1 -- 172.21.15.62:0/4078366980 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f68004230 con 0x7f0f600062a0 2023-10-08T12:00:40.820 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.815+0000 7f0f5ffff640 1 -- 172.21.15.62:0/4078366980 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0f68004480 con 0x7f0f600062a0 2023-10-08T12:00:40.820 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.815+0000 7f0f7d828640 1 -- 172.21.15.62:0/4078366980 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f781df0b0 con 0x7f0f600062a0 2023-10-08T12:00:40.820 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.815+0000 7f0f5ffff640 1 -- 172.21.15.62:0/4078366980 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f68011900 con 0x7f0f600062a0 2023-10-08T12:00:40.820 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.815+0000 7f0f7d828640 1 -- 172.21.15.62:0/4078366980 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f781dfdf0 con 0x7f0f600062a0 2023-10-08T12:00:40.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.815+0000 7f0f7d828640 1 -- 172.21.15.62:0/4078366980 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f780b5440 con 0x7f0f600062a0 2023-10-08T12:00:40.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.815+0000 7f0f5ffff640 1 -- 172.21.15.62:0/4078366980 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f0f68011a60 con 0x7f0f600062a0 2023-10-08T12:00:40.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.815+0000 7f0f5ffff640 1 --2- 172.21.15.62:0/4078366980 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f0f640664a0 0x7f0f64068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:40.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.815+0000 7f0f5ffff640 1 -- 172.21.15.62:0/4078366980 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0f68087170 con 0x7f0f600062a0 2023-10-08T12:00:40.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.815+0000 7f0f767fc640 1 --2- 172.21.15.62:0/4078366980 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f0f640664a0 0x7f0f64068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:40.822 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.815+0000 7f0f767fc640 1 --2- 172.21.15.62:0/4078366980 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f0f640664a0 0x7f0f64068960 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0f780a09b0 tx=0x7f0f6c0091e0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:40.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.819+0000 7f0f5ffff640 1 -- 172.21.15.62:0/4078366980 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0f68054560 con 0x7f0f600062a0 2023-10-08T12:00:40.980 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.975+0000 7f0f7d828640 1 -- 172.21.15.62:0/4078366980 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0f7804da80 con 0x7f0f600062a0 2023-10-08T12:00:40.981 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.975+0000 7f0f5ffff640 1 -- 172.21.15.62:0/4078366980 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0f68020020 con 0x7f0f600062a0 2023-10-08T12:00:40.981 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 64 2023-10-08T12:00:40.983 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.979+0000 7f0f7d828640 1 -- 172.21.15.62:0/4078366980 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f0f640664a0 msgr2=0x7f0f64068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:40.983 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.979+0000 7f0f7d828640 1 --2- 172.21.15.62:0/4078366980 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f0f640664a0 0x7f0f64068960 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0f780a09b0 tx=0x7f0f6c0091e0 comp rx=0 tx=0).stop 2023-10-08T12:00:40.984 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.979+0000 7f0f7d828640 1 -- 172.21.15.62:0/4078366980 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0f600062a0 msgr2=0x7f0f7813e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:40.984 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.979+0000 7f0f7d828640 1 --2- 172.21.15.62:0/4078366980 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0f600062a0 0x7f0f7813e460 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0f68000fc0 tx=0x7f0f6800df90 comp rx=0 tx=0).stop 2023-10-08T12:00:40.984 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.979+0000 7f0f7d828640 1 -- 172.21.15.62:0/4078366980 shutdown_connections 2023-10-08T12:00:40.984 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.979+0000 7f0f7d828640 1 --2- 172.21.15.62:0/4078366980 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f0f640664a0 0x7f0f64068960 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:40.985 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.979+0000 7f0f7d828640 1 --2- 172.21.15.62:0/4078366980 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0f78099490 0x7f0f781df8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:40.985 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.979+0000 7f0f7d828640 1 --2- 172.21.15.62:0/4078366980 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0f78140530 0x7f0f78140990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:40.985 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.979+0000 7f0f7d828640 1 --2- 172.21.15.62:0/4078366980 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0f600062a0 0x7f0f7813e460 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:40.985 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.979+0000 7f0f7d828640 1 -- 172.21.15.62:0/4078366980 >> 172.21.15.62:0/4078366980 conn(0x7f0f7809c520 msgr2=0x7f0f780b7170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:40.985 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.979+0000 7f0f7d828640 1 -- 172.21.15.62:0/4078366980 shutdown_connections 2023-10-08T12:00:40.986 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:40.979+0000 7f0f7d828640 1 -- 172.21.15.62:0/4078366980 wait complete. 2023-10-08T12:00:41.068 INFO:tasks.cephfs_test_runner:Starting test: test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt) 2023-10-08T12:00:41.068 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:00:41.200 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.195+0000 7fdcb5967640 1 -- 172.21.15.62:0/2168315072 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdcb00b8bb0 msgr2=0x7fdcb00bbd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:41.200 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.195+0000 7fdcb5967640 1 --2- 172.21.15.62:0/2168315072 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdcb00b8bb0 0x7fdcb00bbd60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fdca0009900 tx=0x7fdca001c890 comp rx=0 tx=0).stop 2023-10-08T12:00:41.200 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.195+0000 7fdcb5967640 1 -- 172.21.15.62:0/2168315072 shutdown_connections 2023-10-08T12:00:41.200 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.195+0000 7fdcb5967640 1 --2- 172.21.15.62:0/2168315072 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdcb014ace0 0x7fdcb0151aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:41.201 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.195+0000 7fdcb5967640 1 --2- 172.21.15.62:0/2168315072 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdcb00b8bb0 0x7fdcb00bbd60 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:41.201 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.195+0000 7fdcb5967640 1 -- 172.21.15.62:0/2168315072 >> 172.21.15.62:0/2168315072 conn(0x7fdcb009e540 msgr2=0x7fdcb009e950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:41.201 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.195+0000 7fdcb5967640 1 -- 172.21.15.62:0/2168315072 shutdown_connections 2023-10-08T12:00:41.201 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.195+0000 7fdcb5967640 1 -- 172.21.15.62:0/2168315072 wait complete. 2023-10-08T12:00:41.203 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.195+0000 7fdcb5967640 1 Processor -- start 2023-10-08T12:00:41.203 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.195+0000 7fdcb5967640 1 -- start start 2023-10-08T12:00:41.203 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.199+0000 7fdcb5967640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdcb00b8bb0 0x7fdcb0144a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:41.203 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.199+0000 7fdcb5967640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdcb00bc2a0 0x7fdcb01e0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:41.204 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.199+0000 7fdcb5967640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdcb014ace0 0x7fdcb0141920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:41.204 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.199+0000 7fdcb5967640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb0144f40 con 0x7fdcb014ace0 2023-10-08T12:00:41.204 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.199+0000 7fdcb5967640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb01e0a60 con 0x7fdcb00bc2a0 2023-10-08T12:00:41.204 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.199+0000 7fdcb5967640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb0147820 con 0x7fdcb00b8bb0 2023-10-08T12:00:41.204 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.199+0000 7fdcaf7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdcb014ace0 0x7fdcb0141920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:41.204 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.199+0000 7fdcaf7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdcb014ace0 0x7fdcb0141920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43724/0 (socket says 172.21.15.62:43724) 2023-10-08T12:00:41.204 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.199+0000 7fdcaf7fe640 1 -- 172.21.15.62:0/665010009 learned_addr learned my addr 172.21.15.62:0/665010009 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:41.204 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.199+0000 7fdcaeffd640 1 --2- 172.21.15.62:0/665010009 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdcb00b8bb0 0x7fdcb0144a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:41.204 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.199+0000 7fdcae7fc640 1 --2- 172.21.15.62:0/665010009 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdcb00bc2a0 0x7fdcb01e0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:41.204 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.199+0000 7fdcaf7fe640 1 -- 172.21.15.62:0/665010009 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdcb00b8bb0 msgr2=0x7fdcb0144a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:41.205 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.199+0000 7fdcaf7fe640 1 --2- 172.21.15.62:0/665010009 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdcb00b8bb0 0x7fdcb0144a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:41.205 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.199+0000 7fdcaf7fe640 1 -- 172.21.15.62:0/665010009 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdcb00bc2a0 msgr2=0x7fdcb01e0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:41.205 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.199+0000 7fdcaf7fe640 1 --2- 172.21.15.62:0/665010009 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdcb00bc2a0 0x7fdcb01e0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:41.205 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.199+0000 7fdcaf7fe640 1 -- 172.21.15.62:0/665010009 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca0009560 con 0x7fdcb014ace0 2023-10-08T12:00:41.205 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.199+0000 7fdcae7fc640 1 --2- 172.21.15.62:0/665010009 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdcb00bc2a0 0x7fdcb01e0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:00:41.205 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.199+0000 7fdcaeffd640 1 --2- 172.21.15.62:0/665010009 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdcb00b8bb0 0x7fdcb0144a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:00:41.205 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.199+0000 7fdcaf7fe640 1 --2- 172.21.15.62:0/665010009 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdcb014ace0 0x7fdcb0141920 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fdca800e9d0 tx=0x7fdca800ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:41.205 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.199+0000 7fdc97fff640 1 -- 172.21.15.62:0/665010009 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca800cde0 con 0x7fdcb014ace0 2023-10-08T12:00:41.205 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.199+0000 7fdc97fff640 1 -- 172.21.15.62:0/665010009 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fdca8004b30 con 0x7fdcb014ace0 2023-10-08T12:00:41.205 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.199+0000 7fdcb5967640 1 -- 172.21.15.62:0/665010009 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcb009aad0 con 0x7fdcb014ace0 2023-10-08T12:00:41.205 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.199+0000 7fdc97fff640 1 -- 172.21.15.62:0/665010009 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca8005020 con 0x7fdcb014ace0 2023-10-08T12:00:41.206 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.199+0000 7fdcb5967640 1 -- 172.21.15.62:0/665010009 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcb01456e0 con 0x7fdcb014ace0 2023-10-08T12:00:41.206 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.199+0000 7fdcb5967640 1 -- 172.21.15.62:0/665010009 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcb009a930 con 0x7fdcb014ace0 2023-10-08T12:00:41.206 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.199+0000 7fdc97fff640 1 -- 172.21.15.62:0/665010009 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fdca8005180 con 0x7fdcb014ace0 2023-10-08T12:00:41.207 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.199+0000 7fdc97fff640 1 --2- 172.21.15.62:0/665010009 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fdc9c066470 0x7fdc9c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:41.207 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.199+0000 7fdc97fff640 1 -- 172.21.15.62:0/665010009 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdca8014070 con 0x7fdcb014ace0 2023-10-08T12:00:41.207 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.199+0000 7fdcaeffd640 1 --2- 172.21.15.62:0/665010009 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fdc9c066470 0x7fdc9c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:41.207 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.203+0000 7fdcaeffd640 1 --2- 172.21.15.62:0/665010009 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fdc9c066470 0x7fdc9c068930 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fdca00af000 tx=0x7fdca001b0d0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:41.208 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.203+0000 7fdc97fff640 1 -- 172.21.15.62:0/665010009 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fdcb009a930 con 0x7fdcb014ace0 2023-10-08T12:00:41.363 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.359+0000 7fdcb5967640 1 -- 172.21.15.62:0/665010009 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdcb009aff0 con 0x7fdcb014ace0 2023-10-08T12:00:41.365 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.359+0000 7fdc97fff640 1 -- 172.21.15.62:0/665010009 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16481 (secure 0 0 0) 0x7fdcb009aff0 con 0x7fdcb014ace0 2023-10-08T12:00:41.365 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T12:00:41.365 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":20,"fsid":"3e777930-c2c1-4f2b-a903-c07ee4ca2c52","created":"2023-10-08T11:59:54.510229+0000","modified":"2023-10-08T12:00:21.580704+0000","last_up_change":"2023-10-08T12:00:06.783998+0000","last_in_change":"2023-10-08T11:59:57.847944+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:00:07.189433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:00:17.895548+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T12:00:18.871217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7bc3070a-7240-43d9-9ec3-397b68a37e2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6820","nonce":2227876905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6824","nonce":2227876905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6831","nonce":2227876905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6828","nonce":2227876905}]},"public_addr":"172.21.15.62:6820/2227876905","cluster_addr":"172.21.15.62:6824/2227876905","heartbeat_back_addr":"172.21.15.62:6831/2227876905","heartbeat_front_addr":"172.21.15.62:6828/2227876905","state":["exists","up"]},{"osd":1,"uuid":"5e0fa1f5-9ddc-4882-b460-5578bb571003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6801","nonce":315660906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6803","nonce":315660906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6808","nonce":315660906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6805","nonce":315660906}]},"public_addr":"172.21.15.62:6801/315660906","cluster_addr":"172.21.15.62:6803/315660906","heartbeat_back_addr":"172.21.15.62:6808/315660906","heartbeat_front_addr":"172.21.15.62:6805/315660906","state":["exists","up"]},{"osd":2,"uuid":"262b5ee9-4243-4309-a14f-88ad4e8bf812","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6807","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6809","nonce":3784842938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6811","nonce":3784842938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6815","nonce":3784842938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6813","nonce":3784842938}]},"public_addr":"172.21.15.62:6809/3784842938","cluster_addr":"172.21.15.62:6811/3784842938","heartbeat_back_addr":"172.21.15.62:6815/3784842938","heartbeat_front_addr":"172.21.15.62:6813/3784842938","state":["exists","up"]},{"osd":3,"uuid":"1770bdb8-c12b-43b1-aaab-1d6b6fd18f4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6817","nonce":3385303160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6821","nonce":3385303160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6827","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6829","nonce":3385303160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6823","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6825","nonce":3385303160}]},"public_addr":"172.21.15.62:6817/3385303160","cluster_addr":"172.21.15.62:6821/3385303160","heartbeat_back_addr":"172.21.15.62:6829/3385303160","heartbeat_front_addr":"172.21.15.62:6825/3385303160","state":["exists","up"]},{"osd":4,"uuid":"74c73631-9351-494a-8246-28ee86e9f862","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6807","nonce":1174056987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6809","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6811","nonce":1174056987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6820","nonce":1174056987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6813","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6816","nonce":1174056987}]},"public_addr":"172.21.15.130:6807/1174056987","cluster_addr":"172.21.15.130:6811/1174056987","heartbeat_back_addr":"172.21.15.130:6820/1174056987","heartbeat_front_addr":"172.21.15.130:6816/1174056987","state":["exists","up"]},{"osd":5,"uuid":"1040f389-272c-41d6-ae76-70c04d09afa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6801","nonce":561928414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6803","nonce":561928414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6815","nonce":561928414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6808","nonce":561928414}]},"public_addr":"172.21.15.130:6801/561928414","cluster_addr":"172.21.15.130:6803/561928414","heartbeat_back_addr":"172.21.15.130:6815/561928414","heartbeat_front_addr":"172.21.15.130:6808/561928414","state":["exists","up"]},{"osd":6,"uuid":"178553eb-03e1-4ab8-9826-4f5997e6da0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6810","nonce":2877303015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6817","nonce":2877303015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6823","nonce":2877303015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6819","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6821","nonce":2877303015}]},"public_addr":"172.21.15.130:6810/2877303015","cluster_addr":"172.21.15.130:6817/2877303015","heartbeat_back_addr":"172.21.15.130:6823/2877303015","heartbeat_front_addr":"172.21.15.130:6821/2877303015","state":["exists","up"]},{"osd":7,"uuid":"b6581c8f-30b1-4dfd-b7b6-94b579128835","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6825","nonce":680009774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6827","nonce":680009774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6831","nonce":680009774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6829","nonce":680009774}]},"public_addr":"172.21.15.130:6825/680009774","cluster_addr":"172.21.15.130:6827/680009774","heartbeat_back_addr":"172.21.15.130:6831/680009774","heartbeat_front_addr":"172.21.15.130:6829/680009774","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.505543+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.394383+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.456652+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.529168+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.235414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.392158+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.347556+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.432039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:00:41.367 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.363+0000 7fdcb5967640 1 -- 172.21.15.62:0/665010009 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fdc9c066470 msgr2=0x7fdc9c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:41.368 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.363+0000 7fdcb5967640 1 --2- 172.21.15.62:0/665010009 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fdc9c066470 0x7fdc9c068930 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fdca00af000 tx=0x7fdca001b0d0 comp rx=0 tx=0).stop 2023-10-08T12:00:41.368 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.363+0000 7fdcb5967640 1 -- 172.21.15.62:0/665010009 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdcb014ace0 msgr2=0x7fdcb0141920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:41.368 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.363+0000 7fdcb5967640 1 --2- 172.21.15.62:0/665010009 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdcb014ace0 0x7fdcb0141920 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fdca800e9d0 tx=0x7fdca800ee90 comp rx=0 tx=0).stop 2023-10-08T12:00:41.368 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.363+0000 7fdcb5967640 1 -- 172.21.15.62:0/665010009 shutdown_connections 2023-10-08T12:00:41.368 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.363+0000 7fdcb5967640 1 --2- 172.21.15.62:0/665010009 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fdc9c066470 0x7fdc9c068930 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:41.369 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.363+0000 7fdcb5967640 1 --2- 172.21.15.62:0/665010009 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdcb014ace0 0x7fdcb0141920 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:41.369 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.363+0000 7fdcb5967640 1 --2- 172.21.15.62:0/665010009 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdcb00bc2a0 0x7fdcb01e0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:41.369 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.363+0000 7fdcb5967640 1 --2- 172.21.15.62:0/665010009 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdcb00b8bb0 0x7fdcb0144a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:41.369 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.363+0000 7fdcb5967640 1 -- 172.21.15.62:0/665010009 >> 172.21.15.62:0/665010009 conn(0x7fdcb009e540 msgr2=0x7fdcb00a01e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:41.369 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.363+0000 7fdcb5967640 1 -- 172.21.15.62:0/665010009 shutdown_connections 2023-10-08T12:00:41.369 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.363+0000 7fdcb5967640 1 -- 172.21.15.62:0/665010009 wait complete. 2023-10-08T12:00:41.382 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T12:00:07.189433+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T12:00:17.895548+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T12:00:18.871217+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T12:00:41.383 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T12:00:41.519 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.515+0000 7f2d87c89640 1 -- 172.21.15.62:0/2675563196 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d6c005010 msgr2=0x7f2d6c0058e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:41.520 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.515+0000 7f2d87c89640 1 --2- 172.21.15.62:0/2675563196 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d6c005010 0x7f2d6c0058e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f2d7000bb10 tx=0x7f2d7001cd40 comp rx=0 tx=0).stop 2023-10-08T12:00:41.520 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.515+0000 7f2d86226640 1 -- 172.21.15.62:0/2675563196 reap_dead start 2023-10-08T12:00:41.520 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.515+0000 7f2d87c89640 1 -- 172.21.15.62:0/2675563196 shutdown_connections 2023-10-08T12:00:41.520 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.515+0000 7f2d87c89640 1 -- 172.21.15.62:0/2675563196 >> 172.21.15.62:0/2675563196 conn(0x7f2d8009c520 msgr2=0x7f2d8009c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:41.520 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.515+0000 7f2d87c89640 1 -- 172.21.15.62:0/2675563196 shutdown_connections 2023-10-08T12:00:41.520 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.515+0000 7f2d87c89640 1 -- 172.21.15.62:0/2675563196 wait complete. 2023-10-08T12:00:41.522 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.515+0000 7f2d87c89640 1 Processor -- start 2023-10-08T12:00:41.522 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.515+0000 7f2d87c89640 1 -- start start 2023-10-08T12:00:41.522 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.515+0000 7f2d87c89640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d8014ec90 0x7f2d800b3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:41.522 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.515+0000 7f2d87c89640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d8014f350 0x7f2d800b24b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:41.522 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.515+0000 7f2d87c89640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2d80141a90 0x7f2d80141f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:41.522 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.515+0000 7f2d87c89640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d800b1d80 con 0x7f2d8014ec90 2023-10-08T12:00:41.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.515+0000 7f2d87c89640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d80071350 con 0x7f2d8014f350 2023-10-08T12:00:41.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.515+0000 7f2d87c89640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d80142450 con 0x7f2d80141a90 2023-10-08T12:00:41.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.515+0000 7f2d85a25640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d8014ec90 0x7f2d800b3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:41.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.515+0000 7f2d85a25640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d8014ec90 0x7f2d800b3eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43754/0 (socket says 172.21.15.62:43754) 2023-10-08T12:00:41.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.515+0000 7f2d85a25640 1 -- 172.21.15.62:0/1025456916 learned_addr learned my addr 172.21.15.62:0/1025456916 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:41.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.515+0000 7f2d85a25640 1 -- 172.21.15.62:0/1025456916 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2d80141a90 msgr2=0x7f2d80141f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:41.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.515+0000 7f2d85a25640 1 --2- 172.21.15.62:0/1025456916 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2d80141a90 0x7f2d80141f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:41.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.515+0000 7f2d85a25640 1 -- 172.21.15.62:0/1025456916 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d8014f350 msgr2=0x7f2d800b24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:41.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.515+0000 7f2d85a25640 1 --2- 172.21.15.62:0/1025456916 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d8014f350 0x7f2d800b24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:41.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.515+0000 7f2d85a25640 1 -- 172.21.15.62:0/1025456916 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d8009b2a0 con 0x7f2d8014ec90 2023-10-08T12:00:41.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.519+0000 7f2d85a25640 1 --2- 172.21.15.62:0/1025456916 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d8014ec90 0x7f2d800b3eb0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c006340 tx=0x7f2d7c003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:41.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.519+0000 7f2d767fc640 1 -- 172.21.15.62:0/1025456916 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d7c00fac0 con 0x7f2d8014ec90 2023-10-08T12:00:41.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.519+0000 7f2d767fc640 1 -- 172.21.15.62:0/1025456916 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2d7c00fc40 con 0x7f2d8014ec90 2023-10-08T12:00:41.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.519+0000 7f2d87c89640 1 -- 172.21.15.62:0/1025456916 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d8009b580 con 0x7f2d8014ec90 2023-10-08T12:00:41.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.519+0000 7f2d767fc640 1 -- 172.21.15.62:0/1025456916 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d7c011430 con 0x7f2d8014ec90 2023-10-08T12:00:41.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.519+0000 7f2d87c89640 1 -- 172.21.15.62:0/1025456916 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d800b29f0 con 0x7f2d8014ec90 2023-10-08T12:00:41.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.519+0000 7f2d87c89640 1 -- 172.21.15.62:0/1025456916 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d8004da80 con 0x7f2d8014ec90 2023-10-08T12:00:41.526 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.519+0000 7f2d767fc640 1 -- 172.21.15.62:0/1025456916 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2d7c011590 con 0x7f2d8014ec90 2023-10-08T12:00:41.526 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.519+0000 7f2d767fc640 1 --2- 172.21.15.62:0/1025456916 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f2d640664a0 0x7f2d64068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:41.526 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.519+0000 7f2d767fc640 1 -- 172.21.15.62:0/1025456916 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2d7c084ca0 con 0x7f2d8014ec90 2023-10-08T12:00:41.526 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.519+0000 7f2d85224640 1 --2- 172.21.15.62:0/1025456916 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f2d640664a0 0x7f2d64068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:41.526 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.519+0000 7f2d85224640 1 --2- 172.21.15.62:0/1025456916 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f2d640664a0 0x7f2d64068960 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2d700b0000 tx=0x7f2d6c006910 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:41.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.523+0000 7f2d767fc640 1 -- 172.21.15.62:0/1025456916 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2d7c052120 con 0x7f2d8014ec90 2023-10-08T12:00:41.695 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.691+0000 7f2d87c89640 1 -- 172.21.15.62:0/1025456916 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2d800b2160 con 0x7f2d8014ec90 2023-10-08T12:00:41.696 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.691+0000 7f2d767fc640 1 -- 172.21.15.62:0/1025456916 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2d7c015030 con 0x7f2d8014ec90 2023-10-08T12:00:41.696 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2023-10-08T12:00:41.698 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.695+0000 7f2d87c89640 1 -- 172.21.15.62:0/1025456916 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f2d640664a0 msgr2=0x7f2d64068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:41.698 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.695+0000 7f2d87c89640 1 --2- 172.21.15.62:0/1025456916 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f2d640664a0 0x7f2d64068960 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2d700b0000 tx=0x7f2d6c006910 comp rx=0 tx=0).stop 2023-10-08T12:00:41.698 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.695+0000 7f2d87c89640 1 -- 172.21.15.62:0/1025456916 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d8014ec90 msgr2=0x7f2d800b3eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:41.698 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.695+0000 7f2d87c89640 1 --2- 172.21.15.62:0/1025456916 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d8014ec90 0x7f2d800b3eb0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c006340 tx=0x7f2d7c003f90 comp rx=0 tx=0).stop 2023-10-08T12:00:41.699 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.695+0000 7f2d87c89640 1 -- 172.21.15.62:0/1025456916 shutdown_connections 2023-10-08T12:00:41.699 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.695+0000 7f2d87c89640 1 --2- 172.21.15.62:0/1025456916 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f2d640664a0 0x7f2d64068960 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:41.699 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.695+0000 7f2d87c89640 1 --2- 172.21.15.62:0/1025456916 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2d80141a90 0x7f2d80141f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:41.699 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.695+0000 7f2d87c89640 1 --2- 172.21.15.62:0/1025456916 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d8014f350 0x7f2d800b24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:41.699 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.695+0000 7f2d87c89640 1 --2- 172.21.15.62:0/1025456916 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d8014ec90 0x7f2d800b3eb0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:41.699 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.695+0000 7f2d87c89640 1 -- 172.21.15.62:0/1025456916 >> 172.21.15.62:0/1025456916 conn(0x7f2d8009c520 msgr2=0x7f2d800992a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:41.699 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.695+0000 7f2d87c89640 1 -- 172.21.15.62:0/1025456916 shutdown_connections 2023-10-08T12:00:41.699 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.695+0000 7f2d87c89640 1 -- 172.21.15.62:0/1025456916 wait complete. 2023-10-08T12:00:41.713 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T12:00:41.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.835+0000 7fdf4acd2640 1 -- 172.21.15.62:0/406729702 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdf440b9260 msgr2=0x7fdf440b8570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:41.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.835+0000 7fdf4acd2640 1 --2- 172.21.15.62:0/406729702 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdf440b9260 0x7fdf440b8570 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fdf40009900 tx=0x7fdf4001c8c0 comp rx=0 tx=0).stop 2023-10-08T12:00:41.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.835+0000 7fdf4acd2640 1 -- 172.21.15.62:0/406729702 shutdown_connections 2023-10-08T12:00:41.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.835+0000 7fdf4acd2640 1 --2- 172.21.15.62:0/406729702 >> v2:172.21.15.130:3300/0 conn(0x7fdf44071410 0x7fdf440b6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:41.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.835+0000 7fdf4acd2640 1 --2- 172.21.15.62:0/406729702 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdf440b9260 0x7fdf440b8570 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:41.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.835+0000 7fdf4acd2640 1 -- 172.21.15.62:0/406729702 >> 172.21.15.62:0/406729702 conn(0x7fdf4409c520 msgr2=0x7fdf4409c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:41.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.835+0000 7fdf4acd2640 1 -- 172.21.15.62:0/406729702 shutdown_connections 2023-10-08T12:00:41.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.835+0000 7fdf4acd2640 1 -- 172.21.15.62:0/406729702 wait complete. 2023-10-08T12:00:41.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.835+0000 7fdf4acd2640 1 Processor -- start 2023-10-08T12:00:41.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.835+0000 7fdf4acd2640 1 -- start start 2023-10-08T12:00:41.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.835+0000 7fdf4acd2640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdf44071410 0x7fdf4414a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:41.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.835+0000 7fdf4acd2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdf440b9260 0x7fdf441e3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:41.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.835+0000 7fdf4acd2640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdf44147920 0x7fdf441dfb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:41.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.835+0000 7fdf4acd2640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf441e3040 con 0x7fdf440b9260 2023-10-08T12:00:41.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.835+0000 7fdf4acd2640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf441488a0 con 0x7fdf44071410 2023-10-08T12:00:41.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.835+0000 7fdf4acd2640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf441e3300 con 0x7fdf44147920 2023-10-08T12:00:41.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.839+0000 7fdf3bfff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdf440b9260 0x7fdf441e3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:41.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.839+0000 7fdf3bfff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdf440b9260 0x7fdf441e3b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43760/0 (socket says 172.21.15.62:43760) 2023-10-08T12:00:41.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.839+0000 7fdf3bfff640 1 -- 172.21.15.62:0/4278577532 learned_addr learned my addr 172.21.15.62:0/4278577532 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:41.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.839+0000 7fdf4926f640 1 --2- 172.21.15.62:0/4278577532 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdf44147920 0x7fdf441dfb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:41.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.839+0000 7fdf48a6e640 1 --2- 172.21.15.62:0/4278577532 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdf44071410 0x7fdf4414a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:41.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.839+0000 7fdf3bfff640 1 -- 172.21.15.62:0/4278577532 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdf44147920 msgr2=0x7fdf441dfb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:41.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.839+0000 7fdf3bfff640 1 --2- 172.21.15.62:0/4278577532 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdf44147920 0x7fdf441dfb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:41.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.839+0000 7fdf3bfff640 1 -- 172.21.15.62:0/4278577532 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdf44071410 msgr2=0x7fdf4414a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:41.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.839+0000 7fdf3bfff640 1 --2- 172.21.15.62:0/4278577532 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdf44071410 0x7fdf4414a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:41.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.839+0000 7fdf3bfff640 1 -- 172.21.15.62:0/4278577532 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf40009560 con 0x7fdf440b9260 2023-10-08T12:00:41.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.839+0000 7fdf3bfff640 1 --2- 172.21.15.62:0/4278577532 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdf440b9260 0x7fdf441e3b00 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fdf3400c3c0 tx=0x7fdf3400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:41.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.839+0000 7fdf397fa640 1 -- 172.21.15.62:0/4278577532 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf340052d0 con 0x7fdf440b9260 2023-10-08T12:00:41.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.839+0000 7fdf397fa640 1 -- 172.21.15.62:0/4278577532 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fdf34003600 con 0x7fdf440b9260 2023-10-08T12:00:41.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.839+0000 7fdf397fa640 1 -- 172.21.15.62:0/4278577532 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf34003a10 con 0x7fdf440b9260 2023-10-08T12:00:41.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.839+0000 7fdf4acd2640 1 -- 172.21.15.62:0/4278577532 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf441e35e0 con 0x7fdf440b9260 2023-10-08T12:00:41.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.839+0000 7fdf4acd2640 1 -- 172.21.15.62:0/4278577532 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf44147e40 con 0x7fdf440b9260 2023-10-08T12:00:41.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.839+0000 7fdf4acd2640 1 -- 172.21.15.62:0/4278577532 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf440b5be0 con 0x7fdf440b9260 2023-10-08T12:00:41.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.839+0000 7fdf397fa640 1 -- 172.21.15.62:0/4278577532 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fdf34003b70 con 0x7fdf440b9260 2023-10-08T12:00:41.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.839+0000 7fdf397fa640 1 --2- 172.21.15.62:0/4278577532 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fdf30066470 0x7fdf30068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:41.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.839+0000 7fdf397fa640 1 -- 172.21.15.62:0/4278577532 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdf34083580 con 0x7fdf440b9260 2023-10-08T12:00:41.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.839+0000 7fdf48a6e640 1 --2- 172.21.15.62:0/4278577532 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fdf30066470 0x7fdf30068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:41.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.843+0000 7fdf48a6e640 1 --2- 172.21.15.62:0/4278577532 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fdf30066470 0x7fdf30068930 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fdf400af000 tx=0x7fdf4001b100 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:41.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.843+0000 7fdf397fa640 1 -- 172.21.15.62:0/4278577532 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fdf34050a90 con 0x7fdf440b9260 2023-10-08T12:00:41.997 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.991+0000 7fdf4acd2640 1 -- 172.21.15.62:0/4278577532 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdf441e37d0 con 0x7fdf440b9260 2023-10-08T12:00:41.998 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.995+0000 7fdf397fa640 1 -- 172.21.15.62:0/4278577532 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdf340540b0 con 0x7fdf440b9260 2023-10-08T12:00:41.998 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-10-08T12:00:42.000 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.995+0000 7fdf4acd2640 1 -- 172.21.15.62:0/4278577532 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fdf30066470 msgr2=0x7fdf30068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:42.000 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.995+0000 7fdf4acd2640 1 --2- 172.21.15.62:0/4278577532 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fdf30066470 0x7fdf30068930 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fdf400af000 tx=0x7fdf4001b100 comp rx=0 tx=0).stop 2023-10-08T12:00:42.000 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.995+0000 7fdf4acd2640 1 -- 172.21.15.62:0/4278577532 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdf440b9260 msgr2=0x7fdf441e3b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:42.000 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.995+0000 7fdf4acd2640 1 --2- 172.21.15.62:0/4278577532 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdf440b9260 0x7fdf441e3b00 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fdf3400c3c0 tx=0x7fdf3400c880 comp rx=0 tx=0).stop 2023-10-08T12:00:42.000 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.995+0000 7fdf4acd2640 1 -- 172.21.15.62:0/4278577532 shutdown_connections 2023-10-08T12:00:42.001 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.995+0000 7fdf4acd2640 1 --2- 172.21.15.62:0/4278577532 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fdf30066470 0x7fdf30068930 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:42.001 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.995+0000 7fdf4acd2640 1 --2- 172.21.15.62:0/4278577532 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdf44147920 0x7fdf441dfb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:42.001 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.995+0000 7fdf4acd2640 1 --2- 172.21.15.62:0/4278577532 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdf440b9260 0x7fdf441e3b00 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:42.001 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.995+0000 7fdf4acd2640 1 --2- 172.21.15.62:0/4278577532 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdf44071410 0x7fdf4414a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:42.001 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.995+0000 7fdf4acd2640 1 -- 172.21.15.62:0/4278577532 >> 172.21.15.62:0/4278577532 conn(0x7fdf4409c520 msgr2=0x7fdf44098df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:42.001 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.995+0000 7fdf4acd2640 1 -- 172.21.15.62:0/4278577532 shutdown_connections 2023-10-08T12:00:42.001 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:41.995+0000 7fdf4acd2640 1 -- 172.21.15.62:0/4278577532 wait complete. 2023-10-08T12:00:42.015 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T12:00:42.134 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.131+0000 7fc6f2969640 1 -- 172.21.15.62:0/1042243669 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6ec0b8650 msgr2=0x7fc6ec1538d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:42.134 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.131+0000 7fc6f2969640 1 --2- 172.21.15.62:0/1042243669 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6ec0b8650 0x7fc6ec1538d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc6e4009c80 tx=0x7fc6e401cd40 comp rx=0 tx=0).stop 2023-10-08T12:00:42.134 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.131+0000 7fc6f2969640 1 -- 172.21.15.62:0/1042243669 shutdown_connections 2023-10-08T12:00:42.135 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.131+0000 7fc6f2969640 1 --2- 172.21.15.62:0/1042243669 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6ec0b8650 0x7fc6ec1538d0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:42.135 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.131+0000 7fc6f2969640 1 --2- 172.21.15.62:0/1042243669 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc6ec0bc000 0x7fc6ec0b8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:42.135 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.131+0000 7fc6f2969640 1 -- 172.21.15.62:0/1042243669 >> 172.21.15.62:0/1042243669 conn(0x7fc6ec09e5b0 msgr2=0x7fc6ec09e9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:42.135 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.131+0000 7fc6f2969640 1 -- 172.21.15.62:0/1042243669 shutdown_connections 2023-10-08T12:00:42.135 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.131+0000 7fc6f2969640 1 -- 172.21.15.62:0/1042243669 wait complete. 2023-10-08T12:00:42.137 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.131+0000 7fc6f2969640 1 Processor -- start 2023-10-08T12:00:42.137 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.131+0000 7fc6f2969640 1 -- start start 2023-10-08T12:00:42.137 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.131+0000 7fc6f2969640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc6ec071830 0x7fc6ec0b6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:42.137 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.131+0000 7fc6f2969640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc6ec0b8650 0x7fc6ec06b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:42.137 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.131+0000 7fc6f2969640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6ec13f8e0 0x7fc6ec13fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:42.137 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.131+0000 7fc6f2969640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ec14cd00 con 0x7fc6ec13f8e0 2023-10-08T12:00:42.137 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.131+0000 7fc6f2969640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ec0b6ad0 con 0x7fc6ec071830 2023-10-08T12:00:42.137 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.131+0000 7fc6f2969640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ec06ac20 con 0x7fc6ec0b8650 2023-10-08T12:00:42.138 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.131+0000 7fc6f0f06640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6ec13f8e0 0x7fc6ec13fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:42.138 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.131+0000 7fc6f0f06640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6ec13f8e0 0x7fc6ec13fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43774/0 (socket says 172.21.15.62:43774) 2023-10-08T12:00:42.138 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.131+0000 7fc6f0f06640 1 -- 172.21.15.62:0/3862255574 learned_addr learned my addr 172.21.15.62:0/3862255574 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:42.138 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.131+0000 7fc6eb7fe640 1 --2- 172.21.15.62:0/3862255574 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc6ec0b8650 0x7fc6ec06b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:42.138 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.131+0000 7fc6ebfff640 1 --2- 172.21.15.62:0/3862255574 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc6ec071830 0x7fc6ec0b6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:42.138 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.131+0000 7fc6f0f06640 1 -- 172.21.15.62:0/3862255574 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc6ec0b8650 msgr2=0x7fc6ec06b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:42.138 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.131+0000 7fc6f0f06640 1 --2- 172.21.15.62:0/3862255574 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc6ec0b8650 0x7fc6ec06b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:42.138 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.131+0000 7fc6f0f06640 1 -- 172.21.15.62:0/3862255574 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc6ec071830 msgr2=0x7fc6ec0b6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:42.138 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.131+0000 7fc6f0f06640 1 --2- 172.21.15.62:0/3862255574 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc6ec071830 0x7fc6ec0b6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:42.138 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.131+0000 7fc6f0f06640 1 -- 172.21.15.62:0/3862255574 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e40098e0 con 0x7fc6ec13f8e0 2023-10-08T12:00:42.138 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.131+0000 7fc6f0f06640 1 --2- 172.21.15.62:0/3862255574 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6ec13f8e0 0x7fc6ec13fd70 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc6e4009bd0 tx=0x7fc6e4003cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:42.139 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.131+0000 7fc6e8ff9640 1 -- 172.21.15.62:0/3862255574 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e4004e60 con 0x7fc6ec13f8e0 2023-10-08T12:00:42.139 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.131+0000 7fc6e8ff9640 1 -- 172.21.15.62:0/3862255574 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc6e40ad790 con 0x7fc6ec13f8e0 2023-10-08T12:00:42.139 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.131+0000 7fc6f2969640 1 -- 172.21.15.62:0/3862255574 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6ec14c6d0 con 0x7fc6ec13f8e0 2023-10-08T12:00:42.139 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.131+0000 7fc6e8ff9640 1 -- 172.21.15.62:0/3862255574 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e40adba0 con 0x7fc6ec13f8e0 2023-10-08T12:00:42.139 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.131+0000 7fc6f2969640 1 -- 172.21.15.62:0/3862255574 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6ec06b620 con 0x7fc6ec13f8e0 2023-10-08T12:00:42.140 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.135+0000 7fc6f2969640 1 -- 172.21.15.62:0/3862255574 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6ec14ce40 con 0x7fc6ec13f8e0 2023-10-08T12:00:42.140 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.135+0000 7fc6e8ff9640 1 -- 172.21.15.62:0/3862255574 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc6e40b4040 con 0x7fc6ec13f8e0 2023-10-08T12:00:42.140 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.135+0000 7fc6e8ff9640 1 --2- 172.21.15.62:0/3862255574 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fc6d8066470 0x7fc6d8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:42.140 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.135+0000 7fc6e8ff9640 1 -- 172.21.15.62:0/3862255574 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc6e411e110 con 0x7fc6ec13f8e0 2023-10-08T12:00:42.140 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.135+0000 7fc6ebfff640 1 --2- 172.21.15.62:0/3862255574 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fc6d8066470 0x7fc6d8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:42.140 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.135+0000 7fc6ebfff640 1 --2- 172.21.15.62:0/3862255574 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fc6d8066470 0x7fc6d8068930 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc004e30 tx=0x7fc6dc009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:42.142 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.139+0000 7fc6e8ff9640 1 -- 172.21.15.62:0/3862255574 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc6ec14ce40 con 0x7fc6ec13f8e0 2023-10-08T12:00:42.293 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.287+0000 7fc6f2969640 1 -- 172.21.15.62:0/3862255574 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc6ec14ce40 con 0x7fc6ec13f8e0 2023-10-08T12:00:42.294 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.291+0000 7fc6e8ff9640 1 -- 172.21.15.62:0/3862255574 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc6e40b2020 con 0x7fc6ec13f8e0 2023-10-08T12:00:42.294 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 64 2023-10-08T12:00:42.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.291+0000 7fc6f2969640 1 -- 172.21.15.62:0/3862255574 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fc6d8066470 msgr2=0x7fc6d8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:42.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.291+0000 7fc6f2969640 1 --2- 172.21.15.62:0/3862255574 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fc6d8066470 0x7fc6d8068930 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc004e30 tx=0x7fc6dc009040 comp rx=0 tx=0).stop 2023-10-08T12:00:42.297 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.291+0000 7fc6f2969640 1 -- 172.21.15.62:0/3862255574 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6ec13f8e0 msgr2=0x7fc6ec13fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:42.297 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.291+0000 7fc6f2969640 1 --2- 172.21.15.62:0/3862255574 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6ec13f8e0 0x7fc6ec13fd70 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc6e4009bd0 tx=0x7fc6e4003cf0 comp rx=0 tx=0).stop 2023-10-08T12:00:42.297 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.291+0000 7fc6f2969640 1 -- 172.21.15.62:0/3862255574 shutdown_connections 2023-10-08T12:00:42.297 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.291+0000 7fc6f2969640 1 --2- 172.21.15.62:0/3862255574 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fc6d8066470 0x7fc6d8068930 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:42.297 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.291+0000 7fc6f2969640 1 --2- 172.21.15.62:0/3862255574 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc6ec0b8650 0x7fc6ec06b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:42.297 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.291+0000 7fc6f2969640 1 --2- 172.21.15.62:0/3862255574 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6ec13f8e0 0x7fc6ec13fd70 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:42.298 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.291+0000 7fc6f2969640 1 --2- 172.21.15.62:0/3862255574 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc6ec071830 0x7fc6ec0b6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:42.298 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.291+0000 7fc6f2969640 1 -- 172.21.15.62:0/3862255574 >> 172.21.15.62:0/3862255574 conn(0x7fc6ec09e5b0 msgr2=0x7fc6ec0b1820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:42.298 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.291+0000 7fc6f2969640 1 -- 172.21.15.62:0/3862255574 shutdown_connections 2023-10-08T12:00:42.298 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.291+0000 7fc6f2969640 1 -- 172.21.15.62:0/3862255574 wait complete. 2023-10-08T12:00:42.313 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group' 2023-10-08T12:00:42.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.435+0000 7f1b7a1f1640 1 -- 172.21.15.62:0/1126335300 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b740b99e0 msgr2=0x7f1b7409d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:42.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.435+0000 7f1b7a1f1640 1 --2- 172.21.15.62:0/1126335300 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b740b99e0 0x7f1b7409d040 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f1b64009bc0 tx=0x7f1b6401ca10 comp rx=0 tx=0).stop 2023-10-08T12:00:42.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.435+0000 7f1b7a1f1640 1 -- 172.21.15.62:0/1126335300 shutdown_connections 2023-10-08T12:00:42.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.435+0000 7f1b7a1f1640 1 --2- 172.21.15.62:0/1126335300 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1b740b5170 0x7f1b740b56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:42.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.435+0000 7f1b7a1f1640 1 --2- 172.21.15.62:0/1126335300 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b740b99e0 0x7f1b7409d040 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:42.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.435+0000 7f1b7a1f1640 1 -- 172.21.15.62:0/1126335300 >> 172.21.15.62:0/1126335300 conn(0x7f1b7409c520 msgr2=0x7f1b7409c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:42.442 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.435+0000 7f1b7a1f1640 1 -- 172.21.15.62:0/1126335300 shutdown_connections 2023-10-08T12:00:42.442 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.435+0000 7f1b7a1f1640 1 -- 172.21.15.62:0/1126335300 wait complete. 2023-10-08T12:00:42.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.439+0000 7f1b7a1f1640 1 Processor -- start 2023-10-08T12:00:42.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.439+0000 7f1b7a1f1640 1 -- start start 2023-10-08T12:00:42.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.439+0000 7f1b7a1f1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b740b5170 0x7f1b741e0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:42.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.439+0000 7f1b7a1f1640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1b740b5c20 0x7f1b74144890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:42.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.439+0000 7f1b7a1f1640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b740b99e0 0x7f1b7409de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:42.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.439+0000 7f1b7a1f1640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b7409f3c0 con 0x7f1b740b5170 2023-10-08T12:00:42.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.439+0000 7f1b7a1f1640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b740b4450 con 0x7f1b740b99e0 2023-10-08T12:00:42.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.439+0000 7f1b7a1f1640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b740a0810 con 0x7f1b740b5c20 2023-10-08T12:00:42.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.439+0000 7f1b737fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b740b5170 0x7f1b741e0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:42.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.439+0000 7f1b737fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b740b5170 0x7f1b741e0000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43806/0 (socket says 172.21.15.62:43806) 2023-10-08T12:00:42.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.439+0000 7f1b737fe640 1 -- 172.21.15.62:0/3650907291 learned_addr learned my addr 172.21.15.62:0/3650907291 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:42.445 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.439+0000 7f1b737fe640 1 -- 172.21.15.62:0/3650907291 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1b740b5c20 msgr2=0x7f1b74144890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:42.445 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.439+0000 7f1b737fe640 1 --2- 172.21.15.62:0/3650907291 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1b740b5c20 0x7f1b74144890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:42.445 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.439+0000 7f1b737fe640 1 -- 172.21.15.62:0/3650907291 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b740b99e0 msgr2=0x7f1b7409de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:42.445 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.439+0000 7f1b73fff640 1 --2- 172.21.15.62:0/3650907291 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b740b99e0 0x7f1b7409de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:42.445 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.439+0000 7f1b737fe640 1 --2- 172.21.15.62:0/3650907291 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b740b99e0 0x7f1b7409de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:42.445 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.439+0000 7f1b737fe640 1 -- 172.21.15.62:0/3650907291 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b64009820 con 0x7f1b740b5170 2023-10-08T12:00:42.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.439+0000 7f1b73fff640 1 --2- 172.21.15.62:0/3650907291 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b740b99e0 0x7f1b7409de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:00:42.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.439+0000 7f1b737fe640 1 --2- 172.21.15.62:0/3650907291 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b740b5170 0x7f1b741e0000 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1b64009b10 tx=0x7f1b640a5830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:42.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.439+0000 7f1b6bfff640 1 -- 172.21.15.62:0/3650907291 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b640043f0 con 0x7f1b740b5170 2023-10-08T12:00:42.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.439+0000 7f1b6bfff640 1 -- 172.21.15.62:0/3650907291 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1b640a5a20 con 0x7f1b740b5170 2023-10-08T12:00:42.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.439+0000 7f1b7a1f1640 1 -- 172.21.15.62:0/3650907291 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b74144dd0 con 0x7f1b740b5170 2023-10-08T12:00:42.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.439+0000 7f1b6bfff640 1 -- 172.21.15.62:0/3650907291 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b640ad440 con 0x7f1b740b5170 2023-10-08T12:00:42.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.439+0000 7f1b7a1f1640 1 -- 172.21.15.62:0/3650907291 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b740a0a30 con 0x7f1b740b5170 2023-10-08T12:00:42.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.439+0000 7f1b7a1f1640 1 -- 172.21.15.62:0/3650907291 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b7404da80 con 0x7f1b740b5170 2023-10-08T12:00:42.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.439+0000 7f1b6bfff640 1 -- 172.21.15.62:0/3650907291 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f1b640b4040 con 0x7f1b740b5170 2023-10-08T12:00:42.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.439+0000 7f1b6bfff640 1 --2- 172.21.15.62:0/3650907291 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f1b54066470 0x7f1b54068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:42.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.439+0000 7f1b6bfff640 1 -- 172.21.15.62:0/3650907291 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1b6411edb0 con 0x7f1b740b5170 2023-10-08T12:00:42.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.443+0000 7f1b72ffd640 1 --2- 172.21.15.62:0/3650907291 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f1b54066470 0x7f1b54068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:42.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.443+0000 7f1b72ffd640 1 --2- 172.21.15.62:0/3650907291 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f1b54066470 0x7f1b54068930 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1b74098990 tx=0x7f1b5c00b410 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:42.449 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.443+0000 7f1b6bfff640 1 -- 172.21.15.62:0/3650907291 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1b640ec2c0 con 0x7f1b740b5170 2023-10-08T12:00:42.664 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:42.659+0000 7f1b7a1f1640 1 -- 172.21.15.62:0/3650907291 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group"]} v 0) v1 -- 0x7f1b7404da80 con 0x7f1b740b5170 2023-10-08T12:00:43.314 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.311+0000 7f1b6bfff640 1 -- 172.21.15.62:0/3650907291 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group"]}]=0 v47) v1 ==== 166+0+0 (secure 0 0 0) 0x7f1b640b2020 con 0x7f1b740b5170 2023-10-08T12:00:43.319 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.315+0000 7f1b7a1f1640 1 -- 172.21.15.62:0/3650907291 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f1b54066470 msgr2=0x7f1b54068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:43.319 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.315+0000 7f1b7a1f1640 1 --2- 172.21.15.62:0/3650907291 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f1b54066470 0x7f1b54068930 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1b74098990 tx=0x7f1b5c00b410 comp rx=0 tx=0).stop 2023-10-08T12:00:43.319 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.315+0000 7f1b7a1f1640 1 -- 172.21.15.62:0/3650907291 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b740b5170 msgr2=0x7f1b741e0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:43.319 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.315+0000 7f1b7a1f1640 1 --2- 172.21.15.62:0/3650907291 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b740b5170 0x7f1b741e0000 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1b64009b10 tx=0x7f1b640a5830 comp rx=0 tx=0).stop 2023-10-08T12:00:43.319 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.315+0000 7f1b7a1f1640 1 -- 172.21.15.62:0/3650907291 shutdown_connections 2023-10-08T12:00:43.319 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.315+0000 7f1b7a1f1640 1 --2- 172.21.15.62:0/3650907291 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f1b54066470 0x7f1b54068930 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:43.320 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.315+0000 7f1b7a1f1640 1 --2- 172.21.15.62:0/3650907291 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1b740b5c20 0x7f1b74144890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:43.320 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.315+0000 7f1b7a1f1640 1 --2- 172.21.15.62:0/3650907291 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b740b99e0 0x7f1b7409de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:43.320 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.315+0000 7f1b7a1f1640 1 --2- 172.21.15.62:0/3650907291 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b740b5170 0x7f1b741e0000 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:43.320 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.315+0000 7f1b7a1f1640 1 -- 172.21.15.62:0/3650907291 >> 172.21.15.62:0/3650907291 conn(0x7f1b7409c520 msgr2=0x7f1b74145ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:43.320 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.315+0000 7f1b7a1f1640 1 -- 172.21.15.62:0/3650907291 shutdown_connections 2023-10-08T12:00:43.320 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.315+0000 7f1b7a1f1640 1 -- 172.21.15.62:0/3650907291 wait complete. 2023-10-08T12:00:43.343 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2023-10-08T12:00:43.479 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.475+0000 7f93c3825640 1 -- 172.21.15.62:0/992261698 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f93bc14e950 msgr2=0x7f93bc150d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:43.479 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.475+0000 7f93c3825640 1 --2- 172.21.15.62:0/992261698 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f93bc14e950 0x7f93bc150d40 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f93b400adc0 tx=0x7f93b401dbe0 comp rx=0 tx=0).stop 2023-10-08T12:00:43.480 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.475+0000 7f93c3825640 1 -- 172.21.15.62:0/992261698 shutdown_connections 2023-10-08T12:00:43.480 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.475+0000 7f93c3825640 1 --2- 172.21.15.62:0/992261698 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f93bc14e950 0x7f93bc150d40 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:43.480 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.475+0000 7f93c3825640 1 -- 172.21.15.62:0/992261698 >> 172.21.15.62:0/992261698 conn(0x7f93bc09c520 msgr2=0x7f93bc09c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:43.480 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.475+0000 7f93c3825640 1 -- 172.21.15.62:0/992261698 shutdown_connections 2023-10-08T12:00:43.480 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.475+0000 7f93c3825640 1 -- 172.21.15.62:0/992261698 wait complete. 2023-10-08T12:00:43.482 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.475+0000 7f93c3825640 1 Processor -- start 2023-10-08T12:00:43.482 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.475+0000 7f93c3825640 1 -- start start 2023-10-08T12:00:43.482 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.475+0000 7f93c3825640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f93bc0b8bc0 0x7f93bc0706e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:43.482 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.475+0000 7f93c3825640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f93bc148010 0x7f93bc144f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:43.482 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.475+0000 7f93c3825640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f93bc14e950 0x7f93bc13d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:43.482 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.475+0000 7f93c3825640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93bc1e35f0 con 0x7f93bc14e950 2023-10-08T12:00:43.483 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.475+0000 7f93c3825640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93bc1454b0 con 0x7f93bc0b8bc0 2023-10-08T12:00:43.483 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.475+0000 7f93c3825640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93bc1e3e30 con 0x7f93bc148010 2023-10-08T12:00:43.483 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.475+0000 7f93c1dc2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f93bc14e950 0x7f93bc13d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:43.483 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.475+0000 7f93c1dc2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f93bc14e950 0x7f93bc13d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43832/0 (socket says 172.21.15.62:43832) 2023-10-08T12:00:43.483 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.475+0000 7f93c1dc2640 1 -- 172.21.15.62:0/3807335074 learned_addr learned my addr 172.21.15.62:0/3807335074 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:43.483 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.475+0000 7f93c0dc0640 1 --2- 172.21.15.62:0/3807335074 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f93bc148010 0x7f93bc144f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:43.483 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.475+0000 7f93c15c1640 1 --2- 172.21.15.62:0/3807335074 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f93bc0b8bc0 0x7f93bc0706e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:43.483 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.475+0000 7f93c1dc2640 1 -- 172.21.15.62:0/3807335074 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f93bc148010 msgr2=0x7f93bc144f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:43.483 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.475+0000 7f93c1dc2640 1 --2- 172.21.15.62:0/3807335074 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f93bc148010 0x7f93bc144f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:43.483 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.475+0000 7f93c1dc2640 1 -- 172.21.15.62:0/3807335074 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f93bc0b8bc0 msgr2=0x7f93bc0706e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:43.483 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.475+0000 7f93c1dc2640 1 --2- 172.21.15.62:0/3807335074 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f93bc0b8bc0 0x7f93bc0706e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:43.483 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.475+0000 7f93c1dc2640 1 -- 172.21.15.62:0/3807335074 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93b400a9f0 con 0x7f93bc14e950 2023-10-08T12:00:43.484 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.479+0000 7f93c1dc2640 1 --2- 172.21.15.62:0/3807335074 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f93bc14e950 0x7f93bc13d720 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f93b401a7f0 tx=0x7f93b400a450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:43.484 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.479+0000 7f93b1ffb640 1 -- 172.21.15.62:0/3807335074 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b4003b80 con 0x7f93bc14e950 2023-10-08T12:00:43.484 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.479+0000 7f93b1ffb640 1 -- 172.21.15.62:0/3807335074 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f93b4003dd0 con 0x7f93bc14e950 2023-10-08T12:00:43.484 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.479+0000 7f93b1ffb640 1 -- 172.21.15.62:0/3807335074 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b4004290 con 0x7f93bc14e950 2023-10-08T12:00:43.484 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.479+0000 7f93c3825640 1 -- 172.21.15.62:0/3807335074 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93bc150110 con 0x7f93bc14e950 2023-10-08T12:00:43.484 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.479+0000 7f93c3825640 1 -- 172.21.15.62:0/3807335074 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93bc1e3ac0 con 0x7f93bc14e950 2023-10-08T12:00:43.485 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.479+0000 7f93c3825640 1 -- 172.21.15.62:0/3807335074 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93bc04da80 con 0x7f93bc14e950 2023-10-08T12:00:43.485 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.479+0000 7f93b1ffb640 1 -- 172.21.15.62:0/3807335074 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f93b40b5040 con 0x7f93bc14e950 2023-10-08T12:00:43.485 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.479+0000 7f93b1ffb640 1 --2- 172.21.15.62:0/3807335074 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f93a0066470 0x7f93a0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:43.485 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.479+0000 7f93b1ffb640 1 -- 172.21.15.62:0/3807335074 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f93b411e4b0 con 0x7f93bc14e950 2023-10-08T12:00:43.485 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.479+0000 7f93c15c1640 1 --2- 172.21.15.62:0/3807335074 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f93a0066470 0x7f93a0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:43.485 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.479+0000 7f93c15c1640 1 --2- 172.21.15.62:0/3807335074 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f93a0066470 0x7f93a0068930 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f93b8001650 tx=0x7f93b8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:43.488 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.483+0000 7f93b1ffb640 1 -- 172.21.15.62:0/3807335074 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f93b40eb930 con 0x7f93bc14e950 2023-10-08T12:00:43.647 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.643+0000 7f93c3825640 1 -- 172.21.15.62:0/3807335074 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "config dump"} v 0) v1 -- 0x7f93bc1e3f70 con 0x7f93bc14e950 2023-10-08T12:00:43.648 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.643+0000 7f93b1ffb640 1 -- 172.21.15.62:0/3807335074 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v30) v1 ==== 59+0+2220 (secure 0 0 0) 0x7f93b40bc080 con 0x7f93bc14e950 2023-10-08T12:00:43.648 INFO:teuthology.orchestra.run.smithi062.stdout:WHO MASK LEVEL OPTION VALUE RO 2023-10-08T12:00:43.648 INFO:teuthology.orchestra.run.smithi062.stdout:mon advanced mon_op_complaint_time 120 2023-10-08T12:00:43.648 INFO:teuthology.orchestra.run.smithi062.stdout:osd advanced osd_op_complaint_time 180.000000 2023-10-08T12:00:43.648 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 3915.865903 2023-10-08T12:00:43.649 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 4014.963845 2023-10-08T12:00:43.649 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 3547.566142 2023-10-08T12:00:43.649 INFO:teuthology.orchestra.run.smithi062.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 3851.874423 2023-10-08T12:00:43.649 INFO:teuthology.orchestra.run.smithi062.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4514.051608 2023-10-08T12:00:43.649 INFO:teuthology.orchestra.run.smithi062.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 3873.789265 2023-10-08T12:00:43.649 INFO:teuthology.orchestra.run.smithi062.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 4087.365971 2023-10-08T12:00:43.649 INFO:teuthology.orchestra.run.smithi062.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 3899.375883 2023-10-08T12:00:43.649 INFO:teuthology.orchestra.run.smithi062.stdout:mds advanced debug_mds 20/20 2023-10-08T12:00:43.649 INFO:teuthology.orchestra.run.smithi062.stdout:mds advanced debug_mds_balancer 20/20 2023-10-08T12:00:43.649 INFO:teuthology.orchestra.run.smithi062.stdout:mds advanced debug_ms 1/1 2023-10-08T12:00:43.649 INFO:teuthology.orchestra.run.smithi062.stdout:mds advanced mds_bal_fragment_size_max 10000 2023-10-08T12:00:43.650 INFO:teuthology.orchestra.run.smithi062.stdout:mds advanced mds_bal_merge_size 5 2023-10-08T12:00:43.650 INFO:teuthology.orchestra.run.smithi062.stdout:mds advanced mds_bal_split_bits 3 2023-10-08T12:00:43.650 INFO:teuthology.orchestra.run.smithi062.stdout:mds advanced mds_bal_split_size 100 2023-10-08T12:00:43.650 INFO:teuthology.orchestra.run.smithi062.stdout:mds dev mds_debug_frag true 2023-10-08T12:00:43.650 INFO:teuthology.orchestra.run.smithi062.stdout:mds dev mds_debug_scatterstat true 2023-10-08T12:00:43.650 INFO:teuthology.orchestra.run.smithi062.stdout:mds advanced mds_op_complaint_time 180.000000 2023-10-08T12:00:43.650 INFO:teuthology.orchestra.run.smithi062.stdout:mds dev mds_verify_scatter true 2023-10-08T12:00:43.650 INFO:teuthology.orchestra.run.smithi062.stdout:mds advanced osd_op_complaint_time 180.000000 2023-10-08T12:00:43.650 INFO:teuthology.orchestra.run.smithi062.stdout:mds advanced rados_mon_op_timeout 900 2023-10-08T12:00:43.650 INFO:teuthology.orchestra.run.smithi062.stdout:mds advanced rados_osd_op_timeout 900 2023-10-08T12:00:43.650 INFO:teuthology.orchestra.run.smithi062.stdout:client advanced client_mount_timeout 600 2023-10-08T12:00:43.650 INFO:teuthology.orchestra.run.smithi062.stdout:client advanced debug_client 20/20 2023-10-08T12:00:43.651 INFO:teuthology.orchestra.run.smithi062.stdout:client advanced debug_ms 1/1 2023-10-08T12:00:43.651 INFO:teuthology.orchestra.run.smithi062.stdout:client advanced rados_mon_op_timeout 900 2023-10-08T12:00:43.651 INFO:teuthology.orchestra.run.smithi062.stdout:client advanced rados_osd_op_timeout 900 2023-10-08T12:00:43.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.647+0000 7f93c3825640 1 -- 172.21.15.62:0/3807335074 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f93a0066470 msgr2=0x7f93a0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:43.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.647+0000 7f93c3825640 1 --2- 172.21.15.62:0/3807335074 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f93a0066470 0x7f93a0068930 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f93b8001650 tx=0x7f93b8009040 comp rx=0 tx=0).stop 2023-10-08T12:00:43.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.647+0000 7f93c3825640 1 -- 172.21.15.62:0/3807335074 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f93bc14e950 msgr2=0x7f93bc13d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:43.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.647+0000 7f93c3825640 1 --2- 172.21.15.62:0/3807335074 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f93bc14e950 0x7f93bc13d720 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f93b401a7f0 tx=0x7f93b400a450 comp rx=0 tx=0).stop 2023-10-08T12:00:43.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.647+0000 7f93c3825640 1 -- 172.21.15.62:0/3807335074 shutdown_connections 2023-10-08T12:00:43.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.647+0000 7f93c3825640 1 --2- 172.21.15.62:0/3807335074 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f93a0066470 0x7f93a0068930 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:43.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.647+0000 7f93c3825640 1 --2- 172.21.15.62:0/3807335074 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f93bc148010 0x7f93bc144f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:43.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.647+0000 7f93c3825640 1 --2- 172.21.15.62:0/3807335074 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f93bc14e950 0x7f93bc13d720 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:43.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.647+0000 7f93c3825640 1 --2- 172.21.15.62:0/3807335074 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f93bc0b8bc0 0x7f93bc0706e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:43.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.647+0000 7f93c3825640 1 -- 172.21.15.62:0/3807335074 >> 172.21.15.62:0/3807335074 conn(0x7f93bc09c520 msgr2=0x7f93bc09bd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:43.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.647+0000 7f93c3825640 1 -- 172.21.15.62:0/3807335074 shutdown_connections 2023-10-08T12:00:43.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.647+0000 7f93c3825640 1 -- 172.21.15.62:0/3807335074 wait complete. 2023-10-08T12:00:43.668 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-08T12:00:43.791 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.787+0000 7f23abc9d640 1 -- 172.21.15.62:0/3191914745 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23a40ba340 msgr2=0x7f23a40b5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:43.792 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.787+0000 7f23abc9d640 1 --2- 172.21.15.62:0/3191914745 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23a40ba340 0x7f23a40b5a70 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f23a4066910 tx=0x7f239401c7d0 comp rx=0 tx=0).stop 2023-10-08T12:00:43.792 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.787+0000 7f23abc9d640 1 -- 172.21.15.62:0/3191914745 shutdown_connections 2023-10-08T12:00:43.792 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.787+0000 7f23abc9d640 1 --2- 172.21.15.62:0/3191914745 >> v2:172.21.15.130:3300/0 conn(0x7f23a40b9900 0x7f23a414fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:43.792 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.787+0000 7f23abc9d640 1 --2- 172.21.15.62:0/3191914745 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23a40ba340 0x7f23a40b5a70 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:43.792 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.787+0000 7f23abc9d640 1 -- 172.21.15.62:0/3191914745 >> 172.21.15.62:0/3191914745 conn(0x7f23a409c520 msgr2=0x7f23a409c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:43.792 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.787+0000 7f23abc9d640 1 -- 172.21.15.62:0/3191914745 shutdown_connections 2023-10-08T12:00:43.792 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.787+0000 7f23abc9d640 1 -- 172.21.15.62:0/3191914745 wait complete. 2023-10-08T12:00:43.794 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.787+0000 7f23abc9d640 1 Processor -- start 2023-10-08T12:00:43.794 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.787+0000 7f23abc9d640 1 -- start start 2023-10-08T12:00:43.794 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.787+0000 7f23abc9d640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f23a406b1c0 0x7f23a40b49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:43.794 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.787+0000 7f23abc9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23a40b9900 0x7f23a4070360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:43.794 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.787+0000 7f23abc9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f23a40ba340 0x7f23a41e0790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:43.794 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.787+0000 7f23abc9d640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23a40b4ef0 con 0x7f23a40b9900 2023-10-08T12:00:43.794 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.787+0000 7f23abc9d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23a41e4c40 con 0x7f23a40ba340 2023-10-08T12:00:43.795 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.787+0000 7f23abc9d640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23a41e47b0 con 0x7f23a406b1c0 2023-10-08T12:00:43.795 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.787+0000 7f23a9238640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23a40b9900 0x7f23a4070360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:43.795 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.787+0000 7f23a9238640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23a40b9900 0x7f23a4070360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43858/0 (socket says 172.21.15.62:43858) 2023-10-08T12:00:43.795 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.787+0000 7f23a9238640 1 -- 172.21.15.62:0/54900571 learned_addr learned my addr 172.21.15.62:0/54900571 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:43.795 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.791+0000 7f23a9238640 1 -- 172.21.15.62:0/54900571 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f23a406b1c0 msgr2=0x7f23a40b49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:43.795 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.791+0000 7f23a9238640 1 --2- 172.21.15.62:0/54900571 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f23a406b1c0 0x7f23a40b49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:43.795 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.791+0000 7f23a9238640 1 -- 172.21.15.62:0/54900571 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f23a40ba340 msgr2=0x7f23a41e0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:43.795 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.791+0000 7f23a9238640 1 --2- 172.21.15.62:0/54900571 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f23a40ba340 0x7f23a41e0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:43.795 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.791+0000 7f23a9238640 1 -- 172.21.15.62:0/54900571 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2394009560 con 0x7f23a40b9900 2023-10-08T12:00:43.795 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.791+0000 7f23a9238640 1 --2- 172.21.15.62:0/54900571 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23a40b9900 0x7f23a4070360 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f239401ccb0 tx=0x7f23940a5820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:43.796 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.791+0000 7f239a7fc640 1 -- 172.21.15.62:0/54900571 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2394004340 con 0x7f23a40b9900 2023-10-08T12:00:43.796 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.791+0000 7f239a7fc640 1 -- 172.21.15.62:0/54900571 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2394003600 con 0x7f23a40b9900 2023-10-08T12:00:43.796 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.791+0000 7f23abc9d640 1 -- 172.21.15.62:0/54900571 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23a40708a0 con 0x7f23a40b9900 2023-10-08T12:00:43.796 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.791+0000 7f239a7fc640 1 -- 172.21.15.62:0/54900571 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23940039f0 con 0x7f23a40b9900 2023-10-08T12:00:43.796 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.791+0000 7f23abc9d640 1 -- 172.21.15.62:0/54900571 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23a41e4160 con 0x7f23a40b9900 2023-10-08T12:00:43.797 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.791+0000 7f23abc9d640 1 -- 172.21.15.62:0/54900571 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23a404da80 con 0x7f23a40b9900 2023-10-08T12:00:43.797 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.791+0000 7f239a7fc640 1 -- 172.21.15.62:0/54900571 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f23940b4040 con 0x7f23a40b9900 2023-10-08T12:00:43.797 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.791+0000 7f239a7fc640 1 --2- 172.21.15.62:0/54900571 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f2388066470 0x7f2388068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:43.797 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.791+0000 7f239a7fc640 1 -- 172.21.15.62:0/54900571 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f239411e720 con 0x7f23a40b9900 2023-10-08T12:00:43.797 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.791+0000 7f23a9a39640 1 --2- 172.21.15.62:0/54900571 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f2388066470 0x7f2388068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:43.797 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.791+0000 7f23a9a39640 1 --2- 172.21.15.62:0/54900571 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f2388066470 0x7f2388068930 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f23a0007fd0 tx=0x7f23a0007d40 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:43.801 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.795+0000 7f239a7fc640 1 -- 172.21.15.62:0/54900571 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f23940ebba0 con 0x7f23a40b9900 2023-10-08T12:00:43.955 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.951+0000 7f23abc9d640 1 -- 172.21.15.62:0/54900571 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f23a404da80 con 0x7f23a40b9900 2023-10-08T12:00:43.963 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.959+0000 7f239a7fc640 1 -- 172.21.15.62:0/54900571 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v31)=0 v31) v1 ==== 122+0+0 (secure 0 0 0) 0x7f23940b20c0 con 0x7f23a40b9900 2023-10-08T12:00:43.966 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.963+0000 7f23abc9d640 1 -- 172.21.15.62:0/54900571 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f2388066470 msgr2=0x7f2388068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:43.966 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.963+0000 7f23abc9d640 1 --2- 172.21.15.62:0/54900571 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f2388066470 0x7f2388068930 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f23a0007fd0 tx=0x7f23a0007d40 comp rx=0 tx=0).stop 2023-10-08T12:00:43.966 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.963+0000 7f23abc9d640 1 -- 172.21.15.62:0/54900571 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23a40b9900 msgr2=0x7f23a4070360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:43.966 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.963+0000 7f23abc9d640 1 --2- 172.21.15.62:0/54900571 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23a40b9900 0x7f23a4070360 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f239401ccb0 tx=0x7f23940a5820 comp rx=0 tx=0).stop 2023-10-08T12:00:43.966 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.963+0000 7f23abc9d640 1 -- 172.21.15.62:0/54900571 shutdown_connections 2023-10-08T12:00:43.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.963+0000 7f23abc9d640 1 --2- 172.21.15.62:0/54900571 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f2388066470 0x7f2388068930 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:43.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.963+0000 7f23abc9d640 1 --2- 172.21.15.62:0/54900571 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f23a40ba340 0x7f23a41e0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:43.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.963+0000 7f23abc9d640 1 --2- 172.21.15.62:0/54900571 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23a40b9900 0x7f23a4070360 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:43.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.963+0000 7f23abc9d640 1 --2- 172.21.15.62:0/54900571 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f23a406b1c0 0x7f23a40b49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:43.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.963+0000 7f23abc9d640 1 -- 172.21.15.62:0/54900571 >> 172.21.15.62:0/54900571 conn(0x7f23a409c520 msgr2=0x7f23a40b7a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:43.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.963+0000 7f23abc9d640 1 -- 172.21.15.62:0/54900571 shutdown_connections 2023-10-08T12:00:43.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:43.963+0000 7f23abc9d640 1 -- 172.21.15.62:0/54900571 wait complete. 2023-10-08T12:00:43.982 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T12:00:43.982 DEBUG:teuthology.orchestra.run.smithi062:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T12:00:44.011 DEBUG:teuthology.orchestra.run.smithi130:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T12:00:44.080 DEBUG:teuthology.orchestra.run.smithi156:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T12:00:44.130 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T12:00:44.131 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-10-08T12:00:44.131 DEBUG:teuthology.orchestra.run.smithi156:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-08T12:00:44.140 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-10-08T12:00:44.140 DEBUG:teuthology.orchestra.run.smithi156:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-08T12:00:44.196 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-10-08T12:00:44.339 DEBUG:teuthology.orchestra.run.smithi156:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-08T12:00:44.351 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:00:44.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.487+0000 7f33489fe640 1 -- 172.21.15.62:0/1767699503 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33440b6a60 msgr2=0x7f334414a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:44.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.487+0000 7f33489fe640 1 --2- 172.21.15.62:0/1767699503 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33440b6a60 0x7f334414a250 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f334409d530 tx=0x7f333801c8a0 comp rx=0 tx=0).stop 2023-10-08T12:00:44.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.487+0000 7f33489fe640 1 -- 172.21.15.62:0/1767699503 shutdown_connections 2023-10-08T12:00:44.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.487+0000 7f33489fe640 1 --2- 172.21.15.62:0/1767699503 >> v2:172.21.15.130:3300/0 conn(0x7f334414a790 0x7f33440b8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:44.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.487+0000 7f33489fe640 1 --2- 172.21.15.62:0/1767699503 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33440b6a60 0x7f334414a250 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:44.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.487+0000 7f33489fe640 1 --2- 172.21.15.62:0/1767699503 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f33440718c0 0x7f33440b5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:44.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.487+0000 7f33489fe640 1 -- 172.21.15.62:0/1767699503 >> 172.21.15.62:0/1767699503 conn(0x7f334409c520 msgr2=0x7f334409c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:44.492 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.487+0000 7f33489fe640 1 -- 172.21.15.62:0/1767699503 shutdown_connections 2023-10-08T12:00:44.492 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.487+0000 7f33489fe640 1 -- 172.21.15.62:0/1767699503 wait complete. 2023-10-08T12:00:44.492 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.487+0000 7f33489fe640 1 Processor -- start 2023-10-08T12:00:44.492 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.487+0000 7f33489fe640 1 -- start start 2023-10-08T12:00:44.494 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.487+0000 7f33489fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33440718c0 0x7f3344148480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:44.494 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.487+0000 7f33489fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f33440b6a60 0x7f33441e06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:44.494 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.487+0000 7f33489fe640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f334414a790 0x7f3344149990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:44.494 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.487+0000 7f33489fe640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f334406e460 con 0x7f33440718c0 2023-10-08T12:00:44.494 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.487+0000 7f33489fe640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33441dfc00 con 0x7f33440b6a60 2023-10-08T12:00:44.494 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.487+0000 7f33489fe640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33440b4f10 con 0x7f334414a790 2023-10-08T12:00:44.494 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.487+0000 7f334259c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33440718c0 0x7f3344148480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:44.495 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.487+0000 7f334259c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33440718c0 0x7f3344148480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43868/0 (socket says 172.21.15.62:43868) 2023-10-08T12:00:44.495 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.487+0000 7f334259c640 1 -- 172.21.15.62:0/4192450479 learned_addr learned my addr 172.21.15.62:0/4192450479 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:44.495 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.487+0000 7f3341d9b640 1 --2- 172.21.15.62:0/4192450479 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f33440b6a60 0x7f33441e06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:44.495 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.487+0000 7f3342d9d640 1 --2- 172.21.15.62:0/4192450479 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f334414a790 0x7f3344149990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:44.495 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.487+0000 7f334259c640 1 -- 172.21.15.62:0/4192450479 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f334414a790 msgr2=0x7f3344149990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:44.495 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.487+0000 7f334259c640 1 --2- 172.21.15.62:0/4192450479 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f334414a790 0x7f3344149990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:44.495 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.487+0000 7f334259c640 1 -- 172.21.15.62:0/4192450479 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f33440b6a60 msgr2=0x7f33441e06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:44.495 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.487+0000 7f334259c640 1 --2- 172.21.15.62:0/4192450479 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f33440b6a60 0x7f33441e06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:44.496 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.487+0000 7f334259c640 1 -- 172.21.15.62:0/4192450479 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3338009560 con 0x7f33440718c0 2023-10-08T12:00:44.496 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.491+0000 7f334259c640 1 --2- 172.21.15.62:0/4192450479 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33440718c0 0x7f3344148480 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f333c00ccb0 tx=0x7f333c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:44.497 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.491+0000 7f3332ffd640 1 -- 172.21.15.62:0/4192450479 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333c004b30 con 0x7f33440718c0 2023-10-08T12:00:44.497 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.491+0000 7f3332ffd640 1 -- 172.21.15.62:0/4192450479 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f333c004d80 con 0x7f33440718c0 2023-10-08T12:00:44.497 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.491+0000 7f3332ffd640 1 -- 172.21.15.62:0/4192450479 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333c005280 con 0x7f33440718c0 2023-10-08T12:00:44.497 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.491+0000 7f33489fe640 1 -- 172.21.15.62:0/4192450479 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33441dfec0 con 0x7f33440718c0 2023-10-08T12:00:44.497 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.491+0000 7f33489fe640 1 -- 172.21.15.62:0/4192450479 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f334406f3e0 con 0x7f33440718c0 2023-10-08T12:00:44.498 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.491+0000 7f33489fe640 1 -- 172.21.15.62:0/4192450479 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33441e03e0 con 0x7f33440718c0 2023-10-08T12:00:44.498 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.491+0000 7f3332ffd640 1 -- 172.21.15.62:0/4192450479 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f333c0053e0 con 0x7f33440718c0 2023-10-08T12:00:44.498 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.491+0000 7f3332ffd640 1 --2- 172.21.15.62:0/4192450479 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f3324066470 0x7f3324068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:44.498 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.491+0000 7f3332ffd640 1 -- 172.21.15.62:0/4192450479 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f333c0846f0 con 0x7f33440718c0 2023-10-08T12:00:44.498 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.491+0000 7f3341d9b640 1 --2- 172.21.15.62:0/4192450479 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f3324066470 0x7f3324068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:44.498 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.491+0000 7f3341d9b640 1 --2- 172.21.15.62:0/4192450479 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f3324066470 0x7f3324068930 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f33380af000 tx=0x7f333801b0e0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:44.501 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.495+0000 7f3332ffd640 1 -- 172.21.15.62:0/4192450479 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f33441e03e0 con 0x7f33440718c0 2023-10-08T12:00:44.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.655+0000 7f33489fe640 1 -- 172.21.15.62:0/4192450479 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f33440b5080 con 0x7f33440718c0 2023-10-08T12:00:44.661 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.655+0000 7f3332ffd640 1 -- 172.21.15.62:0/4192450479 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16481 (secure 0 0 0) 0x7f333c01d020 con 0x7f33440718c0 2023-10-08T12:00:44.661 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T12:00:44.661 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":20,"fsid":"3e777930-c2c1-4f2b-a903-c07ee4ca2c52","created":"2023-10-08T11:59:54.510229+0000","modified":"2023-10-08T12:00:21.580704+0000","last_up_change":"2023-10-08T12:00:06.783998+0000","last_in_change":"2023-10-08T11:59:57.847944+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:00:07.189433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:00:17.895548+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T12:00:18.871217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7bc3070a-7240-43d9-9ec3-397b68a37e2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6820","nonce":2227876905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6824","nonce":2227876905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6831","nonce":2227876905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6828","nonce":2227876905}]},"public_addr":"172.21.15.62:6820/2227876905","cluster_addr":"172.21.15.62:6824/2227876905","heartbeat_back_addr":"172.21.15.62:6831/2227876905","heartbeat_front_addr":"172.21.15.62:6828/2227876905","state":["exists","up"]},{"osd":1,"uuid":"5e0fa1f5-9ddc-4882-b460-5578bb571003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6801","nonce":315660906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6803","nonce":315660906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6808","nonce":315660906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6805","nonce":315660906}]},"public_addr":"172.21.15.62:6801/315660906","cluster_addr":"172.21.15.62:6803/315660906","heartbeat_back_addr":"172.21.15.62:6808/315660906","heartbeat_front_addr":"172.21.15.62:6805/315660906","state":["exists","up"]},{"osd":2,"uuid":"262b5ee9-4243-4309-a14f-88ad4e8bf812","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6807","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6809","nonce":3784842938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6811","nonce":3784842938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6815","nonce":3784842938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6813","nonce":3784842938}]},"public_addr":"172.21.15.62:6809/3784842938","cluster_addr":"172.21.15.62:6811/3784842938","heartbeat_back_addr":"172.21.15.62:6815/3784842938","heartbeat_front_addr":"172.21.15.62:6813/3784842938","state":["exists","up"]},{"osd":3,"uuid":"1770bdb8-c12b-43b1-aaab-1d6b6fd18f4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6817","nonce":3385303160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6821","nonce":3385303160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6827","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6829","nonce":3385303160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6823","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6825","nonce":3385303160}]},"public_addr":"172.21.15.62:6817/3385303160","cluster_addr":"172.21.15.62:6821/3385303160","heartbeat_back_addr":"172.21.15.62:6829/3385303160","heartbeat_front_addr":"172.21.15.62:6825/3385303160","state":["exists","up"]},{"osd":4,"uuid":"74c73631-9351-494a-8246-28ee86e9f862","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6807","nonce":1174056987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6809","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6811","nonce":1174056987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6820","nonce":1174056987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6813","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6816","nonce":1174056987}]},"public_addr":"172.21.15.130:6807/1174056987","cluster_addr":"172.21.15.130:6811/1174056987","heartbeat_back_addr":"172.21.15.130:6820/1174056987","heartbeat_front_addr":"172.21.15.130:6816/1174056987","state":["exists","up"]},{"osd":5,"uuid":"1040f389-272c-41d6-ae76-70c04d09afa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6801","nonce":561928414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6803","nonce":561928414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6815","nonce":561928414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6808","nonce":561928414}]},"public_addr":"172.21.15.130:6801/561928414","cluster_addr":"172.21.15.130:6803/561928414","heartbeat_back_addr":"172.21.15.130:6815/561928414","heartbeat_front_addr":"172.21.15.130:6808/561928414","state":["exists","up"]},{"osd":6,"uuid":"178553eb-03e1-4ab8-9826-4f5997e6da0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6810","nonce":2877303015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6817","nonce":2877303015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6823","nonce":2877303015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6819","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6821","nonce":2877303015}]},"public_addr":"172.21.15.130:6810/2877303015","cluster_addr":"172.21.15.130:6817/2877303015","heartbeat_back_addr":"172.21.15.130:6823/2877303015","heartbeat_front_addr":"172.21.15.130:6821/2877303015","state":["exists","up"]},{"osd":7,"uuid":"b6581c8f-30b1-4dfd-b7b6-94b579128835","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6825","nonce":680009774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6827","nonce":680009774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6831","nonce":680009774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6829","nonce":680009774}]},"public_addr":"172.21.15.130:6825/680009774","cluster_addr":"172.21.15.130:6827/680009774","heartbeat_back_addr":"172.21.15.130:6831/680009774","heartbeat_front_addr":"172.21.15.130:6829/680009774","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.505543+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.394383+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.456652+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.529168+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.235414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.392158+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.347556+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.432039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:00:44.664 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.659+0000 7f33489fe640 1 -- 172.21.15.62:0/4192450479 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f3324066470 msgr2=0x7f3324068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:44.664 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.659+0000 7f33489fe640 1 --2- 172.21.15.62:0/4192450479 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f3324066470 0x7f3324068930 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f33380af000 tx=0x7f333801b0e0 comp rx=0 tx=0).stop 2023-10-08T12:00:44.664 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.659+0000 7f33489fe640 1 -- 172.21.15.62:0/4192450479 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33440718c0 msgr2=0x7f3344148480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:44.664 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.659+0000 7f33489fe640 1 --2- 172.21.15.62:0/4192450479 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33440718c0 0x7f3344148480 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f333c00ccb0 tx=0x7f333c00a620 comp rx=0 tx=0).stop 2023-10-08T12:00:44.664 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.659+0000 7f33489fe640 1 -- 172.21.15.62:0/4192450479 shutdown_connections 2023-10-08T12:00:44.664 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.659+0000 7f33489fe640 1 --2- 172.21.15.62:0/4192450479 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f3324066470 0x7f3324068930 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:44.664 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.659+0000 7f33489fe640 1 --2- 172.21.15.62:0/4192450479 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f334414a790 0x7f3344149990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:44.664 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.659+0000 7f33489fe640 1 --2- 172.21.15.62:0/4192450479 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f33440b6a60 0x7f33441e06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:44.664 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.659+0000 7f33489fe640 1 --2- 172.21.15.62:0/4192450479 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33440718c0 0x7f3344148480 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:44.664 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.659+0000 7f33489fe640 1 -- 172.21.15.62:0/4192450479 >> 172.21.15.62:0/4192450479 conn(0x7f334409c520 msgr2=0x7f3344141b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:44.665 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.659+0000 7f33489fe640 1 -- 172.21.15.62:0/4192450479 shutdown_connections 2023-10-08T12:00:44.665 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.659+0000 7f33489fe640 1 -- 172.21.15.62:0/4192450479 wait complete. 2023-10-08T12:00:44.680 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T12:00:07.189433+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T12:00:17.895548+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T12:00:18.871217+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T12:00:44.681 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T12:00:44.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.811+0000 7f08fb9ed640 1 -- 172.21.15.62:0/1364135473 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08e00039b0 msgr2=0x7f08e0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:44.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.811+0000 7f08fb9ed640 1 --2- 172.21.15.62:0/1364135473 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08e00039b0 0x7f08e0003dd0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f08f000bc00 tx=0x7f08f001ce00 comp rx=0 tx=0).stop 2023-10-08T12:00:44.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.811+0000 7f08f9f8a640 1 -- 172.21.15.62:0/1364135473 reap_dead start 2023-10-08T12:00:44.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.811+0000 7f08fb9ed640 1 -- 172.21.15.62:0/1364135473 shutdown_connections 2023-10-08T12:00:44.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.811+0000 7f08fb9ed640 1 -- 172.21.15.62:0/1364135473 >> 172.21.15.62:0/1364135473 conn(0x7f08f409c520 msgr2=0x7f08f409c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:44.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.811+0000 7f08fb9ed640 1 -- 172.21.15.62:0/1364135473 shutdown_connections 2023-10-08T12:00:44.818 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.811+0000 7f08fb9ed640 1 -- 172.21.15.62:0/1364135473 wait complete. 2023-10-08T12:00:44.820 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.811+0000 7f08fb9ed640 1 Processor -- start 2023-10-08T12:00:44.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.811+0000 7f08fb9ed640 1 -- start start 2023-10-08T12:00:44.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.811+0000 7f08fb9ed640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08e00039b0 0x7f08f40b1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:44.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.811+0000 7f08fb9ed640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f08f41e5f90 0x7f08f40b4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:44.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.811+0000 7f08fb9ed640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f08f40b3570 0x7f08f4145050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:44.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.811+0000 7f08fb9ed640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f41e5b00 con 0x7f08e00039b0 2023-10-08T12:00:44.822 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.811+0000 7f08fb9ed640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f41e54b0 con 0x7f08f40b3570 2023-10-08T12:00:44.822 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.811+0000 7f08fb9ed640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08f41e5790 con 0x7f08f41e5f90 2023-10-08T12:00:44.822 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.815+0000 7f08f9789640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08e00039b0 0x7f08f40b1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:44.822 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.815+0000 7f08f9789640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08e00039b0 0x7f08f40b1b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43890/0 (socket says 172.21.15.62:43890) 2023-10-08T12:00:44.822 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.815+0000 7f08f9789640 1 -- 172.21.15.62:0/81144456 learned_addr learned my addr 172.21.15.62:0/81144456 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:44.823 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.815+0000 7f08f9f8a640 1 --2- 172.21.15.62:0/81144456 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f08f40b3570 0x7f08f4145050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:44.823 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.815+0000 7f08f8f88640 1 --2- 172.21.15.62:0/81144456 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f08f41e5f90 0x7f08f40b4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:44.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.815+0000 7f08f9789640 1 -- 172.21.15.62:0/81144456 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f08f41e5f90 msgr2=0x7f08f40b4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:44.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.815+0000 7f08f9789640 1 --2- 172.21.15.62:0/81144456 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f08f41e5f90 0x7f08f40b4460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:44.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.815+0000 7f08f9789640 1 -- 172.21.15.62:0/81144456 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f08f40b3570 msgr2=0x7f08f4145050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:44.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.815+0000 7f08f9789640 1 --2- 172.21.15.62:0/81144456 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f08f40b3570 0x7f08f4145050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:44.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.815+0000 7f08f9789640 1 -- 172.21.15.62:0/81144456 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f40b3e50 con 0x7f08e00039b0 2023-10-08T12:00:44.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.815+0000 7f08f9789640 1 --2- 172.21.15.62:0/81144456 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08e00039b0 0x7f08f40b1b20 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f08f000bb20 tx=0x7f08f0005f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:44.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.815+0000 7f08e9ffb640 1 -- 172.21.15.62:0/81144456 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f0004380 con 0x7f08e00039b0 2023-10-08T12:00:44.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.815+0000 7f08e9ffb640 1 -- 172.21.15.62:0/81144456 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f08f00044e0 con 0x7f08e00039b0 2023-10-08T12:00:44.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.815+0000 7f08fb9ed640 1 -- 172.21.15.62:0/81144456 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08f409b390 con 0x7f08e00039b0 2023-10-08T12:00:44.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.815+0000 7f08e9ffb640 1 -- 172.21.15.62:0/81144456 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f0005220 con 0x7f08e00039b0 2023-10-08T12:00:44.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.815+0000 7f08fb9ed640 1 -- 172.21.15.62:0/81144456 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08f40b49a0 con 0x7f08e00039b0 2023-10-08T12:00:44.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.815+0000 7f08fb9ed640 1 -- 172.21.15.62:0/81144456 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08f404da80 con 0x7f08e00039b0 2023-10-08T12:00:44.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.815+0000 7f08e9ffb640 1 -- 172.21.15.62:0/81144456 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f08f0005380 con 0x7f08e00039b0 2023-10-08T12:00:44.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.815+0000 7f08e9ffb640 1 --2- 172.21.15.62:0/81144456 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f08d8066470 0x7f08d8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:44.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.815+0000 7f08e9ffb640 1 -- 172.21.15.62:0/81144456 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f08f011df70 con 0x7f08e00039b0 2023-10-08T12:00:44.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.815+0000 7f08f8f88640 1 --2- 172.21.15.62:0/81144456 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f08d8066470 0x7f08d8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:44.826 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.815+0000 7f08f8f88640 1 --2- 172.21.15.62:0/81144456 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f08d8066470 0x7f08d8068930 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f08f4149300 tx=0x7f08e40069d0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:44.826 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.819+0000 7f08e9ffb640 1 -- 172.21.15.62:0/81144456 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f08f014f090 con 0x7f08e00039b0 2023-10-08T12:00:44.974 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.971+0000 7f08fb9ed640 1 -- 172.21.15.62:0/81144456 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f08f40665d0 con 0x7f08e00039b0 2023-10-08T12:00:44.974 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.971+0000 7f08e9ffb640 1 -- 172.21.15.62:0/81144456 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f08f00ab020 con 0x7f08e00039b0 2023-10-08T12:00:44.975 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2023-10-08T12:00:44.977 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.971+0000 7f08fb9ed640 1 -- 172.21.15.62:0/81144456 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f08d8066470 msgr2=0x7f08d8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:44.977 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.971+0000 7f08fb9ed640 1 --2- 172.21.15.62:0/81144456 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f08d8066470 0x7f08d8068930 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f08f4149300 tx=0x7f08e40069d0 comp rx=0 tx=0).stop 2023-10-08T12:00:44.977 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.971+0000 7f08fb9ed640 1 -- 172.21.15.62:0/81144456 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08e00039b0 msgr2=0x7f08f40b1b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:44.977 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.971+0000 7f08fb9ed640 1 --2- 172.21.15.62:0/81144456 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08e00039b0 0x7f08f40b1b20 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f08f000bb20 tx=0x7f08f0005f00 comp rx=0 tx=0).stop 2023-10-08T12:00:44.978 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.971+0000 7f08fb9ed640 1 -- 172.21.15.62:0/81144456 shutdown_connections 2023-10-08T12:00:44.978 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.971+0000 7f08fb9ed640 1 --2- 172.21.15.62:0/81144456 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f08d8066470 0x7f08d8068930 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:44.978 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.971+0000 7f08fb9ed640 1 --2- 172.21.15.62:0/81144456 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f08f41e5f90 0x7f08f40b4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:44.978 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.971+0000 7f08fb9ed640 1 --2- 172.21.15.62:0/81144456 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f08f40b3570 0x7f08f4145050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:44.978 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.971+0000 7f08fb9ed640 1 --2- 172.21.15.62:0/81144456 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08e00039b0 0x7f08f40b1b20 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:44.978 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.971+0000 7f08fb9ed640 1 -- 172.21.15.62:0/81144456 >> 172.21.15.62:0/81144456 conn(0x7f08f409c520 msgr2=0x7f08f40b8670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:44.978 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.971+0000 7f08fb9ed640 1 -- 172.21.15.62:0/81144456 shutdown_connections 2023-10-08T12:00:44.978 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:44.971+0000 7f08fb9ed640 1 -- 172.21.15.62:0/81144456 wait complete. 2023-10-08T12:00:44.992 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T12:00:45.123 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.119+0000 7f7cdb86d640 1 -- 172.21.15.62:0/3921254066 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7cc0003980 msgr2=0x7f7cc0003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:45.123 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.119+0000 7f7cdb86d640 1 --2- 172.21.15.62:0/3921254066 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7cc0003980 0x7f7cc0003da0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f7cd0009b60 tx=0x7f7cd001d250 comp rx=0 tx=0).stop 2023-10-08T12:00:45.123 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.119+0000 7f7cdb86d640 1 -- 172.21.15.62:0/3921254066 shutdown_connections 2023-10-08T12:00:45.123 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.119+0000 7f7cdb86d640 1 --2- 172.21.15.62:0/3921254066 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7cc0003980 0x7f7cc0003da0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:45.124 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.119+0000 7f7cdb86d640 1 -- 172.21.15.62:0/3921254066 >> 172.21.15.62:0/3921254066 conn(0x7f7cd409c520 msgr2=0x7f7cd409c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:45.124 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.119+0000 7f7cdb86d640 1 -- 172.21.15.62:0/3921254066 shutdown_connections 2023-10-08T12:00:45.124 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.119+0000 7f7cdb86d640 1 -- 172.21.15.62:0/3921254066 wait complete. 2023-10-08T12:00:45.126 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.119+0000 7f7cdb86d640 1 Processor -- start 2023-10-08T12:00:45.126 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.119+0000 7f7cdb86d640 1 -- start start 2023-10-08T12:00:45.127 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.119+0000 7f7cdb86d640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7cc0003980 0x7f7cd409dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:45.127 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.119+0000 7f7cdb86d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7cd4070860 0x7f7cd40b3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:45.127 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.119+0000 7f7cdb86d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7cd40b4110 0x7f7cd409f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:45.127 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.119+0000 7f7cdb86d640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd41e41f0 con 0x7f7cd4070860 2023-10-08T12:00:45.127 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.119+0000 7f7cdb86d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd41e4a20 con 0x7f7cd40b4110 2023-10-08T12:00:45.127 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.119+0000 7f7cdb86d640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd406e310 con 0x7f7cc0003980 2023-10-08T12:00:45.127 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.119+0000 7f7cd8e08640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7cd4070860 0x7f7cd40b3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:45.127 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.119+0000 7f7cd8e08640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7cd4070860 0x7f7cd40b3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43904/0 (socket says 172.21.15.62:43904) 2023-10-08T12:00:45.127 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.119+0000 7f7cd8e08640 1 -- 172.21.15.62:0/2759840634 learned_addr learned my addr 172.21.15.62:0/2759840634 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:45.128 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.119+0000 7f7cd9609640 1 --2- 172.21.15.62:0/2759840634 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7cc0003980 0x7f7cd409dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:45.128 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.119+0000 7f7cd9e0a640 1 --2- 172.21.15.62:0/2759840634 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7cd40b4110 0x7f7cd409f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:45.128 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.119+0000 7f7cd8e08640 1 -- 172.21.15.62:0/2759840634 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7cc0003980 msgr2=0x7f7cd409dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:45.128 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.119+0000 7f7cd8e08640 1 --2- 172.21.15.62:0/2759840634 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7cc0003980 0x7f7cd409dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:45.128 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.119+0000 7f7cd8e08640 1 -- 172.21.15.62:0/2759840634 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7cd40b4110 msgr2=0x7f7cd409f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:45.128 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.119+0000 7f7cd8e08640 1 --2- 172.21.15.62:0/2759840634 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7cd40b4110 0x7f7cd409f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:45.128 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.119+0000 7f7cd8e08640 1 -- 172.21.15.62:0/2759840634 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cd41e43d0 con 0x7f7cd4070860 2023-10-08T12:00:45.129 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.119+0000 7f7cd8e08640 1 --2- 172.21.15.62:0/2759840634 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7cd4070860 0x7f7cd40b3bd0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f7cc400d950 tx=0x7f7cc400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:45.129 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.123+0000 7f7cc9ffb640 1 -- 172.21.15.62:0/2759840634 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc40062e0 con 0x7f7cd4070860 2023-10-08T12:00:45.129 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.123+0000 7f7cc9ffb640 1 -- 172.21.15.62:0/2759840634 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7cc400b830 con 0x7f7cd4070860 2023-10-08T12:00:45.129 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.123+0000 7f7cdb86d640 1 -- 172.21.15.62:0/2759840634 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cd41e46b0 con 0x7f7cd4070860 2023-10-08T12:00:45.129 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.123+0000 7f7cc9ffb640 1 -- 172.21.15.62:0/2759840634 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc400bc40 con 0x7f7cd4070860 2023-10-08T12:00:45.129 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.123+0000 7f7cdb86d640 1 -- 172.21.15.62:0/2759840634 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cd40b45c0 con 0x7f7cd4070860 2023-10-08T12:00:45.129 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.123+0000 7f7cdb86d640 1 -- 172.21.15.62:0/2759840634 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cd40b5be0 con 0x7f7cd4070860 2023-10-08T12:00:45.130 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.123+0000 7f7cc9ffb640 1 -- 172.21.15.62:0/2759840634 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7cc4003600 con 0x7f7cd4070860 2023-10-08T12:00:45.130 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.123+0000 7f7cc9ffb640 1 --2- 172.21.15.62:0/2759840634 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f7cb80664a0 0x7f7cb8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:45.131 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.123+0000 7f7cc9ffb640 1 -- 172.21.15.62:0/2759840634 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7cc40848c0 con 0x7f7cd4070860 2023-10-08T12:00:45.131 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.123+0000 7f7cd9609640 1 --2- 172.21.15.62:0/2759840634 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f7cb80664a0 0x7f7cb8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:45.131 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.123+0000 7f7cd9609640 1 --2- 172.21.15.62:0/2759840634 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f7cb80664a0 0x7f7cb8068960 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7cd00ae000 tx=0x7f7cd0019ff0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:45.131 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.127+0000 7f7cc9ffb640 1 -- 172.21.15.62:0/2759840634 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7cc4051dd0 con 0x7f7cd4070860 2023-10-08T12:00:45.287 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.283+0000 7f7cdb86d640 1 -- 172.21.15.62:0/2759840634 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7cd41e4bd0 con 0x7f7cd4070860 2023-10-08T12:00:45.287 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.283+0000 7f7cc9ffb640 1 -- 172.21.15.62:0/2759840634 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7cd41e4bd0 con 0x7f7cd4070860 2023-10-08T12:00:45.288 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-10-08T12:00:45.290 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.287+0000 7f7cdb86d640 1 -- 172.21.15.62:0/2759840634 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f7cb80664a0 msgr2=0x7f7cb8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:45.290 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.287+0000 7f7cdb86d640 1 --2- 172.21.15.62:0/2759840634 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f7cb80664a0 0x7f7cb8068960 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7cd00ae000 tx=0x7f7cd0019ff0 comp rx=0 tx=0).stop 2023-10-08T12:00:45.290 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.287+0000 7f7cdb86d640 1 -- 172.21.15.62:0/2759840634 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7cd4070860 msgr2=0x7f7cd40b3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:45.290 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.287+0000 7f7cdb86d640 1 --2- 172.21.15.62:0/2759840634 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7cd4070860 0x7f7cd40b3bd0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f7cc400d950 tx=0x7f7cc400de10 comp rx=0 tx=0).stop 2023-10-08T12:00:45.290 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.287+0000 7f7cdb86d640 1 -- 172.21.15.62:0/2759840634 shutdown_connections 2023-10-08T12:00:45.290 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.287+0000 7f7cdb86d640 1 --2- 172.21.15.62:0/2759840634 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f7cb80664a0 0x7f7cb8068960 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:45.290 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.287+0000 7f7cdb86d640 1 --2- 172.21.15.62:0/2759840634 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7cd40b4110 0x7f7cd409f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:45.290 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.287+0000 7f7cdb86d640 1 --2- 172.21.15.62:0/2759840634 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7cd4070860 0x7f7cd40b3bd0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:45.291 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.287+0000 7f7cdb86d640 1 --2- 172.21.15.62:0/2759840634 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7cc0003980 0x7f7cd409dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:45.291 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.287+0000 7f7cdb86d640 1 -- 172.21.15.62:0/2759840634 >> 172.21.15.62:0/2759840634 conn(0x7f7cd409c520 msgr2=0x7f7cd4144ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:45.291 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.287+0000 7f7cdb86d640 1 -- 172.21.15.62:0/2759840634 shutdown_connections 2023-10-08T12:00:45.291 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.287+0000 7f7cdb86d640 1 -- 172.21.15.62:0/2759840634 wait complete. 2023-10-08T12:00:45.307 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T12:00:45.435 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.431+0000 7fc92b44c640 1 -- 172.21.15.62:0/1409416051 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9100039b0 msgr2=0x7fc910003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:45.435 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.431+0000 7fc92b44c640 1 --2- 172.21.15.62:0/1409416051 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9100039b0 0x7fc910003dd0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc920001680 tx=0x7fc92001c760 comp rx=0 tx=0).stop 2023-10-08T12:00:45.436 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.431+0000 7fc9299e9640 1 -- 172.21.15.62:0/1409416051 reap_dead start 2023-10-08T12:00:45.436 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.431+0000 7fc92b44c640 1 -- 172.21.15.62:0/1409416051 shutdown_connections 2023-10-08T12:00:45.436 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.431+0000 7fc92b44c640 1 -- 172.21.15.62:0/1409416051 >> 172.21.15.62:0/1409416051 conn(0x7fc92409e5b0 msgr2=0x7fc92409e9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:45.436 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.431+0000 7fc92b44c640 1 -- 172.21.15.62:0/1409416051 shutdown_connections 2023-10-08T12:00:45.436 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.431+0000 7fc92b44c640 1 -- 172.21.15.62:0/1409416051 wait complete. 2023-10-08T12:00:45.437 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.431+0000 7fc92b44c640 1 Processor -- start 2023-10-08T12:00:45.437 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.431+0000 7fc92b44c640 1 -- start start 2023-10-08T12:00:45.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.431+0000 7fc92b44c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9100039b0 0x7fc9240b5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:45.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.431+0000 7fc92b44c640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc924149570 0x7fc9241470f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:45.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.431+0000 7fc92b44c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc9241dfe00 0x7fc92413d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:45.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.431+0000 7fc92b44c640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc924147630 con 0x7fc9100039b0 2023-10-08T12:00:45.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.431+0000 7fc92b44c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9240b6440 con 0x7fc9241dfe00 2023-10-08T12:00:45.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.431+0000 7fc92b44c640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9241e3350 con 0x7fc924149570 2023-10-08T12:00:45.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.431+0000 7fc9291e8640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9100039b0 0x7fc9240b5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:45.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.431+0000 7fc9291e8640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9100039b0 0x7fc9240b5dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43912/0 (socket says 172.21.15.62:43912) 2023-10-08T12:00:45.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.431+0000 7fc9291e8640 1 -- 172.21.15.62:0/3842008132 learned_addr learned my addr 172.21.15.62:0/3842008132 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:45.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.431+0000 7fc9299e9640 1 --2- 172.21.15.62:0/3842008132 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc9241dfe00 0x7fc92413d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:45.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.435+0000 7fc9289e7640 1 --2- 172.21.15.62:0/3842008132 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc924149570 0x7fc9241470f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:45.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.435+0000 7fc9291e8640 1 -- 172.21.15.62:0/3842008132 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc924149570 msgr2=0x7fc9241470f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:45.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.435+0000 7fc9291e8640 1 --2- 172.21.15.62:0/3842008132 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc924149570 0x7fc9241470f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:45.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.435+0000 7fc9291e8640 1 -- 172.21.15.62:0/3842008132 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc9241dfe00 msgr2=0x7fc92413d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:45.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.435+0000 7fc9291e8640 1 --2- 172.21.15.62:0/3842008132 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc9241dfe00 0x7fc92413d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:45.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.435+0000 7fc9291e8640 1 -- 172.21.15.62:0/3842008132 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9241e35a0 con 0x7fc9100039b0 2023-10-08T12:00:45.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.435+0000 7fc9289e7640 1 --2- 172.21.15.62:0/3842008132 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc924149570 0x7fc9241470f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:00:45.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.435+0000 7fc9291e8640 1 --2- 172.21.15.62:0/3842008132 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9100039b0 0x7fc9240b5dd0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc92001c590 tx=0x7fc9200060c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:45.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.435+0000 7fc919ffb640 1 -- 172.21.15.62:0/3842008132 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc920003800 con 0x7fc9100039b0 2023-10-08T12:00:45.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.435+0000 7fc919ffb640 1 -- 172.21.15.62:0/3842008132 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc920003980 con 0x7fc9100039b0 2023-10-08T12:00:45.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.435+0000 7fc92b44c640 1 -- 172.21.15.62:0/3842008132 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9241e3880 con 0x7fc9100039b0 2023-10-08T12:00:45.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.435+0000 7fc919ffb640 1 -- 172.21.15.62:0/3842008132 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc920003d90 con 0x7fc9100039b0 2023-10-08T12:00:45.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.435+0000 7fc92b44c640 1 -- 172.21.15.62:0/3842008132 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9241e4080 con 0x7fc9100039b0 2023-10-08T12:00:45.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.435+0000 7fc92b44c640 1 -- 172.21.15.62:0/3842008132 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc92404da80 con 0x7fc9100039b0 2023-10-08T12:00:45.443 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.435+0000 7fc919ffb640 1 -- 172.21.15.62:0/3842008132 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc9200a7420 con 0x7fc9100039b0 2023-10-08T12:00:45.443 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.435+0000 7fc919ffb640 1 --2- 172.21.15.62:0/3842008132 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fc908066470 0x7fc908068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:45.443 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.435+0000 7fc919ffb640 1 -- 172.21.15.62:0/3842008132 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc92011e740 con 0x7fc9100039b0 2023-10-08T12:00:45.443 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.435+0000 7fc9289e7640 1 --2- 172.21.15.62:0/3842008132 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fc908066470 0x7fc908068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:45.443 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.439+0000 7fc9289e7640 1 --2- 172.21.15.62:0/3842008132 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fc908066470 0x7fc908068930 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc914001ec0 tx=0x7fc9140014e0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:45.445 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.439+0000 7fc919ffb640 1 -- 172.21.15.62:0/3842008132 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc9200ebd30 con 0x7fc9100039b0 2023-10-08T12:00:45.600 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.595+0000 7fc92b44c640 1 -- 172.21.15.62:0/3842008132 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc924071670 con 0x7fc9100039b0 2023-10-08T12:00:45.601 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.595+0000 7fc919ffb640 1 -- 172.21.15.62:0/3842008132 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc9200ad0a0 con 0x7fc9100039b0 2023-10-08T12:00:45.601 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 64 2023-10-08T12:00:45.604 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.599+0000 7fc92b44c640 1 -- 172.21.15.62:0/3842008132 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fc908066470 msgr2=0x7fc908068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:45.604 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.599+0000 7fc92b44c640 1 --2- 172.21.15.62:0/3842008132 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fc908066470 0x7fc908068930 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc914001ec0 tx=0x7fc9140014e0 comp rx=0 tx=0).stop 2023-10-08T12:00:45.604 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.599+0000 7fc92b44c640 1 -- 172.21.15.62:0/3842008132 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9100039b0 msgr2=0x7fc9240b5dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:45.604 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.599+0000 7fc92b44c640 1 --2- 172.21.15.62:0/3842008132 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9100039b0 0x7fc9240b5dd0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc92001c590 tx=0x7fc9200060c0 comp rx=0 tx=0).stop 2023-10-08T12:00:45.604 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.599+0000 7fc92b44c640 1 -- 172.21.15.62:0/3842008132 shutdown_connections 2023-10-08T12:00:45.604 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.599+0000 7fc92b44c640 1 --2- 172.21.15.62:0/3842008132 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fc908066470 0x7fc908068930 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:45.604 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.599+0000 7fc92b44c640 1 --2- 172.21.15.62:0/3842008132 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc924149570 0x7fc9241470f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:45.604 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.599+0000 7fc92b44c640 1 --2- 172.21.15.62:0/3842008132 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc9241dfe00 0x7fc92413d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:45.605 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.599+0000 7fc92b44c640 1 --2- 172.21.15.62:0/3842008132 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9100039b0 0x7fc9240b5dd0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:45.605 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.599+0000 7fc92b44c640 1 -- 172.21.15.62:0/3842008132 >> 172.21.15.62:0/3842008132 conn(0x7fc92409e5b0 msgr2=0x7fc924140c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:45.605 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.599+0000 7fc92b44c640 1 -- 172.21.15.62:0/3842008132 shutdown_connections 2023-10-08T12:00:45.605 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.599+0000 7fc92b44c640 1 -- 172.21.15.62:0/3842008132 wait complete. 2023-10-08T12:00:45.621 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-08T12:00:45.751 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.747+0000 7fe4ef1b2640 1 -- 172.21.15.62:0/597189162 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4d0003f00 msgr2=0x7fe4d00047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:45.752 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.747+0000 7fe4ef1b2640 1 --2- 172.21.15.62:0/597189162 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4d0003f00 0x7fe4d00047d0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8009b40 tx=0x7fe4d801d1d0 comp rx=0 tx=0).stop 2023-10-08T12:00:45.752 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.747+0000 7fe4ed74f640 1 -- 172.21.15.62:0/597189162 reap_dead start 2023-10-08T12:00:45.752 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.747+0000 7fe4ef1b2640 1 -- 172.21.15.62:0/597189162 shutdown_connections 2023-10-08T12:00:45.752 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.747+0000 7fe4ef1b2640 1 -- 172.21.15.62:0/597189162 >> 172.21.15.62:0/597189162 conn(0x7fe4e809c520 msgr2=0x7fe4e809c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:45.752 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.747+0000 7fe4ef1b2640 1 -- 172.21.15.62:0/597189162 shutdown_connections 2023-10-08T12:00:45.752 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.747+0000 7fe4ef1b2640 1 -- 172.21.15.62:0/597189162 wait complete. 2023-10-08T12:00:45.754 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.747+0000 7fe4ef1b2640 1 Processor -- start 2023-10-08T12:00:45.754 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.747+0000 7fe4ef1b2640 1 -- start start 2023-10-08T12:00:45.754 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.747+0000 7fe4ef1b2640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe4e806eec0 0x7fe4e81dd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:45.754 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.747+0000 7fe4ef1b2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4e806f2a0 0x7fe4e81dd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:45.755 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.747+0000 7fe4ef1b2640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe4e8140a80 0x7fe4e8140ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:45.755 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.747+0000 7fe4ef1b2640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e8071060 con 0x7fe4e806f2a0 2023-10-08T12:00:45.755 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.747+0000 7fe4ef1b2640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e81dcf10 con 0x7fe4e806eec0 2023-10-08T12:00:45.755 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.747+0000 7fe4ef1b2640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e8141420 con 0x7fe4e8140a80 2023-10-08T12:00:45.755 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.747+0000 7fe4e7fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4e806f2a0 0x7fe4e81dd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:45.755 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.747+0000 7fe4e7fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4e806f2a0 0x7fe4e81dd8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43936/0 (socket says 172.21.15.62:43936) 2023-10-08T12:00:45.755 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.747+0000 7fe4e7fff640 1 -- 172.21.15.62:0/3453881004 learned_addr learned my addr 172.21.15.62:0/3453881004 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:45.755 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.751+0000 7fe4ecf4e640 1 --2- 172.21.15.62:0/3453881004 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe4e806eec0 0x7fe4e81dd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:45.755 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.751+0000 7fe4ed74f640 1 --2- 172.21.15.62:0/3453881004 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe4e8140a80 0x7fe4e8140ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:45.755 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.751+0000 7fe4e7fff640 1 -- 172.21.15.62:0/3453881004 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe4e8140a80 msgr2=0x7fe4e8140ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:45.756 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.751+0000 7fe4e7fff640 1 --2- 172.21.15.62:0/3453881004 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe4e8140a80 0x7fe4e8140ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:45.756 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.751+0000 7fe4e7fff640 1 -- 172.21.15.62:0/3453881004 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe4e806eec0 msgr2=0x7fe4e81dd3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:45.756 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.751+0000 7fe4e7fff640 1 --2- 172.21.15.62:0/3453881004 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe4e806eec0 0x7fe4e81dd3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:45.756 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.751+0000 7fe4e7fff640 1 -- 172.21.15.62:0/3453881004 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4e80b2770 con 0x7fe4e806f2a0 2023-10-08T12:00:45.756 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.751+0000 7fe4ed74f640 1 --2- 172.21.15.62:0/3453881004 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe4e8140a80 0x7fe4e8140ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:00:45.756 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.751+0000 7fe4ecf4e640 1 --2- 172.21.15.62:0/3453881004 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe4e806eec0 0x7fe4e81dd3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:00:45.756 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.751+0000 7fe4e7fff640 1 --2- 172.21.15.62:0/3453881004 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4e806f2a0 0x7fe4e81dd8e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe4d801da70 tx=0x7fe4d80056a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:45.756 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.751+0000 7fe4e57fa640 1 -- 172.21.15.62:0/3453881004 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d8004790 con 0x7fe4e806f2a0 2023-10-08T12:00:45.756 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.751+0000 7fe4e57fa640 1 -- 172.21.15.62:0/3453881004 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe4d8004a00 con 0x7fe4e806f2a0 2023-10-08T12:00:45.757 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.751+0000 7fe4ef1b2640 1 -- 172.21.15.62:0/3453881004 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4e80707c0 con 0x7fe4e806f2a0 2023-10-08T12:00:45.757 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.751+0000 7fe4e57fa640 1 -- 172.21.15.62:0/3453881004 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d8004e10 con 0x7fe4e806f2a0 2023-10-08T12:00:45.757 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.751+0000 7fe4ef1b2640 1 -- 172.21.15.62:0/3453881004 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4e8070d80 con 0x7fe4e806f2a0 2023-10-08T12:00:45.758 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.751+0000 7fe4ef1b2640 1 -- 172.21.15.62:0/3453881004 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4e80b5be0 con 0x7fe4e806f2a0 2023-10-08T12:00:45.758 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.751+0000 7fe4e57fa640 1 -- 172.21.15.62:0/3453881004 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe4d80b7440 con 0x7fe4e806f2a0 2023-10-08T12:00:45.758 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.751+0000 7fe4e57fa640 1 --2- 172.21.15.62:0/3453881004 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fe4d40664a0 0x7fe4d4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:45.758 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.751+0000 7fe4e57fa640 1 -- 172.21.15.62:0/3453881004 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe4d811f390 con 0x7fe4e806f2a0 2023-10-08T12:00:45.758 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.751+0000 7fe4ecf4e640 1 --2- 172.21.15.62:0/3453881004 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fe4d40664a0 0x7fe4d4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:45.758 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.751+0000 7fe4ecf4e640 1 --2- 172.21.15.62:0/3453881004 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fe4d40664a0 0x7fe4d4068960 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc009b00 tx=0x7fe4dc0091e0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:45.760 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.755+0000 7fe4e57fa640 1 -- 172.21.15.62:0/3453881004 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe4d80ec900 con 0x7fe4e806f2a0 2023-10-08T12:00:45.922 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.919+0000 7fe4ef1b2640 1 -- 172.21.15.62:0/3453881004 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe4e804da80 con 0x7fe4e806f2a0 2023-10-08T12:00:45.923 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.919+0000 7fe4e57fa640 1 -- 172.21.15.62:0/3453881004 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe4d80c5080 con 0x7fe4e806f2a0 2023-10-08T12:00:45.923 INFO:teuthology.orchestra.run.smithi062.stderr:listed 0 entries 2023-10-08T12:00:45.925 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.919+0000 7fe4ef1b2640 1 -- 172.21.15.62:0/3453881004 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fe4d40664a0 msgr2=0x7fe4d4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:45.925 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.919+0000 7fe4ef1b2640 1 --2- 172.21.15.62:0/3453881004 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fe4d40664a0 0x7fe4d4068960 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc009b00 tx=0x7fe4dc0091e0 comp rx=0 tx=0).stop 2023-10-08T12:00:45.925 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.919+0000 7fe4ef1b2640 1 -- 172.21.15.62:0/3453881004 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4e806f2a0 msgr2=0x7fe4e81dd8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:45.925 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.919+0000 7fe4ef1b2640 1 --2- 172.21.15.62:0/3453881004 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4e806f2a0 0x7fe4e81dd8e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe4d801da70 tx=0x7fe4d80056a0 comp rx=0 tx=0).stop 2023-10-08T12:00:45.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.919+0000 7fe4ef1b2640 1 -- 172.21.15.62:0/3453881004 shutdown_connections 2023-10-08T12:00:45.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.919+0000 7fe4ef1b2640 1 --2- 172.21.15.62:0/3453881004 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fe4d40664a0 0x7fe4d4068960 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:45.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.919+0000 7fe4ef1b2640 1 --2- 172.21.15.62:0/3453881004 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe4e8140a80 0x7fe4e8140ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:45.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.919+0000 7fe4ef1b2640 1 --2- 172.21.15.62:0/3453881004 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4e806f2a0 0x7fe4e81dd8e0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:45.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.919+0000 7fe4ef1b2640 1 --2- 172.21.15.62:0/3453881004 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe4e806eec0 0x7fe4e81dd3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:45.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.919+0000 7fe4ef1b2640 1 -- 172.21.15.62:0/3453881004 >> 172.21.15.62:0/3453881004 conn(0x7fe4e809c520 msgr2=0x7fe4e8097d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:45.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.919+0000 7fe4ef1b2640 1 -- 172.21.15.62:0/3453881004 shutdown_connections 2023-10-08T12:00:45.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:45.919+0000 7fe4ef1b2640 1 -- 172.21.15.62:0/3453881004 wait complete. 2023-10-08T12:00:45.941 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-08T12:00:45.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:00:45.941 DEBUG:teuthology.orchestra.run.smithi156:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-10-08T12:00:46.016 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi156.front.sepia.ceph.com 2023-10-08T12:00:46.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:00:46.016 DEBUG:teuthology.orchestra.run.smithi156:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-08T12:00:46.048 INFO:tasks.cephfs.cephfs_test_case:[] 2023-10-08T12:00:46.048 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:00:46.181 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.175+0000 7f9b27b68640 1 -- 172.21.15.62:0/2638087394 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9b200b6a60 msgr2=0x7f9b2014a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:46.182 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.175+0000 7f9b27b68640 1 --2- 172.21.15.62:0/2638087394 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9b200b6a60 0x7f9b2014a250 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f9b10009840 tx=0x7f9b1001c800 comp rx=0 tx=0).stop 2023-10-08T12:00:46.182 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.175+0000 7f9b27b68640 1 -- 172.21.15.62:0/2638087394 shutdown_connections 2023-10-08T12:00:46.182 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.175+0000 7f9b27b68640 1 --2- 172.21.15.62:0/2638087394 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9b200b6a60 0x7f9b2014a250 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:46.182 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.175+0000 7f9b27b68640 1 --2- 172.21.15.62:0/2638087394 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9b200718c0 0x7f9b200b5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:46.182 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.175+0000 7f9b27b68640 1 -- 172.21.15.62:0/2638087394 >> 172.21.15.62:0/2638087394 conn(0x7f9b2009c520 msgr2=0x7f9b2009c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:46.182 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.175+0000 7f9b27b68640 1 -- 172.21.15.62:0/2638087394 shutdown_connections 2023-10-08T12:00:46.182 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.175+0000 7f9b27b68640 1 -- 172.21.15.62:0/2638087394 wait complete. 2023-10-08T12:00:46.184 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.179+0000 7f9b27b68640 1 Processor -- start 2023-10-08T12:00:46.184 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.179+0000 7f9b27b68640 1 -- start start 2023-10-08T12:00:46.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.179+0000 7f9b27b68640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9b200718c0 0x7f9b200b1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:46.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.179+0000 7f9b27b68640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9b200b6a60 0x7f9b20143b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:46.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.179+0000 7f9b27b68640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9b2014a790 0x7f9b201e2890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:46.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.179+0000 7f9b27b68640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b20144070 con 0x7f9b200718c0 2023-10-08T12:00:46.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.179+0000 7f9b27b68640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b20098b90 con 0x7f9b2014a790 2023-10-08T12:00:46.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.179+0000 7f9b27b68640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b20151140 con 0x7f9b200b6a60 2023-10-08T12:00:46.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.179+0000 7f9b25904640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9b200718c0 0x7f9b200b1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:46.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.179+0000 7f9b25904640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9b200718c0 0x7f9b200b1ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49066/0 (socket says 172.21.15.62:49066) 2023-10-08T12:00:46.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.179+0000 7f9b25904640 1 -- 172.21.15.62:0/22263019 learned_addr learned my addr 172.21.15.62:0/22263019 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:46.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.179+0000 7f9b25904640 1 -- 172.21.15.62:0/22263019 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9b200b6a60 msgr2=0x7f9b20143b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:46.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.179+0000 7f9b25904640 1 --2- 172.21.15.62:0/22263019 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9b200b6a60 0x7f9b20143b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:46.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.179+0000 7f9b26105640 1 --2- 172.21.15.62:0/22263019 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9b2014a790 0x7f9b201e2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:46.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.179+0000 7f9b25904640 1 -- 172.21.15.62:0/22263019 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9b2014a790 msgr2=0x7f9b201e2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:46.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.179+0000 7f9b25904640 1 --2- 172.21.15.62:0/22263019 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9b2014a790 0x7f9b201e2890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:46.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.179+0000 7f9b25904640 1 -- 172.21.15.62:0/22263019 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b100094a0 con 0x7f9b200718c0 2023-10-08T12:00:46.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.179+0000 7f9b26105640 1 --2- 172.21.15.62:0/22263019 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9b2014a790 0x7f9b201e2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:00:46.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.179+0000 7f9b25904640 1 --2- 172.21.15.62:0/22263019 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9b200718c0 0x7f9b200b1ce0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f9b18009fd0 tx=0x7f9b1800c270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:46.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.179+0000 7f9b167fc640 1 -- 172.21.15.62:0/22263019 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b18011470 con 0x7f9b200718c0 2023-10-08T12:00:46.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.179+0000 7f9b167fc640 1 -- 172.21.15.62:0/22263019 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f9b180116c0 con 0x7f9b200718c0 2023-10-08T12:00:46.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.179+0000 7f9b27b68640 1 -- 172.21.15.62:0/22263019 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b201e2400 con 0x7f9b200718c0 2023-10-08T12:00:46.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.179+0000 7f9b167fc640 1 -- 172.21.15.62:0/22263019 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b18011ab0 con 0x7f9b200718c0 2023-10-08T12:00:46.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.179+0000 7f9b27b68640 1 -- 172.21.15.62:0/22263019 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b200b15e0 con 0x7f9b200718c0 2023-10-08T12:00:46.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.179+0000 7f9b27b68640 1 -- 172.21.15.62:0/22263019 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b2004da80 con 0x7f9b200718c0 2023-10-08T12:00:46.187 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.179+0000 7f9b167fc640 1 -- 172.21.15.62:0/22263019 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f9b18011c10 con 0x7f9b200718c0 2023-10-08T12:00:46.187 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.183+0000 7f9b167fc640 1 --2- 172.21.15.62:0/22263019 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f9b04066470 0x7f9b04068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:46.187 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.183+0000 7f9b167fc640 1 -- 172.21.15.62:0/22263019 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9b18084950 con 0x7f9b200718c0 2023-10-08T12:00:46.188 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.183+0000 7f9b25103640 1 --2- 172.21.15.62:0/22263019 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f9b04066470 0x7f9b04068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:46.188 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.183+0000 7f9b25103640 1 --2- 172.21.15.62:0/22263019 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f9b04066470 0x7f9b04068930 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9b100af000 tx=0x7f9b100195a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:46.189 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.187+0000 7f9b167fc640 1 -- 172.21.15.62:0/22263019 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9b18051e60 con 0x7f9b200718c0 2023-10-08T12:00:46.373 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.367+0000 7f9b27b68640 1 -- 172.21.15.62:0/22263019 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9b200b1580 con 0x7f9b200718c0 2023-10-08T12:00:46.373 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.371+0000 7f9b167fc640 1 -- 172.21.15.62:0/22263019 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4120 (secure 0 0 0) 0x7f9b1801f020 con 0x7f9b200718c0 2023-10-08T12:00:46.374 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T12:00:46.374 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4334,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/2629778704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":2629778704},{"type":"v1","addr":"172.21.15.130:6835","nonce":2629778704}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4359,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/2134446062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":2134446062},{"type":"v1","addr":"172.21.15.62:6835","nonce":2134446062}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T12:00:19.866714+0000","modified":"2023-10-08T12:00:22.958677+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4362},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4362":{"gid":4362,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6834/2629384568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":2629384568},{"type":"v1","addr":"172.21.15.62:6834","nonce":2629384568}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:00:46.374 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 8 2023-10-08T12:00:46.376 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.371+0000 7f9b27b68640 1 -- 172.21.15.62:0/22263019 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f9b04066470 msgr2=0x7f9b04068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:46.376 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.371+0000 7f9b27b68640 1 --2- 172.21.15.62:0/22263019 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f9b04066470 0x7f9b04068930 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9b100af000 tx=0x7f9b100195a0 comp rx=0 tx=0).stop 2023-10-08T12:00:46.376 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.371+0000 7f9b27b68640 1 -- 172.21.15.62:0/22263019 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9b200718c0 msgr2=0x7f9b200b1ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:46.376 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.371+0000 7f9b27b68640 1 --2- 172.21.15.62:0/22263019 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9b200718c0 0x7f9b200b1ce0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f9b18009fd0 tx=0x7f9b1800c270 comp rx=0 tx=0).stop 2023-10-08T12:00:46.376 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.371+0000 7f9b27b68640 1 -- 172.21.15.62:0/22263019 shutdown_connections 2023-10-08T12:00:46.376 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.371+0000 7f9b27b68640 1 --2- 172.21.15.62:0/22263019 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f9b04066470 0x7f9b04068930 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:46.377 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.371+0000 7f9b27b68640 1 --2- 172.21.15.62:0/22263019 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9b200b6a60 0x7f9b20143b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:46.377 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.371+0000 7f9b27b68640 1 --2- 172.21.15.62:0/22263019 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9b2014a790 0x7f9b201e2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:46.377 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.371+0000 7f9b27b68640 1 --2- 172.21.15.62:0/22263019 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9b200718c0 0x7f9b200b1ce0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:46.377 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.371+0000 7f9b27b68640 1 -- 172.21.15.62:0/22263019 >> 172.21.15.62:0/22263019 conn(0x7f9b2009c520 msgr2=0x7f9b2009b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:46.377 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.371+0000 7f9b27b68640 1 -- 172.21.15.62:0/22263019 shutdown_connections 2023-10-08T12:00:46.377 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.371+0000 7f9b27b68640 1 -- 172.21.15.62:0/22263019 wait complete. 2023-10-08T12:00:46.392 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:00:46.506 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.499+0000 7efdd1737640 1 -- 172.21.15.62:0/50315197 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efdac0039b0 msgr2=0x7efdac003db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:46.506 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.499+0000 7efdd1737640 1 --2- 172.21.15.62:0/50315197 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efdac0039b0 0x7efdac003db0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7efdbc00c260 tx=0x7efdbc01cfe0 comp rx=0 tx=0).stop 2023-10-08T12:00:46.506 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.503+0000 7efdcb7fe640 1 -- 172.21.15.62:0/50315197 reap_dead start 2023-10-08T12:00:46.506 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.503+0000 7efdd1737640 1 -- 172.21.15.62:0/50315197 shutdown_connections 2023-10-08T12:00:46.507 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.503+0000 7efdd1737640 1 -- 172.21.15.62:0/50315197 >> 172.21.15.62:0/50315197 conn(0x7efdcc09c520 msgr2=0x7efdcc09c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:46.507 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.503+0000 7efdd1737640 1 -- 172.21.15.62:0/50315197 shutdown_connections 2023-10-08T12:00:46.507 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.503+0000 7efdd1737640 1 -- 172.21.15.62:0/50315197 wait complete. 2023-10-08T12:00:46.509 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.503+0000 7efdd1737640 1 Processor -- start 2023-10-08T12:00:46.509 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.503+0000 7efdd1737640 1 -- start start 2023-10-08T12:00:46.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.503+0000 7efdd1737640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efdcc098f20 0x7efdcc14ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:46.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.503+0000 7efdd1737640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efdcc142560 0x7efdcc0aff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:46.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.503+0000 7efdd1737640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efdcc0b04d0 0x7efdcc1407d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:46.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.503+0000 7efdd1737640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdcc0b17f0 con 0x7efdcc098f20 2023-10-08T12:00:46.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.503+0000 7efdd1737640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdcc0afb00 con 0x7efdcc142560 2023-10-08T12:00:46.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.503+0000 7efdd1737640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdcc14bf70 con 0x7efdcc0b04d0 2023-10-08T12:00:46.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.503+0000 7efdcaffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efdcc098f20 0x7efdcc14ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:46.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.503+0000 7efdcaffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efdcc098f20 0x7efdcc14ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49090/0 (socket says 172.21.15.62:49090) 2023-10-08T12:00:46.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.503+0000 7efdcaffd640 1 -- 172.21.15.62:0/2810917889 learned_addr learned my addr 172.21.15.62:0/2810917889 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:46.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.503+0000 7efdca7fc640 1 --2- 172.21.15.62:0/2810917889 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efdcc142560 0x7efdcc0aff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:46.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.503+0000 7efdcb7fe640 1 --2- 172.21.15.62:0/2810917889 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efdcc0b04d0 0x7efdcc1407d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:46.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.503+0000 7efdcaffd640 1 -- 172.21.15.62:0/2810917889 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efdcc0b04d0 msgr2=0x7efdcc1407d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:46.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.503+0000 7efdcaffd640 1 --2- 172.21.15.62:0/2810917889 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efdcc0b04d0 0x7efdcc1407d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:46.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.503+0000 7efdcaffd640 1 -- 172.21.15.62:0/2810917889 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efdcc142560 msgr2=0x7efdcc0aff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:46.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.503+0000 7efdcaffd640 1 --2- 172.21.15.62:0/2810917889 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efdcc142560 0x7efdcc0aff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:46.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.503+0000 7efdcaffd640 1 -- 172.21.15.62:0/2810917889 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdcc0b0950 con 0x7efdcc098f20 2023-10-08T12:00:46.513 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.503+0000 7efdcb7fe640 1 --2- 172.21.15.62:0/2810917889 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efdcc0b04d0 0x7efdcc1407d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:00:46.513 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.503+0000 7efdcaffd640 1 --2- 172.21.15.62:0/2810917889 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efdcc098f20 0x7efdcc14ba30 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7efdbc098a00 tx=0x7efdbc001d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:46.513 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.503+0000 7efdc37fe640 1 -- 172.21.15.62:0/2810917889 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdbc0b3070 con 0x7efdcc098f20 2023-10-08T12:00:46.513 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.503+0000 7efdc37fe640 1 -- 172.21.15.62:0/2810917889 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7efdbc001440 con 0x7efdcc098f20 2023-10-08T12:00:46.513 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.503+0000 7efdd1737640 1 -- 172.21.15.62:0/2810917889 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdcc14ccc0 con 0x7efdcc098f20 2023-10-08T12:00:46.513 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.503+0000 7efdc37fe640 1 -- 172.21.15.62:0/2810917889 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdbc003600 con 0x7efdcc098f20 2023-10-08T12:00:46.513 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.503+0000 7efdd1737640 1 -- 172.21.15.62:0/2810917889 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdcc0af790 con 0x7efdcc098f20 2023-10-08T12:00:46.514 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.503+0000 7efdd1737640 1 -- 172.21.15.62:0/2810917889 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdcc1419d0 con 0x7efdcc098f20 2023-10-08T12:00:46.515 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.507+0000 7efdc37fe640 1 -- 172.21.15.62:0/2810917889 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7efdbc0ab020 con 0x7efdcc098f20 2023-10-08T12:00:46.515 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.507+0000 7efdc37fe640 1 --2- 172.21.15.62:0/2810917889 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7efdb00664f0 0x7efdb00689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:46.515 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.507+0000 7efdc37fe640 1 -- 172.21.15.62:0/2810917889 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efdbc11e130 con 0x7efdcc098f20 2023-10-08T12:00:46.515 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.507+0000 7efdca7fc640 1 --2- 172.21.15.62:0/2810917889 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7efdb00664f0 0x7efdb00689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:46.515 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.507+0000 7efdca7fc640 1 --2- 172.21.15.62:0/2810917889 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7efdb00664f0 0x7efdb00689b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7efdb4005f50 tx=0x7efdb4005e60 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:46.515 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.511+0000 7efdc37fe640 1 -- 172.21.15.62:0/2810917889 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7efdbc0eb690 con 0x7efdcc098f20 2023-10-08T12:00:46.663 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.659+0000 7efdd1737640 1 -- 172.21.15.62:0/2810917889 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efdcc04da80 con 0x7efdcc098f20 2023-10-08T12:00:46.666 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.663+0000 7efdc37fe640 1 -- 172.21.15.62:0/2810917889 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16481 (secure 0 0 0) 0x7efdbc0be090 con 0x7efdcc098f20 2023-10-08T12:00:46.669 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T12:00:46.670 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":20,"fsid":"3e777930-c2c1-4f2b-a903-c07ee4ca2c52","created":"2023-10-08T11:59:54.510229+0000","modified":"2023-10-08T12:00:21.580704+0000","last_up_change":"2023-10-08T12:00:06.783998+0000","last_in_change":"2023-10-08T11:59:57.847944+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:00:07.189433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:00:17.895548+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T12:00:18.871217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7bc3070a-7240-43d9-9ec3-397b68a37e2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6820","nonce":2227876905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6824","nonce":2227876905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6831","nonce":2227876905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6828","nonce":2227876905}]},"public_addr":"172.21.15.62:6820/2227876905","cluster_addr":"172.21.15.62:6824/2227876905","heartbeat_back_addr":"172.21.15.62:6831/2227876905","heartbeat_front_addr":"172.21.15.62:6828/2227876905","state":["exists","up"]},{"osd":1,"uuid":"5e0fa1f5-9ddc-4882-b460-5578bb571003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6801","nonce":315660906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6803","nonce":315660906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6808","nonce":315660906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6805","nonce":315660906}]},"public_addr":"172.21.15.62:6801/315660906","cluster_addr":"172.21.15.62:6803/315660906","heartbeat_back_addr":"172.21.15.62:6808/315660906","heartbeat_front_addr":"172.21.15.62:6805/315660906","state":["exists","up"]},{"osd":2,"uuid":"262b5ee9-4243-4309-a14f-88ad4e8bf812","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6807","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6809","nonce":3784842938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6811","nonce":3784842938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6815","nonce":3784842938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6813","nonce":3784842938}]},"public_addr":"172.21.15.62:6809/3784842938","cluster_addr":"172.21.15.62:6811/3784842938","heartbeat_back_addr":"172.21.15.62:6815/3784842938","heartbeat_front_addr":"172.21.15.62:6813/3784842938","state":["exists","up"]},{"osd":3,"uuid":"1770bdb8-c12b-43b1-aaab-1d6b6fd18f4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6817","nonce":3385303160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6821","nonce":3385303160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6827","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6829","nonce":3385303160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6823","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6825","nonce":3385303160}]},"public_addr":"172.21.15.62:6817/3385303160","cluster_addr":"172.21.15.62:6821/3385303160","heartbeat_back_addr":"172.21.15.62:6829/3385303160","heartbeat_front_addr":"172.21.15.62:6825/3385303160","state":["exists","up"]},{"osd":4,"uuid":"74c73631-9351-494a-8246-28ee86e9f862","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6807","nonce":1174056987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6809","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6811","nonce":1174056987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6820","nonce":1174056987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6813","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6816","nonce":1174056987}]},"public_addr":"172.21.15.130:6807/1174056987","cluster_addr":"172.21.15.130:6811/1174056987","heartbeat_back_addr":"172.21.15.130:6820/1174056987","heartbeat_front_addr":"172.21.15.130:6816/1174056987","state":["exists","up"]},{"osd":5,"uuid":"1040f389-272c-41d6-ae76-70c04d09afa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6801","nonce":561928414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6803","nonce":561928414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6815","nonce":561928414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6808","nonce":561928414}]},"public_addr":"172.21.15.130:6801/561928414","cluster_addr":"172.21.15.130:6803/561928414","heartbeat_back_addr":"172.21.15.130:6815/561928414","heartbeat_front_addr":"172.21.15.130:6808/561928414","state":["exists","up"]},{"osd":6,"uuid":"178553eb-03e1-4ab8-9826-4f5997e6da0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6810","nonce":2877303015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6817","nonce":2877303015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6823","nonce":2877303015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6819","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6821","nonce":2877303015}]},"public_addr":"172.21.15.130:6810/2877303015","cluster_addr":"172.21.15.130:6817/2877303015","heartbeat_back_addr":"172.21.15.130:6823/2877303015","heartbeat_front_addr":"172.21.15.130:6821/2877303015","state":["exists","up"]},{"osd":7,"uuid":"b6581c8f-30b1-4dfd-b7b6-94b579128835","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6825","nonce":680009774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6827","nonce":680009774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6831","nonce":680009774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6829","nonce":680009774}]},"public_addr":"172.21.15.130:6825/680009774","cluster_addr":"172.21.15.130:6827/680009774","heartbeat_back_addr":"172.21.15.130:6831/680009774","heartbeat_front_addr":"172.21.15.130:6829/680009774","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.505543+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.394383+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.456652+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.529168+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.235414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.392158+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.347556+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.432039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:00:46.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.663+0000 7efdd1737640 1 -- 172.21.15.62:0/2810917889 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7efdb00664f0 msgr2=0x7efdb00689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:46.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.663+0000 7efdd1737640 1 --2- 172.21.15.62:0/2810917889 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7efdb00664f0 0x7efdb00689b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7efdb4005f50 tx=0x7efdb4005e60 comp rx=0 tx=0).stop 2023-10-08T12:00:46.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.663+0000 7efdd1737640 1 -- 172.21.15.62:0/2810917889 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efdcc098f20 msgr2=0x7efdcc14ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:46.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.663+0000 7efdd1737640 1 --2- 172.21.15.62:0/2810917889 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efdcc098f20 0x7efdcc14ba30 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7efdbc098a00 tx=0x7efdbc001d30 comp rx=0 tx=0).stop 2023-10-08T12:00:46.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.663+0000 7efdd1737640 1 -- 172.21.15.62:0/2810917889 shutdown_connections 2023-10-08T12:00:46.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.663+0000 7efdd1737640 1 --2- 172.21.15.62:0/2810917889 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7efdb00664f0 0x7efdb00689b0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:46.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.663+0000 7efdd1737640 1 --2- 172.21.15.62:0/2810917889 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efdcc0b04d0 0x7efdcc1407d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:46.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.663+0000 7efdd1737640 1 --2- 172.21.15.62:0/2810917889 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efdcc142560 0x7efdcc0aff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:46.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.663+0000 7efdd1737640 1 --2- 172.21.15.62:0/2810917889 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efdcc098f20 0x7efdcc14ba30 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:46.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.663+0000 7efdd1737640 1 -- 172.21.15.62:0/2810917889 >> 172.21.15.62:0/2810917889 conn(0x7efdcc09c520 msgr2=0x7efdcc143d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:46.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.663+0000 7efdd1737640 1 -- 172.21.15.62:0/2810917889 shutdown_connections 2023-10-08T12:00:46.672 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.663+0000 7efdd1737640 1 -- 172.21.15.62:0/2810917889 wait complete. 2023-10-08T12:00:46.684 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T12:00:07.189433+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T12:00:17.895548+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T12:00:18.871217+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T12:00:46.685 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T12:00:46.807 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.803+0000 7f0045c8f640 1 -- 172.21.15.62:0/4079385398 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00400ba340 msgr2=0x7f00400b5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:46.807 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.803+0000 7f0045c8f640 1 --2- 172.21.15.62:0/4079385398 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00400ba340 0x7f00400b5a70 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f0030009900 tx=0x7f003001c7f0 comp rx=0 tx=0).stop 2023-10-08T12:00:46.807 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.803+0000 7f0045c8f640 1 -- 172.21.15.62:0/4079385398 shutdown_connections 2023-10-08T12:00:46.807 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.803+0000 7f0045c8f640 1 --2- 172.21.15.62:0/4079385398 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00400ba340 0x7f00400b5a70 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:46.807 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.803+0000 7f0045c8f640 1 -- 172.21.15.62:0/4079385398 >> 172.21.15.62:0/4079385398 conn(0x7f004009c520 msgr2=0x7f004009c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:46.808 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.803+0000 7f0045c8f640 1 -- 172.21.15.62:0/4079385398 shutdown_connections 2023-10-08T12:00:46.808 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.803+0000 7f0045c8f640 1 -- 172.21.15.62:0/4079385398 wait complete. 2023-10-08T12:00:46.810 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.803+0000 7f0045c8f640 1 Processor -- start 2023-10-08T12:00:46.810 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.803+0000 7f0045c8f640 1 -- start start 2023-10-08T12:00:46.810 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.803+0000 7f0045c8f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f004006b1c0 0x7f004013fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:46.810 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.803+0000 7f0045c8f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00400b9900 0x7f00401e05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:46.810 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.803+0000 7f0045c8f640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f00400ba340 0x7f00401e0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:46.810 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.803+0000 7f0045c8f640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00401e4740 con 0x7f004006b1c0 2023-10-08T12:00:46.810 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.803+0000 7f0045c8f640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00401403d0 con 0x7f00400b9900 2023-10-08T12:00:46.810 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.803+0000 7f0045c8f640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00401e3e10 con 0x7f00400ba340 2023-10-08T12:00:46.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.803+0000 7f003f7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f004006b1c0 0x7f004013fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:46.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.803+0000 7f003f7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f004006b1c0 0x7f004013fe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49116/0 (socket says 172.21.15.62:49116) 2023-10-08T12:00:46.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.803+0000 7f003f7fe640 1 -- 172.21.15.62:0/1507201331 learned_addr learned my addr 172.21.15.62:0/1507201331 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:46.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.803+0000 7f0037fff640 1 --2- 172.21.15.62:0/1507201331 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00400b9900 0x7f00401e05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:46.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.803+0000 7f003ffff640 1 --2- 172.21.15.62:0/1507201331 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f00400ba340 0x7f00401e0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:46.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.803+0000 7f003f7fe640 1 -- 172.21.15.62:0/1507201331 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f00400ba340 msgr2=0x7f00401e0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:46.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.803+0000 7f003f7fe640 1 --2- 172.21.15.62:0/1507201331 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f00400ba340 0x7f00401e0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:46.814 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.803+0000 7f003f7fe640 1 -- 172.21.15.62:0/1507201331 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00400b9900 msgr2=0x7f00401e05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:46.814 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.803+0000 7f003f7fe640 1 --2- 172.21.15.62:0/1507201331 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00400b9900 0x7f00401e05c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:46.814 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.803+0000 7f003f7fe640 1 -- 172.21.15.62:0/1507201331 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0030009560 con 0x7f004006b1c0 2023-10-08T12:00:46.814 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.803+0000 7f003f7fe640 1 --2- 172.21.15.62:0/1507201331 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f004006b1c0 0x7f004013fe90 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f002800c4d0 tx=0x7f002800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:46.814 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.803+0000 7f003cff9640 1 -- 172.21.15.62:0/1507201331 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0028005480 con 0x7f004006b1c0 2023-10-08T12:00:46.814 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.803+0000 7f003cff9640 1 -- 172.21.15.62:0/1507201331 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f00280036f0 con 0x7f004006b1c0 2023-10-08T12:00:46.814 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.803+0000 7f0045c8f640 1 -- 172.21.15.62:0/1507201331 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00401e40f0 con 0x7f004006b1c0 2023-10-08T12:00:46.814 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.803+0000 7f003cff9640 1 -- 172.21.15.62:0/1507201331 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0028003b00 con 0x7f004006b1c0 2023-10-08T12:00:46.814 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.807+0000 7f0045c8f640 1 -- 172.21.15.62:0/1507201331 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00401e3ac0 con 0x7f004006b1c0 2023-10-08T12:00:46.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.807+0000 7f0045c8f640 1 -- 172.21.15.62:0/1507201331 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00401e45a0 con 0x7f004006b1c0 2023-10-08T12:00:46.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.807+0000 7f003cff9640 1 -- 172.21.15.62:0/1507201331 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f0028003c60 con 0x7f004006b1c0 2023-10-08T12:00:46.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.807+0000 7f003cff9640 1 --2- 172.21.15.62:0/1507201331 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f0020066470 0x7f0020068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:46.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.807+0000 7f003cff9640 1 -- 172.21.15.62:0/1507201331 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0028083660 con 0x7f004006b1c0 2023-10-08T12:00:46.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.807+0000 7f0037fff640 1 --2- 172.21.15.62:0/1507201331 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f0020066470 0x7f0020068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:46.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.807+0000 7f0037fff640 1 --2- 172.21.15.62:0/1507201331 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f0020066470 0x7f0020068930 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f00300af000 tx=0x7f003001b030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:46.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.811+0000 7f003cff9640 1 -- 172.21.15.62:0/1507201331 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f00401e45a0 con 0x7f004006b1c0 2023-10-08T12:00:46.970 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.967+0000 7f0045c8f640 1 -- 172.21.15.62:0/1507201331 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f00401e45a0 con 0x7f004006b1c0 2023-10-08T12:00:46.971 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.967+0000 7f003cff9640 1 -- 172.21.15.62:0/1507201331 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0028017020 con 0x7f004006b1c0 2023-10-08T12:00:46.971 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2023-10-08T12:00:46.973 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.967+0000 7f0045c8f640 1 -- 172.21.15.62:0/1507201331 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f0020066470 msgr2=0x7f0020068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:46.973 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.967+0000 7f0045c8f640 1 --2- 172.21.15.62:0/1507201331 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f0020066470 0x7f0020068930 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f00300af000 tx=0x7f003001b030 comp rx=0 tx=0).stop 2023-10-08T12:00:46.974 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.967+0000 7f0045c8f640 1 -- 172.21.15.62:0/1507201331 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f004006b1c0 msgr2=0x7f004013fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:46.974 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.967+0000 7f0045c8f640 1 --2- 172.21.15.62:0/1507201331 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f004006b1c0 0x7f004013fe90 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f002800c4d0 tx=0x7f002800c990 comp rx=0 tx=0).stop 2023-10-08T12:00:46.974 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.967+0000 7f0045c8f640 1 -- 172.21.15.62:0/1507201331 shutdown_connections 2023-10-08T12:00:46.974 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.967+0000 7f0045c8f640 1 --2- 172.21.15.62:0/1507201331 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f0020066470 0x7f0020068930 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:46.974 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.967+0000 7f0045c8f640 1 --2- 172.21.15.62:0/1507201331 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f00400ba340 0x7f00401e0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:46.974 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.967+0000 7f0045c8f640 1 --2- 172.21.15.62:0/1507201331 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00400b9900 0x7f00401e05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:46.975 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.967+0000 7f0045c8f640 1 --2- 172.21.15.62:0/1507201331 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f004006b1c0 0x7f004013fe90 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:46.975 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.967+0000 7f0045c8f640 1 -- 172.21.15.62:0/1507201331 >> 172.21.15.62:0/1507201331 conn(0x7f004009c520 msgr2=0x7f0040098cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:46.975 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.967+0000 7f0045c8f640 1 -- 172.21.15.62:0/1507201331 shutdown_connections 2023-10-08T12:00:46.975 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:46.967+0000 7f0045c8f640 1 -- 172.21.15.62:0/1507201331 wait complete. 2023-10-08T12:00:46.990 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T12:00:47.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.115+0000 7f8d51e19640 1 -- 172.21.15.62:0/521598400 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d4c0b9900 msgr2=0x7f8d4c14fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:47.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.115+0000 7f8d51e19640 1 --2- 172.21.15.62:0/521598400 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d4c0b9900 0x7f8d4c14fd40 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c073400 tx=0x7f8d4401db80 comp rx=0 tx=0).stop 2023-10-08T12:00:47.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.115+0000 7f8d51e19640 1 -- 172.21.15.62:0/521598400 shutdown_connections 2023-10-08T12:00:47.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.115+0000 7f8d51e19640 1 --2- 172.21.15.62:0/521598400 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d4c0b9900 0x7f8d4c14fd40 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:47.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.115+0000 7f8d51e19640 1 --2- 172.21.15.62:0/521598400 >> v2:172.21.15.130:3300/0 conn(0x7f8d4c06b1c0 0x7f8d4c0b5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:47.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.115+0000 7f8d51e19640 1 -- 172.21.15.62:0/521598400 >> 172.21.15.62:0/521598400 conn(0x7f8d4c09c520 msgr2=0x7f8d4c09c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:47.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.115+0000 7f8d51e19640 1 -- 172.21.15.62:0/521598400 shutdown_connections 2023-10-08T12:00:47.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.115+0000 7f8d51e19640 1 -- 172.21.15.62:0/521598400 wait complete. 2023-10-08T12:00:47.117 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.115+0000 7f8d51e19640 1 Processor -- start 2023-10-08T12:00:47.117 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.115+0000 7f8d51e19640 1 -- start start 2023-10-08T12:00:47.118 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.115+0000 7f8d51e19640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8d4c06b1c0 0x7f8d4c06dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:47.118 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.115+0000 7f8d51e19640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d4c0b9900 0x7f8d4c09fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:47.118 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.115+0000 7f8d51e19640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8d4c0ba340 0x7f8d4c14f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:47.118 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.115+0000 7f8d51e19640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4c09f740 con 0x7f8d4c0b9900 2023-10-08T12:00:47.118 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.115+0000 7f8d51e19640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4c06e5c0 con 0x7f8d4c06b1c0 2023-10-08T12:00:47.118 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.115+0000 7f8d51e19640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4c09ee50 con 0x7f8d4c0ba340 2023-10-08T12:00:47.118 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.115+0000 7f8d4affd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d4c0b9900 0x7f8d4c09fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:47.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.115+0000 7f8d4affd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d4c0b9900 0x7f8d4c09fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49130/0 (socket says 172.21.15.62:49130) 2023-10-08T12:00:47.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.115+0000 7f8d4affd640 1 -- 172.21.15.62:0/3290719332 learned_addr learned my addr 172.21.15.62:0/3290719332 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:47.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.115+0000 7f8d4b7fe640 1 --2- 172.21.15.62:0/3290719332 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8d4c06b1c0 0x7f8d4c06dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:47.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.115+0000 7f8d4affd640 1 -- 172.21.15.62:0/3290719332 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8d4c0ba340 msgr2=0x7f8d4c14f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:47.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.115+0000 7f8d4affd640 1 --2- 172.21.15.62:0/3290719332 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8d4c0ba340 0x7f8d4c14f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:47.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.115+0000 7f8d4affd640 1 -- 172.21.15.62:0/3290719332 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8d4c06b1c0 msgr2=0x7f8d4c06dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:47.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.115+0000 7f8d4affd640 1 --2- 172.21.15.62:0/3290719332 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8d4c06b1c0 0x7f8d4c06dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:47.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.115+0000 7f8d4affd640 1 -- 172.21.15.62:0/3290719332 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d4400a9f0 con 0x7f8d4c0b9900 2023-10-08T12:00:47.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.115+0000 7f8d4affd640 1 --2- 172.21.15.62:0/3290719332 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d4c0b9900 0x7f8d4c09fb60 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c00b3e0 tx=0x7f8d3c00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:47.120 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.115+0000 7f8d43fff640 1 -- 172.21.15.62:0/3290719332 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d3c011830 con 0x7f8d4c0b9900 2023-10-08T12:00:47.120 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.115+0000 7f8d43fff640 1 -- 172.21.15.62:0/3290719332 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8d3c011a80 con 0x7f8d4c0b9900 2023-10-08T12:00:47.120 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.115+0000 7f8d51e19640 1 -- 172.21.15.62:0/3290719332 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d4c1465d0 con 0x7f8d4c0b9900 2023-10-08T12:00:47.120 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.115+0000 7f8d43fff640 1 -- 172.21.15.62:0/3290719332 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d3c010380 con 0x7f8d4c0b9900 2023-10-08T12:00:47.120 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.115+0000 7f8d51e19640 1 -- 172.21.15.62:0/3290719332 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d4c0a00a0 con 0x7f8d4c0b9900 2023-10-08T12:00:47.121 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.115+0000 7f8d51e19640 1 -- 172.21.15.62:0/3290719332 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d4c09f880 con 0x7f8d4c0b9900 2023-10-08T12:00:47.121 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.115+0000 7f8d43fff640 1 -- 172.21.15.62:0/3290719332 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8d3c0104e0 con 0x7f8d4c0b9900 2023-10-08T12:00:47.121 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.115+0000 7f8d43fff640 1 --2- 172.21.15.62:0/3290719332 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f8d2c066470 0x7f8d2c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:47.121 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.115+0000 7f8d43fff640 1 -- 172.21.15.62:0/3290719332 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8d3c084220 con 0x7f8d4c0b9900 2023-10-08T12:00:47.121 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.115+0000 7f8d4b7fe640 1 --2- 172.21.15.62:0/3290719332 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f8d2c066470 0x7f8d2c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:47.121 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.115+0000 7f8d4b7fe640 1 --2- 172.21.15.62:0/3290719332 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f8d2c066470 0x7f8d2c068930 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8d34005fd0 tx=0x7f8d3400a4e0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:47.123 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.119+0000 7f8d43fff640 1 -- 172.21.15.62:0/3290719332 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8d4c09f880 con 0x7f8d4c0b9900 2023-10-08T12:00:47.278 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.275+0000 7f8d51e19640 1 -- 172.21.15.62:0/3290719332 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8d4c09f880 con 0x7f8d4c0b9900 2023-10-08T12:00:47.279 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.275+0000 7f8d43fff640 1 -- 172.21.15.62:0/3290719332 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8d4c09f880 con 0x7f8d4c0b9900 2023-10-08T12:00:47.279 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-10-08T12:00:47.281 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.275+0000 7f8d51e19640 1 -- 172.21.15.62:0/3290719332 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f8d2c066470 msgr2=0x7f8d2c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:47.282 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.275+0000 7f8d51e19640 1 --2- 172.21.15.62:0/3290719332 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f8d2c066470 0x7f8d2c068930 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8d34005fd0 tx=0x7f8d3400a4e0 comp rx=0 tx=0).stop 2023-10-08T12:00:47.282 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.275+0000 7f8d51e19640 1 -- 172.21.15.62:0/3290719332 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d4c0b9900 msgr2=0x7f8d4c09fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:47.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.275+0000 7f8d51e19640 1 --2- 172.21.15.62:0/3290719332 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d4c0b9900 0x7f8d4c09fb60 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c00b3e0 tx=0x7f8d3c00b8a0 comp rx=0 tx=0).stop 2023-10-08T12:00:47.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.275+0000 7f8d51e19640 1 -- 172.21.15.62:0/3290719332 shutdown_connections 2023-10-08T12:00:47.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.275+0000 7f8d51e19640 1 --2- 172.21.15.62:0/3290719332 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f8d2c066470 0x7f8d2c068930 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:47.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.275+0000 7f8d51e19640 1 --2- 172.21.15.62:0/3290719332 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8d4c0ba340 0x7f8d4c14f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:47.284 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.275+0000 7f8d51e19640 1 --2- 172.21.15.62:0/3290719332 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d4c0b9900 0x7f8d4c09fb60 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:47.284 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.275+0000 7f8d51e19640 1 --2- 172.21.15.62:0/3290719332 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8d4c06b1c0 0x7f8d4c06dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:47.285 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.275+0000 7f8d51e19640 1 -- 172.21.15.62:0/3290719332 >> 172.21.15.62:0/3290719332 conn(0x7f8d4c09c520 msgr2=0x7f8d4c0b53a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:47.285 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.275+0000 7f8d51e19640 1 -- 172.21.15.62:0/3290719332 shutdown_connections 2023-10-08T12:00:47.285 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.275+0000 7f8d51e19640 1 -- 172.21.15.62:0/3290719332 wait complete. 2023-10-08T12:00:47.297 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T12:00:47.433 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.427+0000 7f65f4137640 1 -- 172.21.15.62:0/2347143472 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65ec0b9260 msgr2=0x7f65ec0b8570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:47.433 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.427+0000 7f65f4137640 1 --2- 172.21.15.62:0/2347143472 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65ec0b9260 0x7f65ec0b8570 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f65e8009900 tx=0x7f65e801c880 comp rx=0 tx=0).stop 2023-10-08T12:00:47.433 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.427+0000 7f65f4137640 1 -- 172.21.15.62:0/2347143472 shutdown_connections 2023-10-08T12:00:47.433 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.427+0000 7f65f4137640 1 --2- 172.21.15.62:0/2347143472 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65ec0b9260 0x7f65ec0b8570 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:47.433 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.427+0000 7f65f4137640 1 -- 172.21.15.62:0/2347143472 >> 172.21.15.62:0/2347143472 conn(0x7f65ec09c520 msgr2=0x7f65ec09c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:47.433 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.427+0000 7f65f4137640 1 -- 172.21.15.62:0/2347143472 shutdown_connections 2023-10-08T12:00:47.433 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.427+0000 7f65f4137640 1 -- 172.21.15.62:0/2347143472 wait complete. 2023-10-08T12:00:47.435 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.431+0000 7f65f4137640 1 Processor -- start 2023-10-08T12:00:47.436 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.431+0000 7f65f4137640 1 -- start start 2023-10-08T12:00:47.436 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.431+0000 7f65f4137640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f65ec071410 0x7f65ec149ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:47.436 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.431+0000 7f65f4137640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f65ec0b9260 0x7f65ec14a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:47.436 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.431+0000 7f65f4137640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65ec147920 0x7f65ec1e2730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:47.436 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.431+0000 7f65f4137640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65ec14ab20 con 0x7f65ec147920 2023-10-08T12:00:47.436 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.431+0000 7f65f4137640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65ec148f50 con 0x7f65ec071410 2023-10-08T12:00:47.436 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.431+0000 7f65f4137640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65ec148970 con 0x7f65ec0b9260 2023-10-08T12:00:47.436 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.431+0000 7f65f26d4640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65ec147920 0x7f65ec1e2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:47.436 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.431+0000 7f65f26d4640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65ec147920 0x7f65ec1e2730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49136/0 (socket says 172.21.15.62:49136) 2023-10-08T12:00:47.436 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.431+0000 7f65f26d4640 1 -- 172.21.15.62:0/2382185785 learned_addr learned my addr 172.21.15.62:0/2382185785 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:47.437 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.431+0000 7f65f1ed3640 1 --2- 172.21.15.62:0/2382185785 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f65ec071410 0x7f65ec149ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:47.437 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.431+0000 7f65f16d2640 1 --2- 172.21.15.62:0/2382185785 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f65ec0b9260 0x7f65ec14a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:47.437 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.431+0000 7f65f26d4640 1 -- 172.21.15.62:0/2382185785 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f65ec0b9260 msgr2=0x7f65ec14a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:47.437 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.431+0000 7f65f26d4640 1 --2- 172.21.15.62:0/2382185785 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f65ec0b9260 0x7f65ec14a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:47.437 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.431+0000 7f65f26d4640 1 -- 172.21.15.62:0/2382185785 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f65ec071410 msgr2=0x7f65ec149ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:47.437 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.431+0000 7f65f26d4640 1 --2- 172.21.15.62:0/2382185785 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f65ec071410 0x7f65ec149ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:47.437 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.431+0000 7f65f26d4640 1 -- 172.21.15.62:0/2382185785 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65e8009560 con 0x7f65ec147920 2023-10-08T12:00:47.437 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.431+0000 7f65f1ed3640 1 --2- 172.21.15.62:0/2382185785 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f65ec071410 0x7f65ec149ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:00:47.437 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.431+0000 7f65f26d4640 1 --2- 172.21.15.62:0/2382185785 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65ec147920 0x7f65ec1e2730 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f65e400c7a0 tx=0x7f65e400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:47.437 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.431+0000 7f65e27fc640 1 -- 172.21.15.62:0/2382185785 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e4003b80 con 0x7f65ec147920 2023-10-08T12:00:47.438 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.431+0000 7f65e27fc640 1 -- 172.21.15.62:0/2382185785 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f65e4003ce0 con 0x7f65ec147920 2023-10-08T12:00:47.438 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.431+0000 7f65f4137640 1 -- 172.21.15.62:0/2382185785 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65ec148be0 con 0x7f65ec147920 2023-10-08T12:00:47.438 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.431+0000 7f65e27fc640 1 -- 172.21.15.62:0/2382185785 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e400aab0 con 0x7f65ec147920 2023-10-08T12:00:47.438 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.431+0000 7f65f4137640 1 -- 172.21.15.62:0/2382185785 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65ec0b1590 con 0x7f65ec147920 2023-10-08T12:00:47.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.431+0000 7f65f4137640 1 -- 172.21.15.62:0/2382185785 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65ec0b5be0 con 0x7f65ec147920 2023-10-08T12:00:47.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.431+0000 7f65e27fc640 1 -- 172.21.15.62:0/2382185785 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f65e400ac10 con 0x7f65ec147920 2023-10-08T12:00:47.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.431+0000 7f65e27fc640 1 --2- 172.21.15.62:0/2382185785 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f65d0066470 0x7f65d0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:47.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.431+0000 7f65e27fc640 1 -- 172.21.15.62:0/2382185785 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f65e4083f80 con 0x7f65ec147920 2023-10-08T12:00:47.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.435+0000 7f65f1ed3640 1 --2- 172.21.15.62:0/2382185785 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f65d0066470 0x7f65d0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:47.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.435+0000 7f65f1ed3640 1 --2- 172.21.15.62:0/2382185785 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f65d0066470 0x7f65d0068930 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f65e80af000 tx=0x7f65e801b0c0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:47.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.435+0000 7f65e27fc640 1 -- 172.21.15.62:0/2382185785 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f65e40b5090 con 0x7f65ec147920 2023-10-08T12:00:47.594 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.591+0000 7f65f4137640 1 -- 172.21.15.62:0/2382185785 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f65ec149100 con 0x7f65ec147920 2023-10-08T12:00:47.595 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.591+0000 7f65e27fc640 1 -- 172.21.15.62:0/2382185785 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f65ec149100 con 0x7f65ec147920 2023-10-08T12:00:47.595 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 64 2023-10-08T12:00:47.597 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.591+0000 7f65f4137640 1 -- 172.21.15.62:0/2382185785 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f65d0066470 msgr2=0x7f65d0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:47.597 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.591+0000 7f65f4137640 1 --2- 172.21.15.62:0/2382185785 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f65d0066470 0x7f65d0068930 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f65e80af000 tx=0x7f65e801b0c0 comp rx=0 tx=0).stop 2023-10-08T12:00:47.598 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.591+0000 7f65f4137640 1 -- 172.21.15.62:0/2382185785 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65ec147920 msgr2=0x7f65ec1e2730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:47.598 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.591+0000 7f65f4137640 1 --2- 172.21.15.62:0/2382185785 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65ec147920 0x7f65ec1e2730 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f65e400c7a0 tx=0x7f65e400cc60 comp rx=0 tx=0).stop 2023-10-08T12:00:47.598 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.591+0000 7f65f4137640 1 -- 172.21.15.62:0/2382185785 shutdown_connections 2023-10-08T12:00:47.598 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.591+0000 7f65f4137640 1 --2- 172.21.15.62:0/2382185785 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f65d0066470 0x7f65d0068930 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:47.598 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.591+0000 7f65f4137640 1 --2- 172.21.15.62:0/2382185785 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f65ec0b9260 0x7f65ec14a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:47.598 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.591+0000 7f65f4137640 1 --2- 172.21.15.62:0/2382185785 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65ec147920 0x7f65ec1e2730 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:47.598 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.591+0000 7f65f4137640 1 --2- 172.21.15.62:0/2382185785 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f65ec071410 0x7f65ec149ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:47.599 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.591+0000 7f65f4137640 1 -- 172.21.15.62:0/2382185785 >> 172.21.15.62:0/2382185785 conn(0x7f65ec09c520 msgr2=0x7f65ec099400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:47.599 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.591+0000 7f65f4137640 1 -- 172.21.15.62:0/2382185785 shutdown_connections 2023-10-08T12:00:47.599 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.591+0000 7f65f4137640 1 -- 172.21.15.62:0/2382185785 wait complete. 2023-10-08T12:00:47.613 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:00:47.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.727+0000 7ff8cf4cd640 1 -- 172.21.15.62:0/3712408981 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8b40047d0 msgr2=0x7ff8b4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:47.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.727+0000 7ff8cf4cd640 1 --2- 172.21.15.62:0/3712408981 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8b40047d0 0x7ff8b4004c50 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff8c4001da0 tx=0x7ff8c401cb20 comp rx=0 tx=0).stop 2023-10-08T12:00:47.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.727+0000 7ff8cda6a640 1 -- 172.21.15.62:0/3712408981 reap_dead start 2023-10-08T12:00:47.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.727+0000 7ff8cf4cd640 1 -- 172.21.15.62:0/3712408981 shutdown_connections 2023-10-08T12:00:47.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.727+0000 7ff8cf4cd640 1 -- 172.21.15.62:0/3712408981 >> 172.21.15.62:0/3712408981 conn(0x7ff8c809c520 msgr2=0x7ff8c809c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:47.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.727+0000 7ff8cf4cd640 1 -- 172.21.15.62:0/3712408981 shutdown_connections 2023-10-08T12:00:47.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.727+0000 7ff8cf4cd640 1 -- 172.21.15.62:0/3712408981 wait complete. 2023-10-08T12:00:47.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.731+0000 7ff8cf4cd640 1 Processor -- start 2023-10-08T12:00:47.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.731+0000 7ff8cf4cd640 1 -- start start 2023-10-08T12:00:47.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.731+0000 7ff8cf4cd640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff8b40047d0 0x7ff8c81cf370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:47.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.731+0000 7ff8cf4cd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8c80b3900 0x7ff8c80709c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:47.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.731+0000 7ff8cf4cd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff8c81e02a0 0x7ff8c81e0700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:47.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.731+0000 7ff8cf4cd640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c8070160 con 0x7ff8c80b3900 2023-10-08T12:00:47.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.731+0000 7ff8cf4cd640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c81e0c40 con 0x7ff8c81e02a0 2023-10-08T12:00:47.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.731+0000 7ff8cf4cd640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c8070400 con 0x7ff8b40047d0 2023-10-08T12:00:47.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.731+0000 7ff8cca68640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8c80b3900 0x7ff8c80709c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:47.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.731+0000 7ff8cca68640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8c80b3900 0x7ff8c80709c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49158/0 (socket says 172.21.15.62:49158) 2023-10-08T12:00:47.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.731+0000 7ff8cca68640 1 -- 172.21.15.62:0/3627869356 learned_addr learned my addr 172.21.15.62:0/3627869356 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:47.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.731+0000 7ff8cd269640 1 --2- 172.21.15.62:0/3627869356 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff8b40047d0 0x7ff8c81cf370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:47.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.731+0000 7ff8cda6a640 1 --2- 172.21.15.62:0/3627869356 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff8c81e02a0 0x7ff8c81e0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:47.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.731+0000 7ff8cca68640 1 -- 172.21.15.62:0/3627869356 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff8b40047d0 msgr2=0x7ff8c81cf370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:47.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.731+0000 7ff8cca68640 1 --2- 172.21.15.62:0/3627869356 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff8b40047d0 0x7ff8c81cf370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:47.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.731+0000 7ff8cca68640 1 -- 172.21.15.62:0/3627869356 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff8c81e02a0 msgr2=0x7ff8c81e0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:47.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.731+0000 7ff8cca68640 1 --2- 172.21.15.62:0/3627869356 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff8c81e02a0 0x7ff8c81e0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:47.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.731+0000 7ff8cca68640 1 -- 172.21.15.62:0/3627869356 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8c80706e0 con 0x7ff8c80b3900 2023-10-08T12:00:47.738 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.731+0000 7ff8cda6a640 1 --2- 172.21.15.62:0/3627869356 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff8c81e02a0 0x7ff8c81e0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:00:47.738 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.731+0000 7ff8cca68640 1 --2- 172.21.15.62:0/3627869356 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8c80b3900 0x7ff8c80709c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ff8c40aa040 tx=0x7ff8c40a7ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:47.738 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.731+0000 7ff8bdffb640 1 -- 172.21.15.62:0/3627869356 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c40a7070 con 0x7ff8c80b3900 2023-10-08T12:00:47.738 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.731+0000 7ff8bdffb640 1 -- 172.21.15.62:0/3627869356 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff8c40a72c0 con 0x7ff8c80b3900 2023-10-08T12:00:47.738 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.731+0000 7ff8cf4cd640 1 -- 172.21.15.62:0/3627869356 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8c80b3d40 con 0x7ff8c80b3900 2023-10-08T12:00:47.738 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.731+0000 7ff8bdffb640 1 -- 172.21.15.62:0/3627869356 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c40a76b0 con 0x7ff8c80b3900 2023-10-08T12:00:47.738 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.731+0000 7ff8cf4cd640 1 -- 172.21.15.62:0/3627869356 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8c8070f00 con 0x7ff8c80b3900 2023-10-08T12:00:47.738 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.731+0000 7ff8cf4cd640 1 -- 172.21.15.62:0/3627869356 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8c80710f0 con 0x7ff8c80b3900 2023-10-08T12:00:47.739 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.731+0000 7ff8bdffb640 1 -- 172.21.15.62:0/3627869356 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff8c40b5070 con 0x7ff8c80b3900 2023-10-08T12:00:47.739 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.731+0000 7ff8bdffb640 1 --2- 172.21.15.62:0/3627869356 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7ff8ac066470 0x7ff8ac068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:47.739 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.735+0000 7ff8bdffb640 1 -- 172.21.15.62:0/3627869356 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff8c40aa070 con 0x7ff8c80b3900 2023-10-08T12:00:47.739 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.735+0000 7ff8cd269640 1 --2- 172.21.15.62:0/3627869356 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7ff8ac066470 0x7ff8ac068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:47.739 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.735+0000 7ff8cd269640 1 --2- 172.21.15.62:0/3627869356 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7ff8ac066470 0x7ff8ac068930 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff8b80058d0 tx=0x7ff8b8005860 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:47.741 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.735+0000 7ff8bdffb640 1 -- 172.21.15.62:0/3627869356 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff8c40eba80 con 0x7ff8c80b3900 2023-10-08T12:00:47.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.923+0000 7ff8cf4cd640 1 -- 172.21.15.62:0/3627869356 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff8c804da80 con 0x7ff8c80b3900 2023-10-08T12:00:47.927 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.923+0000 7ff8bdffb640 1 -- 172.21.15.62:0/3627869356 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4120 (secure 0 0 0) 0x7ff8c40ef0a0 con 0x7ff8c80b3900 2023-10-08T12:00:47.927 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T12:00:47.927 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4334,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/2629778704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":2629778704},{"type":"v1","addr":"172.21.15.130:6835","nonce":2629778704}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4359,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/2134446062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":2134446062},{"type":"v1","addr":"172.21.15.62:6835","nonce":2134446062}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T12:00:19.866714+0000","modified":"2023-10-08T12:00:22.958677+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4362},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4362":{"gid":4362,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6834/2629384568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":2629384568},{"type":"v1","addr":"172.21.15.62:6834","nonce":2629384568}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:00:47.927 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 8 2023-10-08T12:00:47.929 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.923+0000 7ff8cf4cd640 1 -- 172.21.15.62:0/3627869356 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7ff8ac066470 msgr2=0x7ff8ac068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:47.929 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.923+0000 7ff8cf4cd640 1 --2- 172.21.15.62:0/3627869356 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7ff8ac066470 0x7ff8ac068930 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff8b80058d0 tx=0x7ff8b8005860 comp rx=0 tx=0).stop 2023-10-08T12:00:47.929 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.923+0000 7ff8cf4cd640 1 -- 172.21.15.62:0/3627869356 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8c80b3900 msgr2=0x7ff8c80709c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:47.929 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.923+0000 7ff8cf4cd640 1 --2- 172.21.15.62:0/3627869356 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8c80b3900 0x7ff8c80709c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ff8c40aa040 tx=0x7ff8c40a7ea0 comp rx=0 tx=0).stop 2023-10-08T12:00:47.929 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.923+0000 7ff8cf4cd640 1 -- 172.21.15.62:0/3627869356 shutdown_connections 2023-10-08T12:00:47.929 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.923+0000 7ff8cf4cd640 1 --2- 172.21.15.62:0/3627869356 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7ff8ac066470 0x7ff8ac068930 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:47.929 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.923+0000 7ff8cf4cd640 1 --2- 172.21.15.62:0/3627869356 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff8c81e02a0 0x7ff8c81e0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:47.929 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.923+0000 7ff8cf4cd640 1 --2- 172.21.15.62:0/3627869356 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8c80b3900 0x7ff8c80709c0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:47.929 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.923+0000 7ff8cf4cd640 1 --2- 172.21.15.62:0/3627869356 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff8b40047d0 0x7ff8c81cf370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:47.930 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.923+0000 7ff8cf4cd640 1 -- 172.21.15.62:0/3627869356 >> 172.21.15.62:0/3627869356 conn(0x7ff8c809c520 msgr2=0x7ff8c809ad10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:47.930 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.923+0000 7ff8cf4cd640 1 -- 172.21.15.62:0/3627869356 shutdown_connections 2023-10-08T12:00:47.930 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:47.923+0000 7ff8cf4cd640 1 -- 172.21.15.62:0/3627869356 wait complete. 2023-10-08T12:00:47.945 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:00:48.073 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.067+0000 7efcc7e4d640 1 -- 172.21.15.62:0/1659455940 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efcac005190 msgr2=0x7efcac00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:48.073 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.067+0000 7efcc7e4d640 1 --2- 172.21.15.62:0/1659455940 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efcac005190 0x7efcac00b990 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7efcb800c5c0 tx=0x7efcb801d340 comp rx=0 tx=0).stop 2023-10-08T12:00:48.073 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.067+0000 7efcc7e4d640 1 -- 172.21.15.62:0/1659455940 shutdown_connections 2023-10-08T12:00:48.074 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.067+0000 7efcc7e4d640 1 --2- 172.21.15.62:0/1659455940 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efcac005190 0x7efcac00b990 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:48.074 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.067+0000 7efcc7e4d640 1 -- 172.21.15.62:0/1659455940 >> 172.21.15.62:0/1659455940 conn(0x7efcc009c520 msgr2=0x7efcc009c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:48.074 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.067+0000 7efcc7e4d640 1 -- 172.21.15.62:0/1659455940 shutdown_connections 2023-10-08T12:00:48.074 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.067+0000 7efcc7e4d640 1 -- 172.21.15.62:0/1659455940 wait complete. 2023-10-08T12:00:48.074 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.071+0000 7efcc7e4d640 1 Processor -- start 2023-10-08T12:00:48.074 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.071+0000 7efcc7e4d640 1 -- start start 2023-10-08T12:00:48.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.071+0000 7efcc7e4d640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efcac005190 0x7efcc01df890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:48.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.071+0000 7efcc7e4d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efcc009e1a0 0x7efcc0145bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:48.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.071+0000 7efcc7e4d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efcc01460f0 0x7efcc01e2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:48.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.071+0000 7efcc7e4d640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcc01dedb0 con 0x7efcc009e1a0 2023-10-08T12:00:48.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.071+0000 7efcc7e4d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcc01df090 con 0x7efcc01460f0 2023-10-08T12:00:48.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.071+0000 7efcc7e4d640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcc01df370 con 0x7efcac005190 2023-10-08T12:00:48.077 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.071+0000 7efcc53e8640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efcc009e1a0 0x7efcc0145bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:48.077 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.071+0000 7efcc53e8640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efcc009e1a0 0x7efcc0145bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49176/0 (socket says 172.21.15.62:49176) 2023-10-08T12:00:48.077 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.071+0000 7efcc53e8640 1 -- 172.21.15.62:0/1933815863 learned_addr learned my addr 172.21.15.62:0/1933815863 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:48.077 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.071+0000 7efcc63ea640 1 --2- 172.21.15.62:0/1933815863 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efcc01460f0 0x7efcc01e2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:48.077 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.071+0000 7efcc5be9640 1 --2- 172.21.15.62:0/1933815863 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efcac005190 0x7efcc01df890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:48.077 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.071+0000 7efcc53e8640 1 -- 172.21.15.62:0/1933815863 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efcac005190 msgr2=0x7efcc01df890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:48.077 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.071+0000 7efcc53e8640 1 --2- 172.21.15.62:0/1933815863 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efcac005190 0x7efcc01df890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:48.077 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.071+0000 7efcc53e8640 1 -- 172.21.15.62:0/1933815863 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efcc01460f0 msgr2=0x7efcc01e2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:48.077 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.071+0000 7efcc53e8640 1 --2- 172.21.15.62:0/1933815863 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efcc01460f0 0x7efcc01e2210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:48.077 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.071+0000 7efcc53e8640 1 -- 172.21.15.62:0/1933815863 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcc009e6d0 con 0x7efcc009e1a0 2023-10-08T12:00:48.077 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.071+0000 7efcc53e8640 1 --2- 172.21.15.62:0/1933815863 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efcc009e1a0 0x7efcc0145bb0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7efcb0001ec0 tx=0x7efcb000da80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:48.077 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.071+0000 7efcb67fc640 1 -- 172.21.15.62:0/1933815863 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb00062e0 con 0x7efcc009e1a0 2023-10-08T12:00:48.078 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.071+0000 7efcb67fc640 1 -- 172.21.15.62:0/1933815863 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7efcb0006530 con 0x7efcc009e1a0 2023-10-08T12:00:48.078 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.071+0000 7efcc7e4d640 1 -- 172.21.15.62:0/1933815863 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcc00997e0 con 0x7efcc009e1a0 2023-10-08T12:00:48.078 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.071+0000 7efcb67fc640 1 -- 172.21.15.62:0/1933815863 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb0003860 con 0x7efcc009e1a0 2023-10-08T12:00:48.078 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.071+0000 7efcc7e4d640 1 -- 172.21.15.62:0/1933815863 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcc01e2750 con 0x7efcc009e1a0 2023-10-08T12:00:48.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.071+0000 7efcc7e4d640 1 -- 172.21.15.62:0/1933815863 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcc01df530 con 0x7efcc009e1a0 2023-10-08T12:00:48.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.071+0000 7efcb67fc640 1 -- 172.21.15.62:0/1933815863 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7efcb00039c0 con 0x7efcc009e1a0 2023-10-08T12:00:48.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.071+0000 7efcb67fc640 1 --2- 172.21.15.62:0/1933815863 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7efca40664a0 0x7efca4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:48.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.071+0000 7efcb67fc640 1 -- 172.21.15.62:0/1933815863 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efcb0084710 con 0x7efcc009e1a0 2023-10-08T12:00:48.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.079+0000 7efcc5be9640 1 --2- 172.21.15.62:0/1933815863 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7efca40664a0 0x7efca4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:48.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.079+0000 7efcc5be9640 1 --2- 172.21.15.62:0/1933815863 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7efca40664a0 0x7efca4068960 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7efcbc0099b0 tx=0x7efcbc0091e0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:48.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.079+0000 7efcb67fc640 1 -- 172.21.15.62:0/1933815863 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7efcb0051b90 con 0x7efcc009e1a0 2023-10-08T12:00:48.236 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.235+0000 7efcc7e4d640 1 -- 172.21.15.62:0/1933815863 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efcc01deef0 con 0x7efcc009e1a0 2023-10-08T12:00:48.238 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.239+0000 7efcb67fc640 1 -- 172.21.15.62:0/1933815863 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16481 (secure 0 0 0) 0x7efcc01deef0 con 0x7efcc009e1a0 2023-10-08T12:00:48.239 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T12:00:48.239 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":20,"fsid":"3e777930-c2c1-4f2b-a903-c07ee4ca2c52","created":"2023-10-08T11:59:54.510229+0000","modified":"2023-10-08T12:00:21.580704+0000","last_up_change":"2023-10-08T12:00:06.783998+0000","last_in_change":"2023-10-08T11:59:57.847944+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:00:07.189433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:00:17.895548+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T12:00:18.871217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7bc3070a-7240-43d9-9ec3-397b68a37e2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6820","nonce":2227876905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6824","nonce":2227876905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6831","nonce":2227876905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6828","nonce":2227876905}]},"public_addr":"172.21.15.62:6820/2227876905","cluster_addr":"172.21.15.62:6824/2227876905","heartbeat_back_addr":"172.21.15.62:6831/2227876905","heartbeat_front_addr":"172.21.15.62:6828/2227876905","state":["exists","up"]},{"osd":1,"uuid":"5e0fa1f5-9ddc-4882-b460-5578bb571003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6801","nonce":315660906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6803","nonce":315660906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6808","nonce":315660906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6805","nonce":315660906}]},"public_addr":"172.21.15.62:6801/315660906","cluster_addr":"172.21.15.62:6803/315660906","heartbeat_back_addr":"172.21.15.62:6808/315660906","heartbeat_front_addr":"172.21.15.62:6805/315660906","state":["exists","up"]},{"osd":2,"uuid":"262b5ee9-4243-4309-a14f-88ad4e8bf812","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6807","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6809","nonce":3784842938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6811","nonce":3784842938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6815","nonce":3784842938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6813","nonce":3784842938}]},"public_addr":"172.21.15.62:6809/3784842938","cluster_addr":"172.21.15.62:6811/3784842938","heartbeat_back_addr":"172.21.15.62:6815/3784842938","heartbeat_front_addr":"172.21.15.62:6813/3784842938","state":["exists","up"]},{"osd":3,"uuid":"1770bdb8-c12b-43b1-aaab-1d6b6fd18f4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6817","nonce":3385303160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6821","nonce":3385303160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6827","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6829","nonce":3385303160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6823","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6825","nonce":3385303160}]},"public_addr":"172.21.15.62:6817/3385303160","cluster_addr":"172.21.15.62:6821/3385303160","heartbeat_back_addr":"172.21.15.62:6829/3385303160","heartbeat_front_addr":"172.21.15.62:6825/3385303160","state":["exists","up"]},{"osd":4,"uuid":"74c73631-9351-494a-8246-28ee86e9f862","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6807","nonce":1174056987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6809","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6811","nonce":1174056987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6820","nonce":1174056987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6813","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6816","nonce":1174056987}]},"public_addr":"172.21.15.130:6807/1174056987","cluster_addr":"172.21.15.130:6811/1174056987","heartbeat_back_addr":"172.21.15.130:6820/1174056987","heartbeat_front_addr":"172.21.15.130:6816/1174056987","state":["exists","up"]},{"osd":5,"uuid":"1040f389-272c-41d6-ae76-70c04d09afa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6801","nonce":561928414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6803","nonce":561928414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6815","nonce":561928414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6808","nonce":561928414}]},"public_addr":"172.21.15.130:6801/561928414","cluster_addr":"172.21.15.130:6803/561928414","heartbeat_back_addr":"172.21.15.130:6815/561928414","heartbeat_front_addr":"172.21.15.130:6808/561928414","state":["exists","up"]},{"osd":6,"uuid":"178553eb-03e1-4ab8-9826-4f5997e6da0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6810","nonce":2877303015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6817","nonce":2877303015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6823","nonce":2877303015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6819","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6821","nonce":2877303015}]},"public_addr":"172.21.15.130:6810/2877303015","cluster_addr":"172.21.15.130:6817/2877303015","heartbeat_back_addr":"172.21.15.130:6823/2877303015","heartbeat_front_addr":"172.21.15.130:6821/2877303015","state":["exists","up"]},{"osd":7,"uuid":"b6581c8f-30b1-4dfd-b7b6-94b579128835","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6825","nonce":680009774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6827","nonce":680009774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6831","nonce":680009774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6829","nonce":680009774}]},"public_addr":"172.21.15.130:6825/680009774","cluster_addr":"172.21.15.130:6827/680009774","heartbeat_back_addr":"172.21.15.130:6831/680009774","heartbeat_front_addr":"172.21.15.130:6829/680009774","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.505543+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.394383+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.456652+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.529168+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.235414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.392158+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.347556+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.432039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:00:48.241 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.239+0000 7efcc7e4d640 1 -- 172.21.15.62:0/1933815863 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7efca40664a0 msgr2=0x7efca4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:48.241 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.239+0000 7efcc7e4d640 1 --2- 172.21.15.62:0/1933815863 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7efca40664a0 0x7efca4068960 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7efcbc0099b0 tx=0x7efcbc0091e0 comp rx=0 tx=0).stop 2023-10-08T12:00:48.241 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.239+0000 7efcc7e4d640 1 -- 172.21.15.62:0/1933815863 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efcc009e1a0 msgr2=0x7efcc0145bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:48.242 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.239+0000 7efcc7e4d640 1 --2- 172.21.15.62:0/1933815863 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efcc009e1a0 0x7efcc0145bb0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7efcb0001ec0 tx=0x7efcb000da80 comp rx=0 tx=0).stop 2023-10-08T12:00:48.242 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.239+0000 7efcc7e4d640 1 -- 172.21.15.62:0/1933815863 shutdown_connections 2023-10-08T12:00:48.242 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.239+0000 7efcc7e4d640 1 --2- 172.21.15.62:0/1933815863 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7efca40664a0 0x7efca4068960 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:48.243 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.239+0000 7efcc7e4d640 1 --2- 172.21.15.62:0/1933815863 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efcc01460f0 0x7efcc01e2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:48.243 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.239+0000 7efcc7e4d640 1 --2- 172.21.15.62:0/1933815863 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efcc009e1a0 0x7efcc0145bb0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:48.243 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.239+0000 7efcc7e4d640 1 --2- 172.21.15.62:0/1933815863 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efcac005190 0x7efcc01df890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:48.243 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.239+0000 7efcc7e4d640 1 -- 172.21.15.62:0/1933815863 >> 172.21.15.62:0/1933815863 conn(0x7efcc009c520 msgr2=0x7efcc009a490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:48.243 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.239+0000 7efcc7e4d640 1 -- 172.21.15.62:0/1933815863 shutdown_connections 2023-10-08T12:00:48.243 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.239+0000 7efcc7e4d640 1 -- 172.21.15.62:0/1933815863 wait complete. 2023-10-08T12:00:48.258 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-08T12:00:48.258 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:00:48.358 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:00:48.360 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:00:48.363 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:00:48.380 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.379+0000 7fb9634eb640 1 -- 172.21.15.62:0/1756386267 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb95c06cab0 msgr2=0x7fb95c06cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:48.380 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.379+0000 7fb9634eb640 1 --2- 172.21.15.62:0/1756386267 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb95c06cab0 0x7fb95c06cef0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fb95c0a2460 tx=0x7fb94c01c830 comp rx=0 tx=0).stop 2023-10-08T12:00:48.380 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.379+0000 7fb9634eb640 1 -- 172.21.15.62:0/1756386267 shutdown_connections 2023-10-08T12:00:48.380 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.379+0000 7fb9634eb640 1 --2- 172.21.15.62:0/1756386267 >> v2:172.21.15.130:3300/0 conn(0x7fb95c06d430 0x7fb95c151aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:48.381 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.379+0000 7fb9634eb640 1 --2- 172.21.15.62:0/1756386267 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb95c06cab0 0x7fb95c06cef0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:48.381 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.379+0000 7fb9634eb640 1 -- 172.21.15.62:0/1756386267 >> 172.21.15.62:0/1756386267 conn(0x7fb95c09e540 msgr2=0x7fb95c09e950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:48.381 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.379+0000 7fb9634eb640 1 -- 172.21.15.62:0/1756386267 shutdown_connections 2023-10-08T12:00:48.381 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.379+0000 7fb9634eb640 1 -- 172.21.15.62:0/1756386267 wait complete. 2023-10-08T12:00:48.383 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.379+0000 7fb9634eb640 1 Processor -- start 2023-10-08T12:00:48.383 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.379+0000 7fb9634eb640 1 -- start start 2023-10-08T12:00:48.383 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.383+0000 7fb9634eb640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb95c06cab0 0x7fb95c1e39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:48.384 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.383+0000 7fb9634eb640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb95c06d430 0x7fb95c149cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:48.384 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.383+0000 7fb9634eb640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb95c0b8bb0 0x7fb95c099110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:48.384 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.383+0000 7fb9634eb640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb95c0988e0 con 0x7fb95c06cab0 2023-10-08T12:00:48.384 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.383+0000 7fb9634eb640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb95c14a200 con 0x7fb95c0b8bb0 2023-10-08T12:00:48.384 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.383+0000 7fb9634eb640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb95c099650 con 0x7fb95c06d430 2023-10-08T12:00:48.384 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.383+0000 7fb961287640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb95c06cab0 0x7fb95c1e39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:48.384 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.383+0000 7fb961287640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb95c06cab0 0x7fb95c1e39d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49194/0 (socket says 172.21.15.62:49194) 2023-10-08T12:00:48.384 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.383+0000 7fb961287640 1 -- 172.21.15.62:0/1903163151 learned_addr learned my addr 172.21.15.62:0/1903163151 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:48.385 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.383+0000 7fb960a86640 1 --2- 172.21.15.62:0/1903163151 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb95c06d430 0x7fb95c149cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:48.385 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.383+0000 7fb961a88640 1 --2- 172.21.15.62:0/1903163151 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb95c0b8bb0 0x7fb95c099110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:48.385 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.383+0000 7fb961287640 1 -- 172.21.15.62:0/1903163151 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb95c06d430 msgr2=0x7fb95c149cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:48.385 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.383+0000 7fb961287640 1 --2- 172.21.15.62:0/1903163151 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb95c06d430 0x7fb95c149cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:48.385 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.383+0000 7fb961287640 1 -- 172.21.15.62:0/1903163151 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb95c0b8bb0 msgr2=0x7fb95c099110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:48.385 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.383+0000 7fb961287640 1 --2- 172.21.15.62:0/1903163151 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb95c0b8bb0 0x7fb95c099110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:48.385 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.383+0000 7fb961287640 1 -- 172.21.15.62:0/1903163151 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb94c009560 con 0x7fb95c06cab0 2023-10-08T12:00:48.385 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.383+0000 7fb961287640 1 --2- 172.21.15.62:0/1903163151 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb95c06cab0 0x7fb95c1e39d0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb95800b3e0 tx=0x7fb95800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:48.385 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.383+0000 7fb951ffb640 1 -- 172.21.15.62:0/1903163151 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb958011830 con 0x7fb95c06cab0 2023-10-08T12:00:48.386 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.383+0000 7fb951ffb640 1 -- 172.21.15.62:0/1903163151 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb958011aa0 con 0x7fb95c06cab0 2023-10-08T12:00:48.386 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.383+0000 7fb951ffb640 1 -- 172.21.15.62:0/1903163151 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb958010380 con 0x7fb95c06cab0 2023-10-08T12:00:48.386 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.383+0000 7fb9634eb640 1 -- 172.21.15.62:0/1903163151 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb95c14e860 con 0x7fb95c06cab0 2023-10-08T12:00:48.386 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.383+0000 7fb9634eb640 1 -- 172.21.15.62:0/1903163151 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb95c098ac0 con 0x7fb95c06cab0 2023-10-08T12:00:48.387 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.383+0000 7fb9634eb640 1 -- 172.21.15.62:0/1903163151 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb95c04da80 con 0x7fb95c06cab0 2023-10-08T12:00:48.387 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.383+0000 7fb951ffb640 1 -- 172.21.15.62:0/1903163151 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb9580104e0 con 0x7fb95c06cab0 2023-10-08T12:00:48.387 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.383+0000 7fb951ffb640 1 --2- 172.21.15.62:0/1903163151 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fb940066470 0x7fb940068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:48.387 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.383+0000 7fb951ffb640 1 -- 172.21.15.62:0/1903163151 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb958084200 con 0x7fb95c06cab0 2023-10-08T12:00:48.388 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.383+0000 7fb960a86640 1 --2- 172.21.15.62:0/1903163151 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fb940066470 0x7fb940068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:48.388 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.387+0000 7fb960a86640 1 --2- 172.21.15.62:0/1903163151 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fb940066470 0x7fb940068930 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb94c0af000 tx=0x7fb94c01b070 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:48.389 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.387+0000 7fb951ffb640 1 -- 172.21.15.62:0/1903163151 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb958051710 con 0x7fb95c06cab0 2023-10-08T12:00:48.578 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.579+0000 7fb9634eb640 1 -- 172.21.15.62:0/1903163151 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb95c0a1d30 con 0x7fb95c06cab0 2023-10-08T12:00:48.579 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.579+0000 7fb951ffb640 1 -- 172.21.15.62:0/1903163151 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4120 (secure 0 0 0) 0x7fb958054d30 con 0x7fb95c06cab0 2023-10-08T12:00:48.580 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T12:00:48.580 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4334,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/2629778704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":2629778704},{"type":"v1","addr":"172.21.15.130:6835","nonce":2629778704}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4359,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/2134446062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":2134446062},{"type":"v1","addr":"172.21.15.62:6835","nonce":2134446062}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T12:00:19.866714+0000","modified":"2023-10-08T12:00:22.958677+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4362},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4362":{"gid":4362,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6834/2629384568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":2629384568},{"type":"v1","addr":"172.21.15.62:6834","nonce":2629384568}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:00:48.581 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 8 2023-10-08T12:00:48.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.579+0000 7fb9634eb640 1 -- 172.21.15.62:0/1903163151 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fb940066470 msgr2=0x7fb940068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:48.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.579+0000 7fb9634eb640 1 --2- 172.21.15.62:0/1903163151 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fb940066470 0x7fb940068930 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb94c0af000 tx=0x7fb94c01b070 comp rx=0 tx=0).stop 2023-10-08T12:00:48.583 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.579+0000 7fb9634eb640 1 -- 172.21.15.62:0/1903163151 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb95c06cab0 msgr2=0x7fb95c1e39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:48.583 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.579+0000 7fb9634eb640 1 --2- 172.21.15.62:0/1903163151 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb95c06cab0 0x7fb95c1e39d0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb95800b3e0 tx=0x7fb95800b8a0 comp rx=0 tx=0).stop 2023-10-08T12:00:48.583 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.579+0000 7fb9634eb640 1 -- 172.21.15.62:0/1903163151 shutdown_connections 2023-10-08T12:00:48.583 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.579+0000 7fb9634eb640 1 --2- 172.21.15.62:0/1903163151 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fb940066470 0x7fb940068930 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:48.584 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.579+0000 7fb9634eb640 1 --2- 172.21.15.62:0/1903163151 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb95c06d430 0x7fb95c149cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:48.584 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.579+0000 7fb9634eb640 1 --2- 172.21.15.62:0/1903163151 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb95c0b8bb0 0x7fb95c099110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:48.584 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.579+0000 7fb9634eb640 1 --2- 172.21.15.62:0/1903163151 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb95c06cab0 0x7fb95c1e39d0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:48.585 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.579+0000 7fb9634eb640 1 -- 172.21.15.62:0/1903163151 >> 172.21.15.62:0/1903163151 conn(0x7fb95c09e540 msgr2=0x7fb95c09fb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:48.585 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.579+0000 7fb9634eb640 1 -- 172.21.15.62:0/1903163151 shutdown_connections 2023-10-08T12:00:48.585 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.583+0000 7fb9634eb640 1 -- 172.21.15.62:0/1903163151 wait complete. 2023-10-08T12:00:48.599 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:00:48.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.775+0000 7f023611a640 1 -- 172.21.15.62:0/657766133 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0218005190 msgr2=0x7f021800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:48.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.775+0000 7f023611a640 1 --2- 172.21.15.62:0/657766133 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0218005190 0x7f021800b990 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f022800c5c0 tx=0x7f022801d340 comp rx=0 tx=0).stop 2023-10-08T12:00:48.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.775+0000 7f023611a640 1 -- 172.21.15.62:0/657766133 shutdown_connections 2023-10-08T12:00:48.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.775+0000 7f023611a640 1 --2- 172.21.15.62:0/657766133 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0218005190 0x7f021800b990 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:48.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.775+0000 7f023611a640 1 -- 172.21.15.62:0/657766133 >> 172.21.15.62:0/657766133 conn(0x7f0230069960 msgr2=0x7f0230069d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:48.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.775+0000 7f023611a640 1 -- 172.21.15.62:0/657766133 shutdown_connections 2023-10-08T12:00:48.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.775+0000 7f023611a640 1 -- 172.21.15.62:0/657766133 wait complete. 2023-10-08T12:00:48.777 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.775+0000 7f023611a640 1 Processor -- start 2023-10-08T12:00:48.777 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.775+0000 7f023611a640 1 -- start start 2023-10-08T12:00:48.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.775+0000 7f023611a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0218005190 0x7f02300b3b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:48.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.775+0000 7f023611a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f02300b24f0 0x7f02300b2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:48.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.775+0000 7f023611a640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f023013f4c0 0x7f023013f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:48.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.775+0000 7f023611a640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f023014c780 con 0x7f0218005190 2023-10-08T12:00:48.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.775+0000 7f023611a640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02300b40d0 con 0x7f02300b24f0 2023-10-08T12:00:48.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.775+0000 7f023611a640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02300b4340 con 0x7f023013f4c0 2023-10-08T12:00:48.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.775+0000 7f022f7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0218005190 0x7f02300b3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:48.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.775+0000 7f022f7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0218005190 0x7f02300b3b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49204/0 (socket says 172.21.15.62:49204) 2023-10-08T12:00:48.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.775+0000 7f022f7fe640 1 -- 172.21.15.62:0/2740128077 learned_addr learned my addr 172.21.15.62:0/2740128077 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:48.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.775+0000 7f022effd640 1 --2- 172.21.15.62:0/2740128077 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f02300b24f0 0x7f02300b2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:48.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.775+0000 7f022ffff640 1 --2- 172.21.15.62:0/2740128077 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f023013f4c0 0x7f023013f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:48.779 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.775+0000 7f022f7fe640 1 -- 172.21.15.62:0/2740128077 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f023013f4c0 msgr2=0x7f023013f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:48.779 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.775+0000 7f022f7fe640 1 --2- 172.21.15.62:0/2740128077 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f023013f4c0 0x7f023013f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:48.779 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.775+0000 7f022f7fe640 1 -- 172.21.15.62:0/2740128077 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f02300b24f0 msgr2=0x7f02300b2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:48.779 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.775+0000 7f022f7fe640 1 --2- 172.21.15.62:0/2740128077 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f02300b24f0 0x7f02300b2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:48.779 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.775+0000 7f022f7fe640 1 -- 172.21.15.62:0/2740128077 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02300b2060 con 0x7f0218005190 2023-10-08T12:00:48.779 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.775+0000 7f022f7fe640 1 --2- 172.21.15.62:0/2740128077 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0218005190 0x7f02300b3b90 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f0220011850 tx=0x7f0220011d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:48.779 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.775+0000 7f0217fff640 1 -- 172.21.15.62:0/2740128077 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0220004460 con 0x7f0218005190 2023-10-08T12:00:48.779 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.775+0000 7f0217fff640 1 -- 172.21.15.62:0/2740128077 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f022000fa30 con 0x7f0218005190 2023-10-08T12:00:48.779 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.775+0000 7f0217fff640 1 -- 172.21.15.62:0/2740128077 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f022000fdc0 con 0x7f0218005190 2023-10-08T12:00:48.779 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.775+0000 7f023611a640 1 -- 172.21.15.62:0/2740128077 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02300b2eb0 con 0x7f0218005190 2023-10-08T12:00:48.779 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.775+0000 7f023611a640 1 -- 172.21.15.62:0/2740128077 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f023014a230 con 0x7f0218005190 2023-10-08T12:00:48.780 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.779+0000 7f023611a640 1 -- 172.21.15.62:0/2740128077 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f023004da80 con 0x7f0218005190 2023-10-08T12:00:48.780 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.779+0000 7f0217fff640 1 -- 172.21.15.62:0/2740128077 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f0220018070 con 0x7f0218005190 2023-10-08T12:00:48.780 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.779+0000 7f0217fff640 1 --2- 172.21.15.62:0/2740128077 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f021c0664a0 0x7f021c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:48.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.779+0000 7f0217fff640 1 -- 172.21.15.62:0/2740128077 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0220084aa0 con 0x7f0218005190 2023-10-08T12:00:48.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.779+0000 7f022effd640 1 --2- 172.21.15.62:0/2740128077 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f021c0664a0 0x7f021c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:48.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.779+0000 7f022effd640 1 --2- 172.21.15.62:0/2740128077 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f021c0664a0 0x7f021c068960 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0230146a90 tx=0x7f02240060f0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:48.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.783+0000 7f0217fff640 1 -- 172.21.15.62:0/2740128077 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0220051fb0 con 0x7f0218005190 2023-10-08T12:00:48.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.967+0000 7f023611a640 1 -- 172.21.15.62:0/2740128077 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f02300b5d60 con 0x7f0218005190 2023-10-08T12:00:48.970 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.971+0000 7f0217fff640 1 -- 172.21.15.62:0/2740128077 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4120 (secure 0 0 0) 0x7f0220020020 con 0x7f0218005190 2023-10-08T12:00:48.970 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T12:00:48.970 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4334,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/2629778704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":2629778704},{"type":"v1","addr":"172.21.15.130:6835","nonce":2629778704}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4359,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/2134446062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":2134446062},{"type":"v1","addr":"172.21.15.62:6835","nonce":2134446062}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T12:00:19.866714+0000","modified":"2023-10-08T12:00:22.958677+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4362},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4362":{"gid":4362,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6834/2629384568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":2629384568},{"type":"v1","addr":"172.21.15.62:6834","nonce":2629384568}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:00:48.971 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 8 2023-10-08T12:00:48.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.971+0000 7f023611a640 1 -- 172.21.15.62:0/2740128077 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f021c0664a0 msgr2=0x7f021c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:48.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.971+0000 7f023611a640 1 --2- 172.21.15.62:0/2740128077 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f021c0664a0 0x7f021c068960 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0230146a90 tx=0x7f02240060f0 comp rx=0 tx=0).stop 2023-10-08T12:00:48.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.971+0000 7f023611a640 1 -- 172.21.15.62:0/2740128077 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0218005190 msgr2=0x7f02300b3b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:48.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.971+0000 7f023611a640 1 --2- 172.21.15.62:0/2740128077 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0218005190 0x7f02300b3b90 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f0220011850 tx=0x7f0220011d10 comp rx=0 tx=0).stop 2023-10-08T12:00:48.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.971+0000 7f023611a640 1 -- 172.21.15.62:0/2740128077 shutdown_connections 2023-10-08T12:00:48.973 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.971+0000 7f023611a640 1 --2- 172.21.15.62:0/2740128077 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f021c0664a0 0x7f021c068960 secure :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0230146a90 tx=0x7f02240060f0 comp rx=0 tx=0).stop 2023-10-08T12:00:48.973 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.971+0000 7f023611a640 1 --2- 172.21.15.62:0/2740128077 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f023013f4c0 0x7f023013f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:48.973 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.971+0000 7f023611a640 1 --2- 172.21.15.62:0/2740128077 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f02300b24f0 0x7f02300b2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:48.973 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.971+0000 7f023611a640 1 --2- 172.21.15.62:0/2740128077 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0218005190 0x7f02300b3b90 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:48.973 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.971+0000 7f023611a640 1 -- 172.21.15.62:0/2740128077 >> 172.21.15.62:0/2740128077 conn(0x7f0230069960 msgr2=0x7f02300b9960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:48.973 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.971+0000 7f023611a640 1 -- 172.21.15.62:0/2740128077 shutdown_connections 2023-10-08T12:00:48.973 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:48.971+0000 7f023611a640 1 -- 172.21.15.62:0/2740128077 wait complete. 2023-10-08T12:00:48.987 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:00:49.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.115+0000 7fac422d8640 1 -- 172.21.15.62:0/2595205520 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac3c13f650 msgr2=0x7fac3c14fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:49.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.115+0000 7fac422d8640 1 --2- 172.21.15.62:0/2595205520 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac3c13f650 0x7fac3c14fcd0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fac34009c80 tx=0x7fac3401f540 comp rx=0 tx=0).stop 2023-10-08T12:00:49.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.115+0000 7fac422d8640 1 -- 172.21.15.62:0/2595205520 shutdown_connections 2023-10-08T12:00:49.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.115+0000 7fac422d8640 1 --2- 172.21.15.62:0/2595205520 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac3c13f650 0x7fac3c14fcd0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:49.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.115+0000 7fac422d8640 1 --2- 172.21.15.62:0/2595205520 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fac3c06f540 0x7fac3c13f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:49.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.115+0000 7fac422d8640 1 -- 172.21.15.62:0/2595205520 >> 172.21.15.62:0/2595205520 conn(0x7fac3c069790 msgr2=0x7fac3c069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:49.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.115+0000 7fac422d8640 1 -- 172.21.15.62:0/2595205520 shutdown_connections 2023-10-08T12:00:49.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.115+0000 7fac422d8640 1 -- 172.21.15.62:0/2595205520 wait complete. 2023-10-08T12:00:49.117 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.115+0000 7fac422d8640 1 Processor -- start 2023-10-08T12:00:49.117 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.115+0000 7fac422d8640 1 -- start start 2023-10-08T12:00:49.117 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.115+0000 7fac422d8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac3c06f160 0x7fac3c141330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:49.117 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.115+0000 7fac422d8640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac3c06f540 0x7fac3c138220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:49.117 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.115+0000 7fac422d8640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fac3c13f650 0x7fac3c136180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:49.118 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.115+0000 7fac422d8640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac3c138760 con 0x7fac3c06f540 2023-10-08T12:00:49.118 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.115+0000 7fac422d8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac3c140ea0 con 0x7fac3c06f160 2023-10-08T12:00:49.118 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.115+0000 7fac422d8640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac3c0b3de0 con 0x7fac3c13f650 2023-10-08T12:00:49.118 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.115+0000 7fac337fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac3c06f540 0x7fac3c138220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:49.118 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.115+0000 7fac337fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac3c06f540 0x7fac3c138220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49226/0 (socket says 172.21.15.62:49226) 2023-10-08T12:00:49.118 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.115+0000 7fac337fe640 1 -- 172.21.15.62:0/4184309090 learned_addr learned my addr 172.21.15.62:0/4184309090 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:49.118 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.115+0000 7fac3bfff640 1 --2- 172.21.15.62:0/4184309090 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac3c06f160 0x7fac3c141330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:49.118 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.115+0000 7fac40875640 1 --2- 172.21.15.62:0/4184309090 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fac3c13f650 0x7fac3c136180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:49.118 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.115+0000 7fac337fe640 1 -- 172.21.15.62:0/4184309090 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fac3c13f650 msgr2=0x7fac3c136180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:49.118 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.115+0000 7fac337fe640 1 --2- 172.21.15.62:0/4184309090 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fac3c13f650 0x7fac3c136180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:49.118 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.115+0000 7fac337fe640 1 -- 172.21.15.62:0/4184309090 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac3c06f160 msgr2=0x7fac3c141330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:49.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.115+0000 7fac337fe640 1 --2- 172.21.15.62:0/4184309090 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac3c06f160 0x7fac3c141330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:49.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.115+0000 7fac337fe640 1 -- 172.21.15.62:0/4184309090 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac340098e0 con 0x7fac3c06f540 2023-10-08T12:00:49.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.115+0000 7fac337fe640 1 --2- 172.21.15.62:0/4184309090 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac3c06f540 0x7fac3c138220 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fac2400c970 tx=0x7fac2400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:49.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.115+0000 7fac397fa640 1 -- 172.21.15.62:0/4184309090 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac24007c70 con 0x7fac3c06f540 2023-10-08T12:00:49.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.115+0000 7fac397fa640 1 -- 172.21.15.62:0/4184309090 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fac2400f450 con 0x7fac3c06f540 2023-10-08T12:00:49.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.115+0000 7fac397fa640 1 -- 172.21.15.62:0/4184309090 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac2400f860 con 0x7fac3c06f540 2023-10-08T12:00:49.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.115+0000 7fac422d8640 1 -- 172.21.15.62:0/4184309090 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac3c142900 con 0x7fac3c06f540 2023-10-08T12:00:49.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.115+0000 7fac422d8640 1 -- 172.21.15.62:0/4184309090 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac3c140b30 con 0x7fac3c06f540 2023-10-08T12:00:49.120 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.119+0000 7fac422d8640 1 -- 172.21.15.62:0/4184309090 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac3c06fe70 con 0x7fac3c06f540 2023-10-08T12:00:49.120 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.119+0000 7fac397fa640 1 -- 172.21.15.62:0/4184309090 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fac2400f9c0 con 0x7fac3c06f540 2023-10-08T12:00:49.120 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.119+0000 7fac397fa640 1 --2- 172.21.15.62:0/4184309090 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fac1c0664a0 0x7fac1c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:49.120 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.119+0000 7fac397fa640 1 -- 172.21.15.62:0/4184309090 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fac24084600 con 0x7fac3c06f540 2023-10-08T12:00:49.121 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.119+0000 7fac3bfff640 1 --2- 172.21.15.62:0/4184309090 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fac1c0664a0 0x7fac1c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:49.121 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.119+0000 7fac3bfff640 1 --2- 172.21.15.62:0/4184309090 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fac1c0664a0 0x7fac1c068960 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fac2c007fd0 tx=0x7fac2c007e40 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:49.123 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.123+0000 7fac397fa640 1 -- 172.21.15.62:0/4184309090 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fac24051a80 con 0x7fac3c06f540 2023-10-08T12:00:49.281 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.279+0000 7fac422d8640 1 -- 172.21.15.62:0/4184309090 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fac3c0b5760 con 0x7fac3c06f540 2023-10-08T12:00:49.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.283+0000 7fac397fa640 1 -- 172.21.15.62:0/4184309090 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16481 (secure 0 0 0) 0x7fac240550a0 con 0x7fac3c06f540 2023-10-08T12:00:49.283 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T12:00:49.283 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":20,"fsid":"3e777930-c2c1-4f2b-a903-c07ee4ca2c52","created":"2023-10-08T11:59:54.510229+0000","modified":"2023-10-08T12:00:21.580704+0000","last_up_change":"2023-10-08T12:00:06.783998+0000","last_in_change":"2023-10-08T11:59:57.847944+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:00:07.189433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:00:17.895548+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T12:00:18.871217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7bc3070a-7240-43d9-9ec3-397b68a37e2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6820","nonce":2227876905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6824","nonce":2227876905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6831","nonce":2227876905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6828","nonce":2227876905}]},"public_addr":"172.21.15.62:6820/2227876905","cluster_addr":"172.21.15.62:6824/2227876905","heartbeat_back_addr":"172.21.15.62:6831/2227876905","heartbeat_front_addr":"172.21.15.62:6828/2227876905","state":["exists","up"]},{"osd":1,"uuid":"5e0fa1f5-9ddc-4882-b460-5578bb571003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6801","nonce":315660906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6803","nonce":315660906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6808","nonce":315660906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6805","nonce":315660906}]},"public_addr":"172.21.15.62:6801/315660906","cluster_addr":"172.21.15.62:6803/315660906","heartbeat_back_addr":"172.21.15.62:6808/315660906","heartbeat_front_addr":"172.21.15.62:6805/315660906","state":["exists","up"]},{"osd":2,"uuid":"262b5ee9-4243-4309-a14f-88ad4e8bf812","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6807","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6809","nonce":3784842938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6811","nonce":3784842938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6815","nonce":3784842938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6813","nonce":3784842938}]},"public_addr":"172.21.15.62:6809/3784842938","cluster_addr":"172.21.15.62:6811/3784842938","heartbeat_back_addr":"172.21.15.62:6815/3784842938","heartbeat_front_addr":"172.21.15.62:6813/3784842938","state":["exists","up"]},{"osd":3,"uuid":"1770bdb8-c12b-43b1-aaab-1d6b6fd18f4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6817","nonce":3385303160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6821","nonce":3385303160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6827","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6829","nonce":3385303160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6823","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6825","nonce":3385303160}]},"public_addr":"172.21.15.62:6817/3385303160","cluster_addr":"172.21.15.62:6821/3385303160","heartbeat_back_addr":"172.21.15.62:6829/3385303160","heartbeat_front_addr":"172.21.15.62:6825/3385303160","state":["exists","up"]},{"osd":4,"uuid":"74c73631-9351-494a-8246-28ee86e9f862","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6807","nonce":1174056987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6809","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6811","nonce":1174056987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6820","nonce":1174056987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6813","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6816","nonce":1174056987}]},"public_addr":"172.21.15.130:6807/1174056987","cluster_addr":"172.21.15.130:6811/1174056987","heartbeat_back_addr":"172.21.15.130:6820/1174056987","heartbeat_front_addr":"172.21.15.130:6816/1174056987","state":["exists","up"]},{"osd":5,"uuid":"1040f389-272c-41d6-ae76-70c04d09afa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6801","nonce":561928414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6803","nonce":561928414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6815","nonce":561928414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6808","nonce":561928414}]},"public_addr":"172.21.15.130:6801/561928414","cluster_addr":"172.21.15.130:6803/561928414","heartbeat_back_addr":"172.21.15.130:6815/561928414","heartbeat_front_addr":"172.21.15.130:6808/561928414","state":["exists","up"]},{"osd":6,"uuid":"178553eb-03e1-4ab8-9826-4f5997e6da0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6810","nonce":2877303015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6817","nonce":2877303015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6823","nonce":2877303015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6819","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6821","nonce":2877303015}]},"public_addr":"172.21.15.130:6810/2877303015","cluster_addr":"172.21.15.130:6817/2877303015","heartbeat_back_addr":"172.21.15.130:6823/2877303015","heartbeat_front_addr":"172.21.15.130:6821/2877303015","state":["exists","up"]},{"osd":7,"uuid":"b6581c8f-30b1-4dfd-b7b6-94b579128835","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6825","nonce":680009774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6827","nonce":680009774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6831","nonce":680009774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6829","nonce":680009774}]},"public_addr":"172.21.15.130:6825/680009774","cluster_addr":"172.21.15.130:6827/680009774","heartbeat_back_addr":"172.21.15.130:6831/680009774","heartbeat_front_addr":"172.21.15.130:6829/680009774","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.505543+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.394383+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.456652+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.529168+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.235414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.392158+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.347556+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.432039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:00:49.286 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.283+0000 7fac422d8640 1 -- 172.21.15.62:0/4184309090 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fac1c0664a0 msgr2=0x7fac1c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:49.286 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.283+0000 7fac422d8640 1 --2- 172.21.15.62:0/4184309090 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fac1c0664a0 0x7fac1c068960 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fac2c007fd0 tx=0x7fac2c007e40 comp rx=0 tx=0).stop 2023-10-08T12:00:49.286 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.283+0000 7fac422d8640 1 -- 172.21.15.62:0/4184309090 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac3c06f540 msgr2=0x7fac3c138220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:49.286 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.283+0000 7fac422d8640 1 --2- 172.21.15.62:0/4184309090 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac3c06f540 0x7fac3c138220 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fac2400c970 tx=0x7fac2400ce30 comp rx=0 tx=0).stop 2023-10-08T12:00:49.286 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.283+0000 7fac422d8640 1 -- 172.21.15.62:0/4184309090 shutdown_connections 2023-10-08T12:00:49.286 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.287+0000 7fac422d8640 1 --2- 172.21.15.62:0/4184309090 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fac1c0664a0 0x7fac1c068960 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:49.286 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.287+0000 7fac422d8640 1 --2- 172.21.15.62:0/4184309090 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fac3c13f650 0x7fac3c136180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:49.287 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.287+0000 7fac422d8640 1 --2- 172.21.15.62:0/4184309090 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac3c06f540 0x7fac3c138220 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:49.287 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.287+0000 7fac422d8640 1 --2- 172.21.15.62:0/4184309090 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac3c06f160 0x7fac3c141330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:49.287 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.287+0000 7fac422d8640 1 -- 172.21.15.62:0/4184309090 >> 172.21.15.62:0/4184309090 conn(0x7fac3c069790 msgr2=0x7fac3c13e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:49.287 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.287+0000 7fac422d8640 1 -- 172.21.15.62:0/4184309090 shutdown_connections 2023-10-08T12:00:49.287 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.287+0000 7fac422d8640 1 -- 172.21.15.62:0/4184309090 wait complete. 2023-10-08T12:00:49.303 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-08T12:00:49.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.427+0000 7f2190db3640 1 -- 172.21.15.62:0/3034573711 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f218c0b9260 msgr2=0x7f218c0b8570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:49.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.427+0000 7f2190db3640 1 --2- 172.21.15.62:0/3034573711 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f218c0b9260 0x7f218c0b8570 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f218c0718d0 tx=0x7f218001c8a0 comp rx=0 tx=0).stop 2023-10-08T12:00:49.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.427+0000 7f2190db3640 1 -- 172.21.15.62:0/3034573711 shutdown_connections 2023-10-08T12:00:49.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.427+0000 7f2190db3640 1 --2- 172.21.15.62:0/3034573711 >> v2:172.21.15.130:3300/0 conn(0x7f218c071410 0x7f218c0b6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:49.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.427+0000 7f2190db3640 1 --2- 172.21.15.62:0/3034573711 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f218c0b9260 0x7f218c0b8570 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:49.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.427+0000 7f2190db3640 1 -- 172.21.15.62:0/3034573711 >> 172.21.15.62:0/3034573711 conn(0x7f218c09c520 msgr2=0x7f218c09c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:49.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.427+0000 7f2190db3640 1 -- 172.21.15.62:0/3034573711 shutdown_connections 2023-10-08T12:00:49.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.427+0000 7f2190db3640 1 -- 172.21.15.62:0/3034573711 wait complete. 2023-10-08T12:00:49.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.427+0000 7f2190db3640 1 Processor -- start 2023-10-08T12:00:49.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.427+0000 7f2190db3640 1 -- start start 2023-10-08T12:00:49.431 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.427+0000 7f2190db3640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f218c071410 0x7f218c09eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:49.431 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.427+0000 7f2190db3640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f218c0b9260 0x7f218c1e2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:49.431 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.427+0000 7f2190db3640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f218c147920 0x7f218c0702c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:49.431 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.427+0000 7f2190db3640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f218c09fac0 con 0x7f218c0b9260 2023-10-08T12:00:49.431 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.427+0000 7f2190db3640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f218c09f090 con 0x7f218c071410 2023-10-08T12:00:49.431 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.427+0000 7f2190db3640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f218c09e780 con 0x7f218c147920 2023-10-08T12:00:49.431 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.427+0000 7f2189d9b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f218c0b9260 0x7f218c1e2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:49.431 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.427+0000 7f2189d9b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f218c0b9260 0x7f218c1e2520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49248/0 (socket says 172.21.15.62:49248) 2023-10-08T12:00:49.431 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.431+0000 7f2189d9b640 1 -- 172.21.15.62:0/3344638738 learned_addr learned my addr 172.21.15.62:0/3344638738 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:49.431 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.431+0000 7f218a59c640 1 --2- 172.21.15.62:0/3344638738 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f218c071410 0x7f218c09eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:49.432 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.431+0000 7f218ad9d640 1 --2- 172.21.15.62:0/3344638738 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f218c147920 0x7f218c0702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:49.432 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.431+0000 7f2189d9b640 1 -- 172.21.15.62:0/3344638738 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f218c147920 msgr2=0x7f218c0702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:49.432 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.431+0000 7f2189d9b640 1 --2- 172.21.15.62:0/3344638738 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f218c147920 0x7f218c0702c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:49.432 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.431+0000 7f2189d9b640 1 -- 172.21.15.62:0/3344638738 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f218c071410 msgr2=0x7f218c09eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:49.432 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.431+0000 7f2189d9b640 1 --2- 172.21.15.62:0/3344638738 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f218c071410 0x7f218c09eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:49.432 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.431+0000 7f2189d9b640 1 -- 172.21.15.62:0/3344638738 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2180009560 con 0x7f218c0b9260 2023-10-08T12:00:49.432 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.431+0000 7f218a59c640 1 --2- 172.21.15.62:0/3344638738 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f218c071410 0x7f218c09eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:00:49.432 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.431+0000 7f2189d9b640 1 --2- 172.21.15.62:0/3344638738 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f218c0b9260 0x7f218c1e2520 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f217c00c3c0 tx=0x7f217c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:49.432 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.431+0000 7f217affd640 1 -- 172.21.15.62:0/3344638738 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f217c0052d0 con 0x7f218c0b9260 2023-10-08T12:00:49.432 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.431+0000 7f217affd640 1 -- 172.21.15.62:0/3344638738 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f217c003600 con 0x7f218c0b9260 2023-10-08T12:00:49.432 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.431+0000 7f2190db3640 1 -- 172.21.15.62:0/3344638738 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f218c09d9c0 con 0x7f218c0b9260 2023-10-08T12:00:49.432 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.431+0000 7f217affd640 1 -- 172.21.15.62:0/3344638738 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f217c003a10 con 0x7f218c0b9260 2023-10-08T12:00:49.433 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.431+0000 7f2190db3640 1 -- 172.21.15.62:0/3344638738 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f218c09e260 con 0x7f218c0b9260 2023-10-08T12:00:49.433 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.431+0000 7f2190db3640 1 -- 172.21.15.62:0/3344638738 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f218c0b5be0 con 0x7f218c0b9260 2023-10-08T12:00:49.434 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.431+0000 7f217affd640 1 -- 172.21.15.62:0/3344638738 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f217c003b70 con 0x7f218c0b9260 2023-10-08T12:00:49.434 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.431+0000 7f217affd640 1 --2- 172.21.15.62:0/3344638738 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f216c066470 0x7f216c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:49.434 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.431+0000 7f217affd640 1 -- 172.21.15.62:0/3344638738 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f217c083720 con 0x7f218c0b9260 2023-10-08T12:00:49.434 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.431+0000 7f218a59c640 1 --2- 172.21.15.62:0/3344638738 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f216c066470 0x7f216c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:49.434 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.431+0000 7f218a59c640 1 --2- 172.21.15.62:0/3344638738 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f216c066470 0x7f216c068930 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f21800af000 tx=0x7f218001b0e0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:49.436 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.435+0000 7f217affd640 1 -- 172.21.15.62:0/3344638738 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f217c050d10 con 0x7f218c0b9260 2023-10-08T12:00:49.626 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.627+0000 7f2190db3640 1 -- 172.21.15.62:0/3344638738 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f218c09dbb0 con 0x7f218c0b9260 2023-10-08T12:00:49.627 INFO:tasks.ceph.mon.a.smithi062.stderr:2023-10-08T12:00:49.627+0000 7fe01c507640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-08T12:00:49.630 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.631+0000 7f217affd640 1 -- 172.21.15.62:0/3344638738 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f217c054330 con 0x7f218c0b9260 2023-10-08T12:00:49.630 INFO:teuthology.orchestra.run.smithi062.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-08T12:00:49.633 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.631+0000 7f2190db3640 1 -- 172.21.15.62:0/3344638738 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f216c066470 msgr2=0x7f216c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:49.633 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.631+0000 7f2190db3640 1 --2- 172.21.15.62:0/3344638738 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f216c066470 0x7f216c068930 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f21800af000 tx=0x7f218001b0e0 comp rx=0 tx=0).stop 2023-10-08T12:00:49.633 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.631+0000 7f2190db3640 1 -- 172.21.15.62:0/3344638738 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f218c0b9260 msgr2=0x7f218c1e2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:49.633 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.631+0000 7f2190db3640 1 --2- 172.21.15.62:0/3344638738 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f218c0b9260 0x7f218c1e2520 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f217c00c3c0 tx=0x7f217c00c880 comp rx=0 tx=0).stop 2023-10-08T12:00:49.633 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.631+0000 7f2190db3640 1 -- 172.21.15.62:0/3344638738 shutdown_connections 2023-10-08T12:00:49.633 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.631+0000 7f2190db3640 1 --2- 172.21.15.62:0/3344638738 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f216c066470 0x7f216c068930 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:49.633 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.631+0000 7f2190db3640 1 --2- 172.21.15.62:0/3344638738 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f218c147920 0x7f218c0702c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:49.633 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.631+0000 7f2190db3640 1 --2- 172.21.15.62:0/3344638738 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f218c0b9260 0x7f218c1e2520 secure :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f217c00c3c0 tx=0x7f217c00c880 comp rx=0 tx=0).stop 2023-10-08T12:00:49.633 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.631+0000 7f2190db3640 1 --2- 172.21.15.62:0/3344638738 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f218c071410 0x7f218c09eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:49.633 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.631+0000 7f2190db3640 1 -- 172.21.15.62:0/3344638738 >> 172.21.15.62:0/3344638738 conn(0x7f218c09c520 msgr2=0x7f218c150b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:49.633 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.631+0000 7f2190db3640 1 -- 172.21.15.62:0/3344638738 shutdown_connections 2023-10-08T12:00:49.634 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.631+0000 7f2190db3640 1 -- 172.21.15.62:0/3344638738 wait complete. 2023-10-08T12:00:49.639 INFO:tasks.ceph.mds.a.smithi062.stderr: -4713> 2023-10-08T12:00:24.479+0000 7f34590cb640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T12:00:49.654 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-08T12:00:49.680 INFO:tasks.ceph.mds.a.smithi062.stdout:starting mds.a at 2023-10-08T12:00:49.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.771+0000 7fa9f541b640 1 -- 172.21.15.62:0/680802164 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa9d80047d0 msgr2=0x7fa9d8004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:49.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.771+0000 7fa9f541b640 1 --2- 172.21.15.62:0/680802164 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa9d80047d0 0x7fa9d8004c50 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa9f00ba740 tx=0x7fa9e401cf60 comp rx=0 tx=0).stop 2023-10-08T12:00:49.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.775+0000 7fa9f541b640 1 -- 172.21.15.62:0/680802164 shutdown_connections 2023-10-08T12:00:49.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.775+0000 7fa9f541b640 1 --2- 172.21.15.62:0/680802164 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa9d80047d0 0x7fa9d8004c50 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:49.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.775+0000 7fa9f541b640 1 -- 172.21.15.62:0/680802164 >> 172.21.15.62:0/680802164 conn(0x7fa9f009c520 msgr2=0x7fa9f009c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:49.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.775+0000 7fa9f541b640 1 -- 172.21.15.62:0/680802164 shutdown_connections 2023-10-08T12:00:49.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.775+0000 7fa9f541b640 1 -- 172.21.15.62:0/680802164 wait complete. 2023-10-08T12:00:49.777 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.775+0000 7fa9f541b640 1 Processor -- start 2023-10-08T12:00:49.777 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.775+0000 7fa9f541b640 1 -- start start 2023-10-08T12:00:49.777 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.775+0000 7fa9f541b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa9d80047d0 0x7fa9f01d5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:49.777 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.775+0000 7fa9f541b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa9f0144d70 0x7fa9f01451f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:49.777 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.775+0000 7fa9f541b640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa9f01d0ef0 0x7fa9f01d1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:49.777 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.775+0000 7fa9f541b640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f01d55d0 con 0x7fa9d80047d0 2023-10-08T12:00:49.777 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.775+0000 7fa9f541b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f01d1cf0 con 0x7fa9f0144d70 2023-10-08T12:00:49.777 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.775+0000 7fa9f541b640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f01d2270 con 0x7fa9f01d0ef0 2023-10-08T12:00:49.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.775+0000 7fa9eeffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa9d80047d0 0x7fa9f01d5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:49.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.775+0000 7fa9eeffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa9d80047d0 0x7fa9f01d5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49296/0 (socket says 172.21.15.62:49296) 2023-10-08T12:00:49.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.775+0000 7fa9eeffd640 1 -- 172.21.15.62:0/2603893685 learned_addr learned my addr 172.21.15.62:0/2603893685 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:49.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.775+0000 7fa9ee7fc640 1 --2- 172.21.15.62:0/2603893685 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa9f0144d70 0x7fa9f01451f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:49.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.775+0000 7fa9ef7fe640 1 --2- 172.21.15.62:0/2603893685 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa9f01d0ef0 0x7fa9f01d1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:49.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.775+0000 7fa9eeffd640 1 -- 172.21.15.62:0/2603893685 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa9f01d0ef0 msgr2=0x7fa9f01d1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:49.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.775+0000 7fa9eeffd640 1 --2- 172.21.15.62:0/2603893685 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa9f01d0ef0 0x7fa9f01d1370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:49.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.775+0000 7fa9eeffd640 1 -- 172.21.15.62:0/2603893685 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa9f0144d70 msgr2=0x7fa9f01451f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:49.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.775+0000 7fa9eeffd640 1 --2- 172.21.15.62:0/2603893685 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa9f0144d70 0x7fa9f01451f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:49.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.775+0000 7fa9eeffd640 1 -- 172.21.15.62:0/2603893685 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9f0099890 con 0x7fa9d80047d0 2023-10-08T12:00:49.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.775+0000 7fa9eeffd640 1 --2- 172.21.15.62:0/2603893685 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa9d80047d0 0x7fa9f01d5090 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa9e000ee00 tx=0x7fa9e000c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:49.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.775+0000 7fa9d77fe640 1 -- 172.21.15.62:0/2603893685 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e0009750 con 0x7fa9d80047d0 2023-10-08T12:00:49.779 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.775+0000 7fa9d77fe640 1 -- 172.21.15.62:0/2603893685 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa9e00099a0 con 0x7fa9d80047d0 2023-10-08T12:00:49.779 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.775+0000 7fa9d77fe640 1 -- 172.21.15.62:0/2603893685 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e0009d90 con 0x7fa9d80047d0 2023-10-08T12:00:49.779 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.775+0000 7fa9f541b640 1 -- 172.21.15.62:0/2603893685 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9f01d1f00 con 0x7fa9d80047d0 2023-10-08T12:00:49.779 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.775+0000 7fa9f541b640 1 -- 172.21.15.62:0/2603893685 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9f0099420 con 0x7fa9d80047d0 2023-10-08T12:00:49.779 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.775+0000 7fa9f541b640 1 -- 172.21.15.62:0/2603893685 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9f004da80 con 0x7fa9d80047d0 2023-10-08T12:00:49.780 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.779+0000 7fa9d77fe640 1 -- 172.21.15.62:0/2603893685 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa9e00163f0 con 0x7fa9d80047d0 2023-10-08T12:00:49.780 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.779+0000 7fa9d77fe640 1 --2- 172.21.15.62:0/2603893685 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fa9dc0664a0 0x7fa9dc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:49.780 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.779+0000 7fa9d77fe640 1 -- 172.21.15.62:0/2603893685 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fa9e00848d0 con 0x7fa9d80047d0 2023-10-08T12:00:49.780 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.779+0000 7fa9ee7fc640 1 --2- 172.21.15.62:0/2603893685 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fa9dc0664a0 0x7fa9dc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:49.780 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.779+0000 7fa9ee7fc640 1 --2- 172.21.15.62:0/2603893685 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fa9dc0664a0 0x7fa9dc068960 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa9e40ac000 tx=0x7fa9e40b0040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:49.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.783+0000 7fa9d77fe640 1 -- 172.21.15.62:0/2603893685 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa9e0051d00 con 0x7fa9d80047d0 2023-10-08T12:00:49.975 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:49.975+0000 7fa9f541b640 1 -- 172.21.15.62:0/2603893685 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa9f00b0ca0 con 0x7fa9d80047d0 2023-10-08T12:00:50.633 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:50.631+0000 7fa9d77fe640 1 -- 172.21.15.62:0/2603893685 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa9e0055320 con 0x7fa9d80047d0 2023-10-08T12:00:50.636 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:50.635+0000 7fa9f541b640 1 -- 172.21.15.62:0/2603893685 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fa9dc0664a0 msgr2=0x7fa9dc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:50.637 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:50.635+0000 7fa9f541b640 1 --2- 172.21.15.62:0/2603893685 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fa9dc0664a0 0x7fa9dc068960 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa9e40ac000 tx=0x7fa9e40b0040 comp rx=0 tx=0).stop 2023-10-08T12:00:50.637 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:50.635+0000 7fa9f541b640 1 -- 172.21.15.62:0/2603893685 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa9d80047d0 msgr2=0x7fa9f01d5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:50.637 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:50.635+0000 7fa9f541b640 1 --2- 172.21.15.62:0/2603893685 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa9d80047d0 0x7fa9f01d5090 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa9e000ee00 tx=0x7fa9e000c740 comp rx=0 tx=0).stop 2023-10-08T12:00:50.637 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:50.635+0000 7fa9f541b640 1 -- 172.21.15.62:0/2603893685 shutdown_connections 2023-10-08T12:00:50.637 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:50.635+0000 7fa9f541b640 1 --2- 172.21.15.62:0/2603893685 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fa9dc0664a0 0x7fa9dc068960 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:50.637 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:50.635+0000 7fa9f541b640 1 --2- 172.21.15.62:0/2603893685 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa9f01d0ef0 0x7fa9f01d1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:50.637 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:50.635+0000 7fa9f541b640 1 --2- 172.21.15.62:0/2603893685 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa9f0144d70 0x7fa9f01451f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:50.637 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:50.635+0000 7fa9f541b640 1 --2- 172.21.15.62:0/2603893685 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa9d80047d0 0x7fa9f01d5090 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:50.637 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:50.635+0000 7fa9f541b640 1 -- 172.21.15.62:0/2603893685 >> 172.21.15.62:0/2603893685 conn(0x7fa9f009c520 msgr2=0x7fa9f009b710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:50.637 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:50.635+0000 7fa9f541b640 1 -- 172.21.15.62:0/2603893685 shutdown_connections 2023-10-08T12:00:50.637 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:50.635+0000 7fa9f541b640 1 -- 172.21.15.62:0/2603893685 wait complete. 2023-10-08T12:00:50.660 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-08T12:00:50.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:50.843+0000 7f1c35f34640 1 -- 172.21.15.62:0/3439600836 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c300ba660 msgr2=0x7f1c30069790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:50.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:50.843+0000 7f1c35f34640 1 --2- 172.21.15.62:0/3439600836 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c300ba660 0x7f1c30069790 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1c3006a870 tx=0x7f1c2401efd0 comp rx=0 tx=0).stop 2023-10-08T12:00:50.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:50.843+0000 7f1c35f34640 1 -- 172.21.15.62:0/3439600836 shutdown_connections 2023-10-08T12:00:50.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:50.843+0000 7f1c35f34640 1 --2- 172.21.15.62:0/3439600836 >> v2:172.21.15.130:3300/0 conn(0x7f1c30069cd0 0x7f1c301538e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:50.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:50.843+0000 7f1c35f34640 1 --2- 172.21.15.62:0/3439600836 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c300ba660 0x7f1c30069790 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:50.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:50.843+0000 7f1c35f34640 1 -- 172.21.15.62:0/3439600836 >> 172.21.15.62:0/3439600836 conn(0x7f1c300be900 msgr2=0x7f1c300bed10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:50.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:50.843+0000 7f1c35f34640 1 -- 172.21.15.62:0/3439600836 shutdown_connections 2023-10-08T12:00:50.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:50.843+0000 7f1c35f34640 1 -- 172.21.15.62:0/3439600836 wait complete. 2023-10-08T12:00:50.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:50.843+0000 7f1c35f34640 1 Processor -- start 2023-10-08T12:00:50.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:50.843+0000 7f1c35f34640 1 -- start start 2023-10-08T12:00:50.847 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:50.843+0000 7f1c35f34640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c30069cd0 0x7f1c301e6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:50.847 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:50.843+0000 7f1c35f34640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1c300ba660 0x7f1c301413c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:50.847 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:50.843+0000 7f1c35f34640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1c3013f900 0x7f1c301403f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:50.847 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:50.843+0000 7f1c35f34640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c301e71c0 con 0x7f1c30069cd0 2023-10-08T12:00:50.847 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:50.843+0000 7f1c35f34640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3014ca90 con 0x7f1c3013f900 2023-10-08T12:00:50.847 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:50.843+0000 7f1c35f34640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c301e7420 con 0x7f1c300ba660 2023-10-08T12:00:50.847 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:50.843+0000 7f1c2f7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c30069cd0 0x7f1c301e6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:50.847 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:50.843+0000 7f1c2f7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c30069cd0 0x7f1c301e6c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49312/0 (socket says 172.21.15.62:49312) 2023-10-08T12:00:50.847 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:50.843+0000 7f1c2f7fe640 1 -- 172.21.15.62:0/3524599795 learned_addr learned my addr 172.21.15.62:0/3524599795 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:50.847 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:50.843+0000 7f1c2ffff640 1 --2- 172.21.15.62:0/3524599795 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1c3013f900 0x7f1c301403f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:50.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:50.843+0000 7f1c2f7fe640 1 -- 172.21.15.62:0/3524599795 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1c300ba660 msgr2=0x7f1c301413c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:50.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:50.847+0000 7f1c2f7fe640 1 --2- 172.21.15.62:0/3524599795 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1c300ba660 0x7f1c301413c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:50.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:50.847+0000 7f1c2f7fe640 1 -- 172.21.15.62:0/3524599795 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1c3013f900 msgr2=0x7f1c301403f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:50.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:50.847+0000 7f1c2f7fe640 1 --2- 172.21.15.62:0/3524599795 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1c3013f900 0x7f1c301403f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:50.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:50.847+0000 7f1c2f7fe640 1 -- 172.21.15.62:0/3524599795 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c240094a0 con 0x7f1c30069cd0 2023-10-08T12:00:50.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:50.847+0000 7f1c2ffff640 1 --2- 172.21.15.62:0/3524599795 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1c3013f900 0x7f1c301403f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:00:50.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:50.847+0000 7f1c2f7fe640 1 --2- 172.21.15.62:0/3524599795 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c30069cd0 0x7f1c301e6c80 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1c2000c430 tx=0x7f1c2000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:50.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:50.847+0000 7f1c17fff640 1 -- 172.21.15.62:0/3524599795 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c20004230 con 0x7f1c30069cd0 2023-10-08T12:00:50.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:50.847+0000 7f1c17fff640 1 -- 172.21.15.62:0/3524599795 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1c200044a0 con 0x7f1c30069cd0 2023-10-08T12:00:50.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:50.847+0000 7f1c35f34640 1 -- 172.21.15.62:0/3524599795 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c301e7700 con 0x7f1c30069cd0 2023-10-08T12:00:50.849 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:50.847+0000 7f1c17fff640 1 -- 172.21.15.62:0/3524599795 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c20003840 con 0x7f1c30069cd0 2023-10-08T12:00:50.849 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:50.847+0000 7f1c35f34640 1 -- 172.21.15.62:0/3524599795 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c3013c6a0 con 0x7f1c30069cd0 2023-10-08T12:00:50.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:50.847+0000 7f1c35f34640 1 -- 172.21.15.62:0/3524599795 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c300b5b10 con 0x7f1c30069cd0 2023-10-08T12:00:50.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:50.847+0000 7f1c17fff640 1 -- 172.21.15.62:0/3524599795 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f1c200039a0 con 0x7f1c30069cd0 2023-10-08T12:00:50.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:50.847+0000 7f1c17fff640 1 --2- 172.21.15.62:0/3524599795 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f1c1c066470 0x7f1c1c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:50.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:50.847+0000 7f1c17fff640 1 -- 172.21.15.62:0/3524599795 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f1c20083880 con 0x7f1c30069cd0 2023-10-08T12:00:50.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:50.847+0000 7f1c2effd640 1 --2- 172.21.15.62:0/3524599795 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f1c1c066470 0x7f1c1c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:50.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:50.851+0000 7f1c2effd640 1 --2- 172.21.15.62:0/3524599795 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f1c1c066470 0x7f1c1c068930 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1c240b2000 tx=0x7f1c2401bd70 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:50.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:50.851+0000 7f1c17fff640 1 -- 172.21.15.62:0/3524599795 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1c200548a0 con 0x7f1c30069cd0 2023-10-08T12:00:51.006 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:51.007+0000 7f1c35f34640 1 -- 172.21.15.62:0/3524599795 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1c301e7940 con 0x7f1c30069cd0 2023-10-08T12:00:51.647 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:51.647+0000 7f1c17fff640 1 -- 172.21.15.62:0/3524599795 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v22) v1 ==== 181+0+0 (secure 0 0 0) 0x7f1c301e7940 con 0x7f1c30069cd0 2023-10-08T12:00:51.647 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_metadata' removed 2023-10-08T12:00:51.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:51.651+0000 7f1c35f34640 1 -- 172.21.15.62:0/3524599795 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f1c1c066470 msgr2=0x7f1c1c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:51.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:51.651+0000 7f1c35f34640 1 --2- 172.21.15.62:0/3524599795 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f1c1c066470 0x7f1c1c068930 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1c240b2000 tx=0x7f1c2401bd70 comp rx=0 tx=0).stop 2023-10-08T12:00:51.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:51.651+0000 7f1c35f34640 1 -- 172.21.15.62:0/3524599795 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c30069cd0 msgr2=0x7f1c301e6c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:51.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:51.651+0000 7f1c35f34640 1 --2- 172.21.15.62:0/3524599795 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c30069cd0 0x7f1c301e6c80 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1c2000c430 tx=0x7f1c2000c8f0 comp rx=0 tx=0).stop 2023-10-08T12:00:51.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:51.651+0000 7f1c35f34640 1 -- 172.21.15.62:0/3524599795 shutdown_connections 2023-10-08T12:00:51.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:51.651+0000 7f1c35f34640 1 --2- 172.21.15.62:0/3524599795 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f1c1c066470 0x7f1c1c068930 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:51.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:51.651+0000 7f1c35f34640 1 --2- 172.21.15.62:0/3524599795 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1c300ba660 0x7f1c301413c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:51.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:51.651+0000 7f1c35f34640 1 --2- 172.21.15.62:0/3524599795 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1c3013f900 0x7f1c301403f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:51.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:51.651+0000 7f1c35f34640 1 --2- 172.21.15.62:0/3524599795 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c30069cd0 0x7f1c301e6c80 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:51.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:51.651+0000 7f1c35f34640 1 -- 172.21.15.62:0/3524599795 >> 172.21.15.62:0/3524599795 conn(0x7f1c300be900 msgr2=0x7f1c30139a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:51.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:51.651+0000 7f1c35f34640 1 -- 172.21.15.62:0/3524599795 shutdown_connections 2023-10-08T12:00:51.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:51.651+0000 7f1c35f34640 1 -- 172.21.15.62:0/3524599795 wait complete. 2023-10-08T12:00:51.674 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-08T12:00:51.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:51.815+0000 7f1e95a28640 1 -- 172.21.15.62:0/2277761472 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1e9014cde0 msgr2=0x7f1e90141a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:51.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:51.815+0000 7f1e95a28640 1 --2- 172.21.15.62:0/2277761472 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1e9014cde0 0x7f1e90141a90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f1e88009bf0 tx=0x7f1e8801c880 comp rx=0 tx=0).stop 2023-10-08T12:00:51.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:51.815+0000 7f1e95a28640 1 -- 172.21.15.62:0/2277761472 shutdown_connections 2023-10-08T12:00:51.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:51.815+0000 7f1e95a28640 1 --2- 172.21.15.62:0/2277761472 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1e9014cde0 0x7f1e90141a90 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:51.818 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:51.815+0000 7f1e95a28640 1 --2- 172.21.15.62:0/2277761472 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1e900b70d0 0x7f1e900b74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:51.818 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:51.815+0000 7f1e95a28640 1 -- 172.21.15.62:0/2277761472 >> 172.21.15.62:0/2277761472 conn(0x7f1e900ba770 msgr2=0x7f1e900bab80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:51.818 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:51.815+0000 7f1e95a28640 1 -- 172.21.15.62:0/2277761472 shutdown_connections 2023-10-08T12:00:51.818 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:51.815+0000 7f1e95a28640 1 -- 172.21.15.62:0/2277761472 wait complete. 2023-10-08T12:00:51.820 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:51.819+0000 7f1e95a28640 1 Processor -- start 2023-10-08T12:00:51.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:51.819+0000 7f1e95a28640 1 -- start start 2023-10-08T12:00:51.823 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:51.823+0000 7f1e95a28640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1e900713a0 0x7f1e9013f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:51.823 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:51.823+0000 7f1e95a28640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e900b70d0 0x7f1e90140d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:51.823 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:51.823+0000 7f1e95a28640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1e9014cde0 0x7f1e90142b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:51.823 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:51.823+0000 7f1e95a28640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e901412c0 con 0x7f1e900713a0 2023-10-08T12:00:51.823 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:51.823+0000 7f1e95a28640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e90131800 con 0x7f1e900b70d0 2023-10-08T12:00:51.823 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:51.823+0000 7f1e95a28640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e901e7190 con 0x7f1e9014cde0 2023-10-08T12:00:51.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:51.823+0000 7f1e8effd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1e900713a0 0x7f1e9013f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:51.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:51.823+0000 7f1e8effd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1e900713a0 0x7f1e9013f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49324/0 (socket says 172.21.15.62:49324) 2023-10-08T12:00:51.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:51.823+0000 7f1e8effd640 1 -- 172.21.15.62:0/1274840064 learned_addr learned my addr 172.21.15.62:0/1274840064 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:51.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:51.823+0000 7f1e8e7fc640 1 --2- 172.21.15.62:0/1274840064 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e900b70d0 0x7f1e90140d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:51.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:51.823+0000 7f1e8effd640 1 -- 172.21.15.62:0/1274840064 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1e9014cde0 msgr2=0x7f1e90142b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:51.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:51.823+0000 7f1e8effd640 1 --2- 172.21.15.62:0/1274840064 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1e9014cde0 0x7f1e90142b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:51.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:51.823+0000 7f1e8effd640 1 -- 172.21.15.62:0/1274840064 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e900b70d0 msgr2=0x7f1e90140d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:51.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:51.823+0000 7f1e8effd640 1 --2- 172.21.15.62:0/1274840064 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e900b70d0 0x7f1e90140d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:51.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:51.823+0000 7f1e8effd640 1 -- 172.21.15.62:0/1274840064 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e88009820 con 0x7f1e900713a0 2023-10-08T12:00:51.826 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:51.823+0000 7f1e8effd640 1 --2- 172.21.15.62:0/1274840064 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1e900713a0 0x7f1e9013f130 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1e8400d950 tx=0x7f1e8400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:51.826 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:51.823+0000 7f1e77fff640 1 -- 172.21.15.62:0/1274840064 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e84009c30 con 0x7f1e900713a0 2023-10-08T12:00:51.826 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:51.823+0000 7f1e77fff640 1 -- 172.21.15.62:0/1274840064 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1e84009e80 con 0x7f1e900713a0 2023-10-08T12:00:51.826 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:51.823+0000 7f1e77fff640 1 -- 172.21.15.62:0/1274840064 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e840106c0 con 0x7f1e900713a0 2023-10-08T12:00:51.826 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:51.823+0000 7f1e95a28640 1 -- 172.21.15.62:0/1274840064 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e901e7620 con 0x7f1e900713a0 2023-10-08T12:00:51.826 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:51.823+0000 7f1e95a28640 1 -- 172.21.15.62:0/1274840064 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e901e6b40 con 0x7f1e900713a0 2023-10-08T12:00:51.826 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:51.823+0000 7f1e95a28640 1 -- 172.21.15.62:0/1274840064 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e9004da80 con 0x7f1e900713a0 2023-10-08T12:00:51.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:51.827+0000 7f1e77fff640 1 -- 172.21.15.62:0/1274840064 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f1e84010820 con 0x7f1e900713a0 2023-10-08T12:00:51.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:51.827+0000 7f1e77fff640 1 --2- 172.21.15.62:0/1274840064 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f1e7c0664c0 0x7f1e7c068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:51.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:51.827+0000 7f1e8e7fc640 1 --2- 172.21.15.62:0/1274840064 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f1e7c0664c0 0x7f1e7c068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:51.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:51.827+0000 7f1e8e7fc640 1 --2- 172.21.15.62:0/1274840064 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f1e7c0664c0 0x7f1e7c068980 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1e9014c270 tx=0x7f1e80009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:51.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:51.831+0000 7f1e77fff640 1 -- 172.21.15.62:0/1274840064 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f1e84055fd0 con 0x7f1e900713a0 2023-10-08T12:00:51.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:51.831+0000 7f1e77fff640 1 -- 172.21.15.62:0/1274840064 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1e84082e60 con 0x7f1e900713a0 2023-10-08T12:00:51.988 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:51.987+0000 7f1e95a28640 1 -- 172.21.15.62:0/1274840064 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1e90144b50 con 0x7f1e900713a0 2023-10-08T12:00:52.650 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:52.651+0000 7f1e77fff640 1 -- 172.21.15.62:0/1274840064 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v23) v1 ==== 169+0+0 (secure 0 0 0) 0x7f1e84017070 con 0x7f1e900713a0 2023-10-08T12:00:52.651 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_data' removed 2023-10-08T12:00:52.656 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:52.655+0000 7f1e95a28640 1 -- 172.21.15.62:0/1274840064 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f1e7c0664c0 msgr2=0x7f1e7c068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:52.656 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:52.655+0000 7f1e95a28640 1 --2- 172.21.15.62:0/1274840064 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f1e7c0664c0 0x7f1e7c068980 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1e9014c270 tx=0x7f1e80009040 comp rx=0 tx=0).stop 2023-10-08T12:00:52.657 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:52.655+0000 7f1e95a28640 1 -- 172.21.15.62:0/1274840064 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1e900713a0 msgr2=0x7f1e9013f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:52.657 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:52.655+0000 7f1e95a28640 1 --2- 172.21.15.62:0/1274840064 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1e900713a0 0x7f1e9013f130 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1e8400d950 tx=0x7f1e8400de10 comp rx=0 tx=0).stop 2023-10-08T12:00:52.657 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:52.655+0000 7f1e95a28640 1 -- 172.21.15.62:0/1274840064 shutdown_connections 2023-10-08T12:00:52.657 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:52.655+0000 7f1e95a28640 1 --2- 172.21.15.62:0/1274840064 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f1e7c0664c0 0x7f1e7c068980 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:52.657 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:52.655+0000 7f1e95a28640 1 --2- 172.21.15.62:0/1274840064 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1e9014cde0 0x7f1e90142b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:52.657 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:52.655+0000 7f1e95a28640 1 --2- 172.21.15.62:0/1274840064 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e900b70d0 0x7f1e90140d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:52.657 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:52.655+0000 7f1e95a28640 1 --2- 172.21.15.62:0/1274840064 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1e900713a0 0x7f1e9013f130 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:52.657 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:52.655+0000 7f1e95a28640 1 -- 172.21.15.62:0/1274840064 >> 172.21.15.62:0/1274840064 conn(0x7f1e900ba770 msgr2=0x7f1e900b8b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:52.657 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:52.655+0000 7f1e95a28640 1 -- 172.21.15.62:0/1274840064 shutdown_connections 2023-10-08T12:00:52.657 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:52.655+0000 7f1e95a28640 1 -- 172.21.15.62:0/1274840064 wait complete. 2023-10-08T12:00:52.686 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-08T12:00:52.686 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-08T12:00:52.686 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-08T12:00:52.686 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T12:00:52.686 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-08T12:00:52.687 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-08T12:00:52.687 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-08T12:00:52.687 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T12:00:52.687 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-08T12:00:52.687 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-08T12:00:52.687 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-08T12:00:52.687 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T12:00:52.699 INFO:tasks.ceph.mds.a:Stopped 2023-10-08T12:00:52.699 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-08T12:00:52.700 INFO:tasks.ceph.mds.c:Stopped 2023-10-08T12:00:52.701 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-08T12:00:52.716 INFO:tasks.ceph.mds.b:Stopped 2023-10-08T12:00:52.717 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-08T12:00:52.747 INFO:tasks.ceph.mds.a:Started 2023-10-08T12:00:52.747 DEBUG:teuthology.parallel:result is None 2023-10-08T12:00:52.748 INFO:tasks.ceph.mds.c:Started 2023-10-08T12:00:52.748 DEBUG:teuthology.parallel:result is None 2023-10-08T12:00:52.759 INFO:tasks.ceph.mds.b:Started 2023-10-08T12:00:52.759 DEBUG:teuthology.parallel:result is None 2023-10-08T12:00:52.760 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-08T12:00:52.816 INFO:tasks.ceph.mds.a.smithi062.stdout:starting mds.a at 2023-10-08T12:00:52.816 INFO:tasks.ceph.mds.c.smithi062.stdout:starting mds.c at 2023-10-08T12:00:52.832 INFO:tasks.ceph.mds.b.smithi130.stdout:starting mds.b at 2023-10-08T12:00:52.883 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:52.883+0000 7f5cc514f640 1 -- 172.21.15.62:0/2764619054 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5cc00a0c90 msgr2=0x7f5cc0145fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:52.883 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:52.883+0000 7f5cc514f640 1 --2- 172.21.15.62:0/2764619054 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5cc00a0c90 0x7f5cc0145fc0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f5cc009e900 tx=0x7f5cb401c780 comp rx=0 tx=0).stop 2023-10-08T12:00:52.883 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:52.883+0000 7f5cc514f640 1 -- 172.21.15.62:0/2764619054 shutdown_connections 2023-10-08T12:00:52.883 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:52.883+0000 7f5cc514f640 1 --2- 172.21.15.62:0/2764619054 >> v2:172.21.15.130:3300/0 conn(0x7f5cc0065920 0x7f5cc0146500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:52.883 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:52.883+0000 7f5cc514f640 1 --2- 172.21.15.62:0/2764619054 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5cc00a0c90 0x7f5cc0145fc0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:52.883 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:52.883+0000 7f5cc514f640 1 -- 172.21.15.62:0/2764619054 >> 172.21.15.62:0/2764619054 conn(0x7f5cc00b7b10 msgr2=0x7f5cc00b7f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:52.883 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:52.883+0000 7f5cc514f640 1 -- 172.21.15.62:0/2764619054 shutdown_connections 2023-10-08T12:00:52.883 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:52.883+0000 7f5cc514f640 1 -- 172.21.15.62:0/2764619054 wait complete. 2023-10-08T12:00:52.886 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:52.883+0000 7f5cc514f640 1 Processor -- start 2023-10-08T12:00:52.886 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:52.883+0000 7f5cc514f640 1 -- start start 2023-10-08T12:00:52.886 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:52.883+0000 7f5cc514f640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5cc0065920 0x7f5cc01390b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:52.886 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:52.883+0000 7f5cc514f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5cc00a08b0 0x7f5cc00b94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:52.886 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:52.883+0000 7f5cc514f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5cc00a0c90 0x7f5cc00b9a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:52.886 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:52.883+0000 7f5cc514f640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc013b810 con 0x7f5cc00a0c90 2023-10-08T12:00:52.886 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:52.883+0000 7f5cc514f640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc013baf0 con 0x7f5cc00a08b0 2023-10-08T12:00:52.887 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:52.883+0000 7f5cc514f640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc013bdd0 con 0x7f5cc0065920 2023-10-08T12:00:52.887 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:52.883+0000 7f5cbf59e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5cc00a0c90 0x7f5cc00b9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:52.887 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:52.883+0000 7f5cbf59e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5cc00a0c90 0x7f5cc00b9a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49358/0 (socket says 172.21.15.62:49358) 2023-10-08T12:00:52.887 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:52.883+0000 7f5cbf59e640 1 -- 172.21.15.62:0/3369299427 learned_addr learned my addr 172.21.15.62:0/3369299427 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:52.887 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:52.883+0000 7f5cbe59c640 1 --2- 172.21.15.62:0/3369299427 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5cc00a08b0 0x7f5cc00b94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:52.887 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:52.883+0000 7f5cbed9d640 1 --2- 172.21.15.62:0/3369299427 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5cc0065920 0x7f5cc01390b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:52.887 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:52.883+0000 7f5cbf59e640 1 -- 172.21.15.62:0/3369299427 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5cc0065920 msgr2=0x7f5cc01390b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:52.887 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:52.883+0000 7f5cbf59e640 1 --2- 172.21.15.62:0/3369299427 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5cc0065920 0x7f5cc01390b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:52.887 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:52.883+0000 7f5cbf59e640 1 -- 172.21.15.62:0/3369299427 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5cc00a08b0 msgr2=0x7f5cc00b94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:52.887 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:52.883+0000 7f5cbf59e640 1 --2- 172.21.15.62:0/3369299427 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5cc00a08b0 0x7f5cc00b94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:52.887 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:52.883+0000 7f5cbf59e640 1 -- 172.21.15.62:0/3369299427 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cb4009560 con 0x7f5cc00a0c90 2023-10-08T12:00:52.887 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:52.883+0000 7f5cbf59e640 1 --2- 172.21.15.62:0/3369299427 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5cc00a0c90 0x7f5cc00b9a10 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f5cb800dac0 tx=0x7f5cb800df80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:52.888 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:52.883+0000 7f5ca77fe640 1 -- 172.21.15.62:0/3369299427 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb800be30 con 0x7f5cc00a0c90 2023-10-08T12:00:52.888 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:52.883+0000 7f5ca77fe640 1 -- 172.21.15.62:0/3369299427 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5cb8004c20 con 0x7f5cc00a0c90 2023-10-08T12:00:52.888 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:52.883+0000 7f5cc514f640 1 -- 172.21.15.62:0/3369299427 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cc013c0b0 con 0x7f5cc00a0c90 2023-10-08T12:00:52.888 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:52.883+0000 7f5ca77fe640 1 -- 172.21.15.62:0/3369299427 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb8003980 con 0x7f5cc00a0c90 2023-10-08T12:00:52.888 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:52.883+0000 7f5cc514f640 1 -- 172.21.15.62:0/3369299427 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cc00b9020 con 0x7f5cc00a0c90 2023-10-08T12:00:52.888 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:52.887+0000 7f5cc514f640 1 -- 172.21.15.62:0/3369299427 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cc00739e0 con 0x7f5cc00a0c90 2023-10-08T12:00:52.889 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:52.887+0000 7f5ca77fe640 1 -- 172.21.15.62:0/3369299427 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f5cb8003ae0 con 0x7f5cc00a0c90 2023-10-08T12:00:52.889 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:52.887+0000 7f5ca77fe640 1 --2- 172.21.15.62:0/3369299427 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f5cac0664a0 0x7f5cac068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:52.889 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:52.887+0000 7f5ca77fe640 1 -- 172.21.15.62:0/3369299427 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5cb8083fa0 con 0x7f5cc00a0c90 2023-10-08T12:00:52.889 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:52.887+0000 7f5cbed9d640 1 --2- 172.21.15.62:0/3369299427 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f5cac0664a0 0x7f5cac068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:52.889 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:52.887+0000 7f5cbed9d640 1 --2- 172.21.15.62:0/3369299427 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f5cac0664a0 0x7f5cac068960 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5cb0007fd0 tx=0x7f5cb0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:52.891 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:52.891+0000 7f5ca77fe640 1 -- 172.21.15.62:0/3369299427 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5cb80b5090 con 0x7f5cc00a0c90 2023-10-08T12:00:52.918 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-10-08T12:00:52.918 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-10-08T12:00:53.058 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:53.059+0000 7f5cc514f640 1 -- 172.21.15.62:0/3369299427 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f5cc013b950 con 0x7f5cc00a0c90 2023-10-08T12:00:53.673 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:53.671+0000 7f5ca77fe640 1 -- 172.21.15.62:0/3369299427 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v25) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5cc013b950 con 0x7f5cc00a0c90 2023-10-08T12:00:53.673 INFO:teuthology.orchestra.run.smithi062.stderr: removed all blocklist entries 2023-10-08T12:00:53.677 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:53.675+0000 7f5cc514f640 1 -- 172.21.15.62:0/3369299427 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f5cac0664a0 msgr2=0x7f5cac068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:53.677 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:53.675+0000 7f5cc514f640 1 --2- 172.21.15.62:0/3369299427 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f5cac0664a0 0x7f5cac068960 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5cb0007fd0 tx=0x7f5cb0009040 comp rx=0 tx=0).stop 2023-10-08T12:00:53.677 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:53.675+0000 7f5cc514f640 1 -- 172.21.15.62:0/3369299427 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5cc00a0c90 msgr2=0x7f5cc00b9a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:53.677 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:53.675+0000 7f5cc514f640 1 --2- 172.21.15.62:0/3369299427 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5cc00a0c90 0x7f5cc00b9a10 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f5cb800dac0 tx=0x7f5cb800df80 comp rx=0 tx=0).stop 2023-10-08T12:00:53.678 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:53.675+0000 7f5cc514f640 1 -- 172.21.15.62:0/3369299427 shutdown_connections 2023-10-08T12:00:53.678 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:53.675+0000 7f5cc514f640 1 --2- 172.21.15.62:0/3369299427 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f5cac0664a0 0x7f5cac068960 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:53.678 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:53.675+0000 7f5cc514f640 1 --2- 172.21.15.62:0/3369299427 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5cc00a0c90 0x7f5cc00b9a10 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:53.678 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:53.675+0000 7f5cc514f640 1 --2- 172.21.15.62:0/3369299427 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5cc00a08b0 0x7f5cc00b94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:53.678 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:53.675+0000 7f5cc514f640 1 --2- 172.21.15.62:0/3369299427 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5cc0065920 0x7f5cc01390b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:53.678 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:53.675+0000 7f5cc514f640 1 -- 172.21.15.62:0/3369299427 >> 172.21.15.62:0/3369299427 conn(0x7f5cc00b7b10 msgr2=0x7f5cc00b0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:53.678 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:53.675+0000 7f5cc514f640 1 -- 172.21.15.62:0/3369299427 shutdown_connections 2023-10-08T12:00:53.678 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:53.675+0000 7f5cc514f640 1 -- 172.21.15.62:0/3369299427 wait complete. 2023-10-08T12:00:53.701 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-08T12:00:53.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:53.831+0000 7f8632230640 1 -- 172.21.15.62:0/288950771 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f862c0b6a60 msgr2=0x7f862c14a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:53.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:53.831+0000 7f8632230640 1 --2- 172.21.15.62:0/288950771 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f862c0b6a60 0x7f862c14a250 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f862c0734e0 tx=0x7f862001c8a0 comp rx=0 tx=0).stop 2023-10-08T12:00:53.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:53.831+0000 7f8632230640 1 -- 172.21.15.62:0/288950771 shutdown_connections 2023-10-08T12:00:53.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:53.831+0000 7f8632230640 1 --2- 172.21.15.62:0/288950771 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f862c14a790 0x7f862c0b8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:53.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:53.831+0000 7f8632230640 1 --2- 172.21.15.62:0/288950771 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f862c0b6a60 0x7f862c14a250 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:53.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:53.831+0000 7f8632230640 1 --2- 172.21.15.62:0/288950771 >> v2:172.21.15.130:3300/0 conn(0x7f862c0718c0 0x7f862c0b5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:53.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:53.831+0000 7f8632230640 1 -- 172.21.15.62:0/288950771 >> 172.21.15.62:0/288950771 conn(0x7f862c09c520 msgr2=0x7f862c09c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:53.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:53.831+0000 7f8632230640 1 -- 172.21.15.62:0/288950771 shutdown_connections 2023-10-08T12:00:53.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:53.831+0000 7f8632230640 1 -- 172.21.15.62:0/288950771 wait complete. 2023-10-08T12:00:53.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:53.831+0000 7f8632230640 1 Processor -- start 2023-10-08T12:00:53.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:53.831+0000 7f8632230640 1 -- start start 2023-10-08T12:00:53.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:53.831+0000 7f8632230640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f862c0718c0 0x7f862c1498f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:53.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:53.831+0000 7f8632230640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f862c0b6a60 0x7f862c149e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:53.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:53.831+0000 7f8632230640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f862c14a790 0x7f862c097a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:53.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:53.831+0000 7f8632230640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f862c148ff0 con 0x7f862c0718c0 2023-10-08T12:00:53.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:53.831+0000 7f8632230640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f862c06eca0 con 0x7f862c0b6a60 2023-10-08T12:00:53.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:53.831+0000 7f8632230640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f862c1486c0 con 0x7f862c14a790 2023-10-08T12:00:53.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:53.831+0000 7f862b7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f862c0718c0 0x7f862c1498f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:53.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:53.831+0000 7f862b7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f862c0718c0 0x7f862c1498f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49378/0 (socket says 172.21.15.62:49378) 2023-10-08T12:00:53.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:53.831+0000 7f862b7fe640 1 -- 172.21.15.62:0/1903371303 learned_addr learned my addr 172.21.15.62:0/1903371303 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:53.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:53.831+0000 7f862bfff640 1 --2- 172.21.15.62:0/1903371303 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f862c14a790 0x7f862c097a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:53.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:53.831+0000 7f862affd640 1 --2- 172.21.15.62:0/1903371303 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f862c0b6a60 0x7f862c149e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:53.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:53.831+0000 7f862b7fe640 1 -- 172.21.15.62:0/1903371303 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f862c14a790 msgr2=0x7f862c097a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:53.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:53.831+0000 7f862b7fe640 1 --2- 172.21.15.62:0/1903371303 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f862c14a790 0x7f862c097a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:53.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:53.831+0000 7f862b7fe640 1 -- 172.21.15.62:0/1903371303 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f862c0b6a60 msgr2=0x7f862c149e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:53.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:53.831+0000 7f862b7fe640 1 --2- 172.21.15.62:0/1903371303 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f862c0b6a60 0x7f862c149e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:53.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:53.831+0000 7f862b7fe640 1 -- 172.21.15.62:0/1903371303 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8620009560 con 0x7f862c0718c0 2023-10-08T12:00:53.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:53.831+0000 7f862b7fe640 1 --2- 172.21.15.62:0/1903371303 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f862c0718c0 0x7f862c1498f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f861c00c9a0 tx=0x7f861c00ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:53.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:53.831+0000 7f8613fff640 1 -- 172.21.15.62:0/1903371303 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f861c007c10 con 0x7f862c0718c0 2023-10-08T12:00:53.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:53.831+0000 7f8613fff640 1 -- 172.21.15.62:0/1903371303 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f861c007e60 con 0x7f862c0718c0 2023-10-08T12:00:53.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:53.831+0000 7f8613fff640 1 -- 172.21.15.62:0/1903371303 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f861c005280 con 0x7f862c0718c0 2023-10-08T12:00:53.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:53.831+0000 7f8632230640 1 -- 172.21.15.62:0/1903371303 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f862c1489a0 con 0x7f862c0718c0 2023-10-08T12:00:53.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:53.831+0000 7f8632230640 1 -- 172.21.15.62:0/1903371303 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f862c09baa0 con 0x7f862c0718c0 2023-10-08T12:00:53.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:53.835+0000 7f8632230640 1 -- 172.21.15.62:0/1903371303 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f862c04da80 con 0x7f862c0718c0 2023-10-08T12:00:53.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:53.835+0000 7f8613fff640 1 -- 172.21.15.62:0/1903371303 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f861c0053e0 con 0x7f862c0718c0 2023-10-08T12:00:53.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:53.835+0000 7f8613fff640 1 --2- 172.21.15.62:0/1903371303 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f86180664a0 0x7f8618068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:53.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:53.835+0000 7f8613fff640 1 -- 172.21.15.62:0/1903371303 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f861c084160 con 0x7f862c0718c0 2023-10-08T12:00:53.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:53.835+0000 7f862affd640 1 --2- 172.21.15.62:0/1903371303 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f86180664a0 0x7f8618068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:53.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:53.835+0000 7f862affd640 1 --2- 172.21.15.62:0/1903371303 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f86180664a0 0x7f8618068960 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f86200af000 tx=0x7f862001b0e0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:53.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:53.839+0000 7f8613fff640 1 -- 172.21.15.62:0/1903371303 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f861c0553b0 con 0x7f862c0718c0 2023-10-08T12:00:54.051 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.051+0000 7f8632230640 1 -- 172.21.15.62:0/1903371303 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f862c09d260 con 0x7f862c0718c0 2023-10-08T12:00:54.053 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.051+0000 7f8613fff640 1 -- 172.21.15.62:0/1903371303 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v8) v1 ==== 80+0+5491 (secure 0 0 0) 0x7f861c01d090 con 0x7f862c0718c0 2023-10-08T12:00:54.054 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T12:00:54.054 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2023-10-08T12:00:54.054 INFO:teuthology.orchestra.run.smithi062.stdout: "auth_dump": [ 2023-10-08T12:00:54.054 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-10-08T12:00:54.054 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "mds.a", 2023-10-08T12:00:54.054 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQCYmSJlV1m0IhAAit8j5cckFTGj5Ck9pkgdow==", 2023-10-08T12:00:54.054 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-10-08T12:00:54.054 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2023-10-08T12:00:54.054 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2023-10-08T12:00:54.054 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2023-10-08T12:00:54.055 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2023-10-08T12:00:54.055 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-10-08T12:00:54.055 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-10-08T12:00:54.055 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-10-08T12:00:54.055 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "mds.b", 2023-10-08T12:00:54.055 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQCYmSJlYOBtMRAAWfADuNr0+eolLmNKB9xNpQ==", 2023-10-08T12:00:54.055 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-10-08T12:00:54.055 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2023-10-08T12:00:54.055 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2023-10-08T12:00:54.055 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2023-10-08T12:00:54.055 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2023-10-08T12:00:54.055 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-10-08T12:00:54.055 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-10-08T12:00:54.056 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-10-08T12:00:54.056 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "mds.c", 2023-10-08T12:00:54.056 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQCYmSJlZ7BXKxAACUYVyd3CDiAodvuJf8/TKg==", 2023-10-08T12:00:54.056 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-10-08T12:00:54.056 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2023-10-08T12:00:54.056 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2023-10-08T12:00:54.056 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2023-10-08T12:00:54.056 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2023-10-08T12:00:54.056 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-10-08T12:00:54.056 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-10-08T12:00:54.056 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-10-08T12:00:54.056 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.0", 2023-10-08T12:00:54.057 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQCbmSJlybBIMhAACXbg4KPq75PvktnaGq1hQQ==", 2023-10-08T12:00:54.057 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-10-08T12:00:54.057 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow profile osd", 2023-10-08T12:00:54.057 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile osd", 2023-10-08T12:00:54.057 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2023-10-08T12:00:54.057 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-10-08T12:00:54.057 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-10-08T12:00:54.057 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-10-08T12:00:54.057 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.1", 2023-10-08T12:00:54.057 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQCfmSJlbaoJABAA3XGl48fcJJo1ItCgJhTQ8g==", 2023-10-08T12:00:54.057 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-10-08T12:00:54.057 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow profile osd", 2023-10-08T12:00:54.057 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile osd", 2023-10-08T12:00:54.058 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2023-10-08T12:00:54.058 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-10-08T12:00:54.058 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-10-08T12:00:54.058 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-10-08T12:00:54.058 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.2", 2023-10-08T12:00:54.058 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQCimSJlIWRSCRAAZu4ha3rV+cUfFl9c8W+lLA==", 2023-10-08T12:00:54.058 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-10-08T12:00:54.058 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow profile osd", 2023-10-08T12:00:54.058 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile osd", 2023-10-08T12:00:54.058 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2023-10-08T12:00:54.058 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-10-08T12:00:54.058 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-10-08T12:00:54.059 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-10-08T12:00:54.059 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.3", 2023-10-08T12:00:54.059 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQClmSJlH1pgEhAAMSvbx7GwyT05uRpuQTabUA==", 2023-10-08T12:00:54.059 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-10-08T12:00:54.059 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow profile osd", 2023-10-08T12:00:54.059 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile osd", 2023-10-08T12:00:54.059 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2023-10-08T12:00:54.059 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-10-08T12:00:54.059 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-10-08T12:00:54.059 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-10-08T12:00:54.059 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.4", 2023-10-08T12:00:54.059 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQCrmSJlgUuZExAAQV7ijxzeMNZPD5gv3GnMeg==", 2023-10-08T12:00:54.059 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-10-08T12:00:54.060 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow profile osd", 2023-10-08T12:00:54.060 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile osd", 2023-10-08T12:00:54.060 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2023-10-08T12:00:54.060 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-10-08T12:00:54.060 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-10-08T12:00:54.060 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-10-08T12:00:54.060 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.5", 2023-10-08T12:00:54.060 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQCumSJlvlUjGhAA2ZSKh9+qHnSVYMqrjMgpqQ==", 2023-10-08T12:00:54.060 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-10-08T12:00:54.060 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow profile osd", 2023-10-08T12:00:54.060 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile osd", 2023-10-08T12:00:54.060 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2023-10-08T12:00:54.061 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-10-08T12:00:54.061 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-10-08T12:00:54.061 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-10-08T12:00:54.061 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.6", 2023-10-08T12:00:54.061 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQCxmSJl3YWJIxAAddhU34JikV7hryh98pmbEg==", 2023-10-08T12:00:54.061 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-10-08T12:00:54.061 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow profile osd", 2023-10-08T12:00:54.061 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile osd", 2023-10-08T12:00:54.061 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2023-10-08T12:00:54.061 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-10-08T12:00:54.061 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-10-08T12:00:54.061 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-10-08T12:00:54.061 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.7", 2023-10-08T12:00:54.062 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQC0mSJlHnrNKhAAOvh0v9xMi33fb/ryK+8/3w==", 2023-10-08T12:00:54.062 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-10-08T12:00:54.062 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow profile osd", 2023-10-08T12:00:54.062 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile osd", 2023-10-08T12:00:54.062 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2023-10-08T12:00:54.062 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-10-08T12:00:54.062 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-10-08T12:00:54.062 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-10-08T12:00:54.062 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.0", 2023-10-08T12:00:54.062 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQCYmSJlBqVKNRAAty1+t99MyOB+ME+wqN8uCA==", 2023-10-08T12:00:54.062 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-10-08T12:00:54.062 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2023-10-08T12:00:54.063 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow r", 2023-10-08T12:00:54.063 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow rw", 2023-10-08T12:00:54.063 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow rwx" 2023-10-08T12:00:54.063 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-10-08T12:00:54.063 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-10-08T12:00:54.063 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-10-08T12:00:54.063 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.admin", 2023-10-08T12:00:54.063 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQCYmSJlZGuKBRAAwp6lQTFcdd0ZaqeY7H1U5A==", 2023-10-08T12:00:54.063 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-10-08T12:00:54.063 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow *", 2023-10-08T12:00:54.063 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2023-10-08T12:00:54.063 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2023-10-08T12:00:54.063 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2023-10-08T12:00:54.064 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-10-08T12:00:54.064 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-10-08T12:00:54.064 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-10-08T12:00:54.064 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.bootstrap-mds", 2023-10-08T12:00:54.064 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQC6mSJlxmtyHhAAxiiPatFo+Hgq2Cnyfsyz/A==", 2023-10-08T12:00:54.064 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-10-08T12:00:54.064 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile bootstrap-mds" 2023-10-08T12:00:54.064 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-10-08T12:00:54.064 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-10-08T12:00:54.064 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-10-08T12:00:54.064 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.bootstrap-mgr", 2023-10-08T12:00:54.064 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQC6mSJlxXRyHhAAqv6N2LbylUozrKvxlBnGaQ==", 2023-10-08T12:00:54.064 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-10-08T12:00:54.065 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile bootstrap-mgr" 2023-10-08T12:00:54.065 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-10-08T12:00:54.065 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-10-08T12:00:54.065 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-10-08T12:00:54.065 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.bootstrap-osd", 2023-10-08T12:00:54.065 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQC6mSJlqXxyHhAA/AuzpVDEyG1XQC/7wixqWw==", 2023-10-08T12:00:54.065 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-10-08T12:00:54.065 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile bootstrap-osd" 2023-10-08T12:00:54.065 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-10-08T12:00:54.065 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-10-08T12:00:54.065 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-10-08T12:00:54.065 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.bootstrap-rbd", 2023-10-08T12:00:54.066 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQC6mSJlW4RyHhAAuy4ZhQ0OlygxeRKbkRtXyA==", 2023-10-08T12:00:54.066 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-10-08T12:00:54.066 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile bootstrap-rbd" 2023-10-08T12:00:54.066 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-10-08T12:00:54.066 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-10-08T12:00:54.066 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-10-08T12:00:54.066 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-10-08T12:00:54.066 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQC6mSJlRIxyHhAArR6Nj+8oYafc6OpTaj8s7A==", 2023-10-08T12:00:54.066 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-10-08T12:00:54.066 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-10-08T12:00:54.066 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-10-08T12:00:54.066 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-10-08T12:00:54.066 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-10-08T12:00:54.067 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.bootstrap-rgw", 2023-10-08T12:00:54.067 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQC6mSJl0JRyHhAAzOCMLq1ZfSdTv8g73LxOvg==", 2023-10-08T12:00:54.067 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-10-08T12:00:54.067 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile bootstrap-rgw" 2023-10-08T12:00:54.067 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-10-08T12:00:54.067 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-10-08T12:00:54.067 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-10-08T12:00:54.067 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "mgr.x", 2023-10-08T12:00:54.067 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQCYmSJl1nIwHxAA6/TWuNto52pYRuPXCrO72Q==", 2023-10-08T12:00:54.067 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-10-08T12:00:54.067 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow *", 2023-10-08T12:00:54.067 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile mgr", 2023-10-08T12:00:54.067 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2023-10-08T12:00:54.068 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-10-08T12:00:54.068 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-10-08T12:00:54.068 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-10-08T12:00:54.068 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "mgr.y", 2023-10-08T12:00:54.068 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQCYmSJl0HKDHBAArxllDY8oWIw4v3wCk216Tw==", 2023-10-08T12:00:54.068 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-10-08T12:00:54.068 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow *", 2023-10-08T12:00:54.068 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile mgr", 2023-10-08T12:00:54.068 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2023-10-08T12:00:54.068 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-10-08T12:00:54.068 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-10-08T12:00:54.068 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2023-10-08T12:00:54.068 INFO:teuthology.orchestra.run.smithi062.stdout:} 2023-10-08T12:00:54.069 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.055+0000 7f8632230640 1 -- 172.21.15.62:0/1903371303 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f86180664a0 msgr2=0x7f8618068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:54.069 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.055+0000 7f8632230640 1 --2- 172.21.15.62:0/1903371303 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f86180664a0 0x7f8618068960 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f86200af000 tx=0x7f862001b0e0 comp rx=0 tx=0).stop 2023-10-08T12:00:54.069 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.055+0000 7f8632230640 1 -- 172.21.15.62:0/1903371303 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f862c0718c0 msgr2=0x7f862c1498f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:54.069 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.055+0000 7f8632230640 1 --2- 172.21.15.62:0/1903371303 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f862c0718c0 0x7f862c1498f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f861c00c9a0 tx=0x7f861c00ce60 comp rx=0 tx=0).stop 2023-10-08T12:00:54.070 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.055+0000 7f8632230640 1 -- 172.21.15.62:0/1903371303 shutdown_connections 2023-10-08T12:00:54.070 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.055+0000 7f8632230640 1 --2- 172.21.15.62:0/1903371303 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f86180664a0 0x7f8618068960 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:54.070 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.055+0000 7f8632230640 1 --2- 172.21.15.62:0/1903371303 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f862c14a790 0x7f862c097a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:54.070 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.055+0000 7f8632230640 1 --2- 172.21.15.62:0/1903371303 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f862c0b6a60 0x7f862c149e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:54.070 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.055+0000 7f8632230640 1 --2- 172.21.15.62:0/1903371303 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f862c0718c0 0x7f862c1498f0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:54.070 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.055+0000 7f8632230640 1 -- 172.21.15.62:0/1903371303 >> 172.21.15.62:0/1903371303 conn(0x7f862c09c520 msgr2=0x7f862c141c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:54.070 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.055+0000 7f8632230640 1 -- 172.21.15.62:0/1903371303 shutdown_connections 2023-10-08T12:00:54.070 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.055+0000 7f8632230640 1 -- 172.21.15.62:0/1903371303 wait complete. 2023-10-08T12:00:54.071 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-10-08T12:00:54.203 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.203+0000 7f7d24223640 1 -- 172.21.15.62:0/3641845900 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7d1c06c0c0 msgr2=0x7f7d1c150570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:54.203 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.203+0000 7f7d24223640 1 --2- 172.21.15.62:0/3641845900 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7d1c06c0c0 0x7f7d1c150570 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c0bb550 tx=0x7f7d1401c860 comp rx=0 tx=0).stop 2023-10-08T12:00:54.203 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.203+0000 7f7d24223640 1 -- 172.21.15.62:0/3641845900 shutdown_connections 2023-10-08T12:00:54.204 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.203+0000 7f7d24223640 1 --2- 172.21.15.62:0/3641845900 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7d1c06c0c0 0x7f7d1c150570 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:54.204 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.203+0000 7f7d24223640 1 --2- 172.21.15.62:0/3641845900 >> v2:172.21.15.130:3300/0 conn(0x7f7d1c0b7b50 0x7f7d1c0b68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:54.204 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.203+0000 7f7d24223640 1 -- 172.21.15.62:0/3641845900 >> 172.21.15.62:0/3641845900 conn(0x7f7d1c0b82f0 msgr2=0x7f7d1c0b8700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:54.204 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.203+0000 7f7d24223640 1 -- 172.21.15.62:0/3641845900 shutdown_connections 2023-10-08T12:00:54.204 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.203+0000 7f7d24223640 1 -- 172.21.15.62:0/3641845900 wait complete. 2023-10-08T12:00:54.206 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.203+0000 7f7d24223640 1 Processor -- start 2023-10-08T12:00:54.206 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.203+0000 7f7d24223640 1 -- start start 2023-10-08T12:00:54.206 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.203+0000 7f7d24223640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7d1c06c0c0 0x7f7d1c13f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:54.207 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.203+0000 7f7d24223640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7d1c0b6e30 0x7f7d1c0b1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:54.207 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.203+0000 7f7d24223640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d1c0b7b50 0x7f7d1c13ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:54.207 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.203+0000 7f7d24223640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d1c140de0 con 0x7f7d1c06c0c0 2023-10-08T12:00:54.207 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.203+0000 7f7d24223640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d1c0b2290 con 0x7f7d1c0b7b50 2023-10-08T12:00:54.207 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.203+0000 7f7d24223640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d1c13d880 con 0x7f7d1c0b6e30 2023-10-08T12:00:54.207 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.203+0000 7f7d21fbf640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7d1c06c0c0 0x7f7d1c13f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:54.207 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.203+0000 7f7d21fbf640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7d1c06c0c0 0x7f7d1c13f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49398/0 (socket says 172.21.15.62:49398) 2023-10-08T12:00:54.207 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.203+0000 7f7d21fbf640 1 -- 172.21.15.62:0/2979300264 learned_addr learned my addr 172.21.15.62:0/2979300264 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:54.207 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.203+0000 7f7d227c0640 1 --2- 172.21.15.62:0/2979300264 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d1c0b7b50 0x7f7d1c13ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:54.207 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.203+0000 7f7d217be640 1 --2- 172.21.15.62:0/2979300264 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7d1c0b6e30 0x7f7d1c0b1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:54.207 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.203+0000 7f7d21fbf640 1 -- 172.21.15.62:0/2979300264 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7d1c0b6e30 msgr2=0x7f7d1c0b1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:54.207 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.203+0000 7f7d21fbf640 1 --2- 172.21.15.62:0/2979300264 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7d1c0b6e30 0x7f7d1c0b1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:54.208 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.203+0000 7f7d21fbf640 1 -- 172.21.15.62:0/2979300264 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d1c0b7b50 msgr2=0x7f7d1c13ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:54.208 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.203+0000 7f7d21fbf640 1 --2- 172.21.15.62:0/2979300264 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d1c0b7b50 0x7f7d1c13ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:54.208 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.203+0000 7f7d21fbf640 1 -- 172.21.15.62:0/2979300264 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d14009560 con 0x7f7d1c06c0c0 2023-10-08T12:00:54.208 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.203+0000 7f7d227c0640 1 --2- 172.21.15.62:0/2979300264 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d1c0b7b50 0x7f7d1c13ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:00:54.208 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.207+0000 7f7d21fbf640 1 --2- 172.21.15.62:0/2979300264 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7d1c06c0c0 0x7f7d1c13f420 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c00ca20 tx=0x7f7d0c00cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:54.208 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.207+0000 7f7d1a7fc640 1 -- 172.21.15.62:0/2979300264 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0c007c70 con 0x7f7d1c06c0c0 2023-10-08T12:00:54.208 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.207+0000 7f7d1a7fc640 1 -- 172.21.15.62:0/2979300264 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7d0c00f450 con 0x7f7d1c06c0c0 2023-10-08T12:00:54.208 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.207+0000 7f7d24223640 1 -- 172.21.15.62:0/2979300264 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d1c13e480 con 0x7f7d1c06c0c0 2023-10-08T12:00:54.208 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.207+0000 7f7d1a7fc640 1 -- 172.21.15.62:0/2979300264 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0c00f860 con 0x7f7d1c06c0c0 2023-10-08T12:00:54.208 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.207+0000 7f7d24223640 1 -- 172.21.15.62:0/2979300264 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d1c142510 con 0x7f7d1c06c0c0 2023-10-08T12:00:54.208 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.207+0000 7f7d24223640 1 -- 172.21.15.62:0/2979300264 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d1c04da80 con 0x7f7d1c06c0c0 2023-10-08T12:00:54.209 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.207+0000 7f7d1a7fc640 1 -- 172.21.15.62:0/2979300264 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7d0c00f9c0 con 0x7f7d1c06c0c0 2023-10-08T12:00:54.209 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.207+0000 7f7d1a7fc640 1 --2- 172.21.15.62:0/2979300264 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f7d08066470 0x7f7d08068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:54.209 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.207+0000 7f7d1a7fc640 1 -- 172.21.15.62:0/2979300264 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7d0c084320 con 0x7f7d1c06c0c0 2023-10-08T12:00:54.209 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.207+0000 7f7d217be640 1 --2- 172.21.15.62:0/2979300264 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f7d08066470 0x7f7d08068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:54.210 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.207+0000 7f7d217be640 1 --2- 172.21.15.62:0/2979300264 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f7d08066470 0x7f7d08068930 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c1e12e0 tx=0x7f7d10009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:54.212 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.211+0000 7f7d1a7fc640 1 -- 172.21.15.62:0/2979300264 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7d0c051b80 con 0x7f7d1c06c0c0 2023-10-08T12:00:54.424 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.423+0000 7f7d24223640 1 -- 172.21.15.62:0/2979300264 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f7d1c06b690 con 0x7f7d1c06c0c0 2023-10-08T12:00:54.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.427+0000 7f7d1a7fc640 1 -- 172.21.15.62:0/2979300264 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f7d0c0551a0 con 0x7f7d1c06c0c0 2023-10-08T12:00:54.431 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.431+0000 7f7d24223640 1 -- 172.21.15.62:0/2979300264 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f7d08066470 msgr2=0x7f7d08068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:54.431 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.431+0000 7f7d24223640 1 --2- 172.21.15.62:0/2979300264 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f7d08066470 0x7f7d08068930 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c1e12e0 tx=0x7f7d10009040 comp rx=0 tx=0).stop 2023-10-08T12:00:54.431 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.431+0000 7f7d24223640 1 -- 172.21.15.62:0/2979300264 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7d1c06c0c0 msgr2=0x7f7d1c13f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:54.431 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.431+0000 7f7d24223640 1 --2- 172.21.15.62:0/2979300264 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7d1c06c0c0 0x7f7d1c13f420 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c00ca20 tx=0x7f7d0c00cee0 comp rx=0 tx=0).stop 2023-10-08T12:00:54.431 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.431+0000 7f7d24223640 1 -- 172.21.15.62:0/2979300264 shutdown_connections 2023-10-08T12:00:54.431 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.431+0000 7f7d24223640 1 --2- 172.21.15.62:0/2979300264 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f7d08066470 0x7f7d08068930 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:54.431 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.431+0000 7f7d24223640 1 --2- 172.21.15.62:0/2979300264 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7d1c0b6e30 0x7f7d1c0b1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:54.431 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.431+0000 7f7d24223640 1 --2- 172.21.15.62:0/2979300264 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d1c0b7b50 0x7f7d1c13ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:54.432 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.431+0000 7f7d24223640 1 --2- 172.21.15.62:0/2979300264 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7d1c06c0c0 0x7f7d1c13f420 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:54.432 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.431+0000 7f7d24223640 1 -- 172.21.15.62:0/2979300264 >> 172.21.15.62:0/2979300264 conn(0x7f7d1c0b82f0 msgr2=0x7f7d1c0b86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:54.432 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.431+0000 7f7d24223640 1 -- 172.21.15.62:0/2979300264 shutdown_connections 2023-10-08T12:00:54.432 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.431+0000 7f7d24223640 1 -- 172.21.15.62:0/2979300264 wait complete. 2023-10-08T12:00:54.449 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-10-08T12:00:54.574 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.575+0000 7f603d8e9640 1 -- 172.21.15.62:0/3619910985 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6038071410 msgr2=0x7f60380b6ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:54.574 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.575+0000 7f603d8e9640 1 --2- 172.21.15.62:0/3619910985 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6038071410 0x7f60380b6ad0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f6030009c80 tx=0x7f603001cd40 comp rx=0 tx=0).stop 2023-10-08T12:00:54.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.575+0000 7f603d8e9640 1 -- 172.21.15.62:0/3619910985 shutdown_connections 2023-10-08T12:00:54.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.575+0000 7f603d8e9640 1 --2- 172.21.15.62:0/3619910985 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6038071410 0x7f60380b6ad0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:54.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.575+0000 7f603d8e9640 1 --2- 172.21.15.62:0/3619910985 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f60380b9260 0x7f60380b8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:54.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.575+0000 7f603d8e9640 1 -- 172.21.15.62:0/3619910985 >> 172.21.15.62:0/3619910985 conn(0x7f603809c520 msgr2=0x7f603809c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:54.576 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.575+0000 7f603d8e9640 1 -- 172.21.15.62:0/3619910985 shutdown_connections 2023-10-08T12:00:54.576 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.575+0000 7f603d8e9640 1 -- 172.21.15.62:0/3619910985 wait complete. 2023-10-08T12:00:54.580 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.575+0000 7f603d8e9640 1 Processor -- start 2023-10-08T12:00:54.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.575+0000 7f603d8e9640 1 -- start start 2023-10-08T12:00:54.586 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.575+0000 7f603d8e9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6038071410 0x7f60380b2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:54.586 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.575+0000 7f603d8e9640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f60380b9260 0x7f60380afd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:54.586 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.575+0000 7f603d8e9640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6038147920 0x7f60380b0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:54.586 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.575+0000 7f603d8e9640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60380b2680 con 0x7f6038071410 2023-10-08T12:00:54.586 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.575+0000 7f603d8e9640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60380af8c0 con 0x7f60380b9260 2023-10-08T12:00:54.587 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.575+0000 7f603d8e9640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60380b3070 con 0x7f6038147920 2023-10-08T12:00:54.587 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.575+0000 7f6036ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6038071410 0x7f60380b2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:54.587 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.575+0000 7f6036ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6038071410 0x7f60380b2960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49416/0 (socket says 172.21.15.62:49416) 2023-10-08T12:00:54.587 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.575+0000 7f6036ffd640 1 -- 172.21.15.62:0/3445923478 learned_addr learned my addr 172.21.15.62:0/3445923478 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:54.587 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.575+0000 7f60377fe640 1 --2- 172.21.15.62:0/3445923478 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6038147920 0x7f60380b0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:54.587 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.575+0000 7f60367fc640 1 --2- 172.21.15.62:0/3445923478 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f60380b9260 0x7f60380afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:54.587 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.575+0000 7f6036ffd640 1 -- 172.21.15.62:0/3445923478 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6038147920 msgr2=0x7f60380b0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:54.588 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.575+0000 7f6036ffd640 1 --2- 172.21.15.62:0/3445923478 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6038147920 0x7f60380b0290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:54.588 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.575+0000 7f6036ffd640 1 -- 172.21.15.62:0/3445923478 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f60380b9260 msgr2=0x7f60380afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:54.588 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.575+0000 7f6036ffd640 1 --2- 172.21.15.62:0/3445923478 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f60380b9260 0x7f60380afd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:54.588 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.575+0000 7f6036ffd640 1 -- 172.21.15.62:0/3445923478 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60300098e0 con 0x7f6038071410 2023-10-08T12:00:54.588 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.575+0000 7f60367fc640 1 --2- 172.21.15.62:0/3445923478 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f60380b9260 0x7f60380afd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:00:54.588 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.575+0000 7f6036ffd640 1 --2- 172.21.15.62:0/3445923478 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6038071410 0x7f60380b2960 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f602800c9a0 tx=0x7f602800ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:54.588 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.575+0000 7f601ffff640 1 -- 172.21.15.62:0/3445923478 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6028007b50 con 0x7f6038071410 2023-10-08T12:00:54.588 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.575+0000 7f601ffff640 1 -- 172.21.15.62:0/3445923478 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6028007dc0 con 0x7f6038071410 2023-10-08T12:00:54.588 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.575+0000 7f603d8e9640 1 -- 172.21.15.62:0/3445923478 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60380b2120 con 0x7f6038071410 2023-10-08T12:00:54.588 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.575+0000 7f601ffff640 1 -- 172.21.15.62:0/3445923478 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6028005280 con 0x7f6038071410 2023-10-08T12:00:54.589 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.575+0000 7f603d8e9640 1 -- 172.21.15.62:0/3445923478 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60380b1320 con 0x7f6038071410 2023-10-08T12:00:54.589 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.575+0000 7f603d8e9640 1 -- 172.21.15.62:0/3445923478 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60380b5be0 con 0x7f6038071410 2023-10-08T12:00:54.589 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.579+0000 7f601ffff640 1 -- 172.21.15.62:0/3445923478 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f60280053e0 con 0x7f6038071410 2023-10-08T12:00:54.589 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.579+0000 7f601ffff640 1 --2- 172.21.15.62:0/3445923478 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f60240664c0 0x7f6024068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:54.589 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.579+0000 7f601ffff640 1 -- 172.21.15.62:0/3445923478 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6028083fb0 con 0x7f6038071410 2023-10-08T12:00:54.589 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.579+0000 7f60367fc640 1 --2- 172.21.15.62:0/3445923478 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f60240664c0 0x7f6024068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:54.589 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.579+0000 7f60367fc640 1 --2- 172.21.15.62:0/3445923478 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f60240664c0 0x7f6024068980 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f603806b1e0 tx=0x7f602c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:54.590 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.583+0000 7f601ffff640 1 -- 172.21.15.62:0/3445923478 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f60280518f0 con 0x7f6038071410 2023-10-08T12:00:54.798 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.799+0000 7f603d8e9640 1 -- 172.21.15.62:0/3445923478 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f603804da80 con 0x7f6038071410 2023-10-08T12:00:54.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.803+0000 7f601ffff640 1 -- 172.21.15.62:0/3445923478 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f602801d020 con 0x7f6038071410 2023-10-08T12:00:54.805 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.803+0000 7f603d8e9640 1 -- 172.21.15.62:0/3445923478 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f60240664c0 msgr2=0x7f6024068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:54.805 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.803+0000 7f603d8e9640 1 --2- 172.21.15.62:0/3445923478 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f60240664c0 0x7f6024068980 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f603806b1e0 tx=0x7f602c008040 comp rx=0 tx=0).stop 2023-10-08T12:00:54.805 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.803+0000 7f603d8e9640 1 -- 172.21.15.62:0/3445923478 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6038071410 msgr2=0x7f60380b2960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:54.805 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.803+0000 7f603d8e9640 1 --2- 172.21.15.62:0/3445923478 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6038071410 0x7f60380b2960 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f602800c9a0 tx=0x7f602800ce60 comp rx=0 tx=0).stop 2023-10-08T12:00:54.805 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.803+0000 7f603d8e9640 1 -- 172.21.15.62:0/3445923478 shutdown_connections 2023-10-08T12:00:54.805 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.803+0000 7f603d8e9640 1 --2- 172.21.15.62:0/3445923478 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f60240664c0 0x7f6024068980 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:54.805 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.803+0000 7f603d8e9640 1 --2- 172.21.15.62:0/3445923478 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6038147920 0x7f60380b0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:54.806 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.803+0000 7f603d8e9640 1 --2- 172.21.15.62:0/3445923478 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f60380b9260 0x7f60380afd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:54.806 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.803+0000 7f603d8e9640 1 --2- 172.21.15.62:0/3445923478 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6038071410 0x7f60380b2960 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:54.806 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.803+0000 7f603d8e9640 1 -- 172.21.15.62:0/3445923478 >> 172.21.15.62:0/3445923478 conn(0x7f603809c520 msgr2=0x7f6038098bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:54.806 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.803+0000 7f603d8e9640 1 -- 172.21.15.62:0/3445923478 shutdown_connections 2023-10-08T12:00:54.806 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.803+0000 7f603d8e9640 1 -- 172.21.15.62:0/3445923478 wait complete. 2023-10-08T12:00:54.821 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-10-08T12:00:54.941 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.939+0000 7fd0e1de9640 1 -- 172.21.15.62:0/1856157123 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd0dc14b0b0 msgr2=0x7fd0dc151e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:54.941 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.939+0000 7fd0e1de9640 1 --2- 172.21.15.62:0/1856157123 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd0dc14b0b0 0x7fd0dc151e00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd0d4009bc0 tx=0x7fd0d401cac0 comp rx=0 tx=0).stop 2023-10-08T12:00:54.941 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.939+0000 7fd0e1de9640 1 -- 172.21.15.62:0/1856157123 shutdown_connections 2023-10-08T12:00:54.941 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.939+0000 7fd0e1de9640 1 --2- 172.21.15.62:0/1856157123 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd0dc14b0b0 0x7fd0dc151e00 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:54.942 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.939+0000 7fd0e1de9640 1 --2- 172.21.15.62:0/1856157123 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd0dc0b8f10 0x7fd0dc0bc440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:54.942 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.939+0000 7fd0e1de9640 1 -- 172.21.15.62:0/1856157123 >> 172.21.15.62:0/1856157123 conn(0x7fd0dc09e910 msgr2=0x7fd0dc09ed20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:54.942 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.939+0000 7fd0e1de9640 1 -- 172.21.15.62:0/1856157123 shutdown_connections 2023-10-08T12:00:54.942 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.939+0000 7fd0e1de9640 1 -- 172.21.15.62:0/1856157123 wait complete. 2023-10-08T12:00:54.944 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.943+0000 7fd0e1de9640 1 Processor -- start 2023-10-08T12:00:54.944 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.943+0000 7fd0e1de9640 1 -- start start 2023-10-08T12:00:54.944 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.943+0000 7fd0e1de9640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd0dc06cbd0 0x7fd0dc143410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:54.944 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.943+0000 7fd0e1de9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd0dc0b8f10 0x7fd0dc0b2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:54.944 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.943+0000 7fd0e1de9640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd0dc14b0b0 0x7fd0dc1e5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:54.945 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.943+0000 7fd0e1de9640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0dc0b34d0 con 0x7fd0dc0b8f10 2023-10-08T12:00:54.945 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.943+0000 7fd0e1de9640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0dc143950 con 0x7fd0dc06cbd0 2023-10-08T12:00:54.945 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.943+0000 7fd0e1de9640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0dc145c50 con 0x7fd0dc14b0b0 2023-10-08T12:00:54.945 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.943+0000 7fd0daffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd0dc0b8f10 0x7fd0dc0b2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:54.945 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.943+0000 7fd0daffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd0dc0b8f10 0x7fd0dc0b2cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49426/0 (socket says 172.21.15.62:49426) 2023-10-08T12:00:54.945 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.943+0000 7fd0daffd640 1 -- 172.21.15.62:0/31940720 learned_addr learned my addr 172.21.15.62:0/31940720 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:54.945 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.943+0000 7fd0db7fe640 1 --2- 172.21.15.62:0/31940720 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd0dc06cbd0 0x7fd0dc143410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:54.945 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.943+0000 7fd0dbfff640 1 --2- 172.21.15.62:0/31940720 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd0dc14b0b0 0x7fd0dc1e5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:54.945 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.943+0000 7fd0daffd640 1 -- 172.21.15.62:0/31940720 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd0dc14b0b0 msgr2=0x7fd0dc1e5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:54.945 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.943+0000 7fd0daffd640 1 --2- 172.21.15.62:0/31940720 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd0dc14b0b0 0x7fd0dc1e5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:54.946 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.943+0000 7fd0daffd640 1 -- 172.21.15.62:0/31940720 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd0dc06cbd0 msgr2=0x7fd0dc143410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:54.946 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.943+0000 7fd0daffd640 1 --2- 172.21.15.62:0/31940720 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd0dc06cbd0 0x7fd0dc143410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:54.946 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.943+0000 7fd0daffd640 1 -- 172.21.15.62:0/31940720 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0d4009820 con 0x7fd0dc0b8f10 2023-10-08T12:00:54.946 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.943+0000 7fd0daffd640 1 --2- 172.21.15.62:0/31940720 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd0dc0b8f10 0x7fd0dc0b2cb0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd0d000c430 tx=0x7fd0d000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:54.946 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.943+0000 7fd0c3fff640 1 -- 172.21.15.62:0/31940720 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d0011790 con 0x7fd0dc0b8f10 2023-10-08T12:00:54.946 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.943+0000 7fd0c3fff640 1 -- 172.21.15.62:0/31940720 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd0d0011a00 con 0x7fd0dc0b8f10 2023-10-08T12:00:54.946 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.943+0000 7fd0e1de9640 1 -- 172.21.15.62:0/31940720 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0dc144d00 con 0x7fd0dc0b8f10 2023-10-08T12:00:54.946 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.943+0000 7fd0c3fff640 1 -- 172.21.15.62:0/31940720 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d0011e10 con 0x7fd0dc0b8f10 2023-10-08T12:00:54.946 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.943+0000 7fd0e1de9640 1 -- 172.21.15.62:0/31940720 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0dc1458e0 con 0x7fd0dc0b8f10 2023-10-08T12:00:54.946 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.943+0000 7fd0e1de9640 1 -- 172.21.15.62:0/31940720 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0dc066a30 con 0x7fd0dc0b8f10 2023-10-08T12:00:54.947 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.943+0000 7fd0c3fff640 1 -- 172.21.15.62:0/31940720 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd0d001c460 con 0x7fd0dc0b8f10 2023-10-08T12:00:54.947 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.943+0000 7fd0c3fff640 1 --2- 172.21.15.62:0/31940720 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fd0c80664a0 0x7fd0c8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:54.947 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.943+0000 7fd0c3fff640 1 -- 172.21.15.62:0/31940720 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd0d0083cf0 con 0x7fd0dc0b8f10 2023-10-08T12:00:54.948 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.947+0000 7fd0db7fe640 1 --2- 172.21.15.62:0/31940720 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fd0c80664a0 0x7fd0c8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:54.948 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.947+0000 7fd0db7fe640 1 --2- 172.21.15.62:0/31940720 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fd0c80664a0 0x7fd0c8068960 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc009b70 tx=0x7fd0cc0091e0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:54.949 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:54.947+0000 7fd0c3fff640 1 -- 172.21.15.62:0/31940720 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd0d0088070 con 0x7fd0dc0b8f10 2023-10-08T12:00:55.161 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.159+0000 7fd0e1de9640 1 -- 172.21.15.62:0/31940720 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fd0dc04da80 con 0x7fd0dc0b8f10 2023-10-08T12:00:55.165 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.167+0000 7fd0c3fff640 1 -- 172.21.15.62:0/31940720 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v11) v1 ==== 90+0+0 (secure 0 0 0) 0x7fd0d0051430 con 0x7fd0dc0b8f10 2023-10-08T12:00:55.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.167+0000 7fd0e1de9640 1 -- 172.21.15.62:0/31940720 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fd0c80664a0 msgr2=0x7fd0c8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:55.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.167+0000 7fd0e1de9640 1 --2- 172.21.15.62:0/31940720 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fd0c80664a0 0x7fd0c8068960 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc009b70 tx=0x7fd0cc0091e0 comp rx=0 tx=0).stop 2023-10-08T12:00:55.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.167+0000 7fd0e1de9640 1 -- 172.21.15.62:0/31940720 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd0dc0b8f10 msgr2=0x7fd0dc0b2cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:55.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.167+0000 7fd0e1de9640 1 --2- 172.21.15.62:0/31940720 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd0dc0b8f10 0x7fd0dc0b2cb0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd0d000c430 tx=0x7fd0d000c8f0 comp rx=0 tx=0).stop 2023-10-08T12:00:55.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.167+0000 7fd0e1de9640 1 -- 172.21.15.62:0/31940720 shutdown_connections 2023-10-08T12:00:55.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.167+0000 7fd0e1de9640 1 --2- 172.21.15.62:0/31940720 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fd0c80664a0 0x7fd0c8068960 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:55.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.167+0000 7fd0e1de9640 1 --2- 172.21.15.62:0/31940720 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd0dc14b0b0 0x7fd0dc1e5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:55.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.167+0000 7fd0e1de9640 1 --2- 172.21.15.62:0/31940720 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd0dc0b8f10 0x7fd0dc0b2cb0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:55.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.167+0000 7fd0e1de9640 1 --2- 172.21.15.62:0/31940720 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd0dc06cbd0 0x7fd0dc143410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:55.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.167+0000 7fd0e1de9640 1 -- 172.21.15.62:0/31940720 >> 172.21.15.62:0/31940720 conn(0x7fd0dc09e910 msgr2=0x7fd0dc147490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:55.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.167+0000 7fd0e1de9640 1 -- 172.21.15.62:0/31940720 shutdown_connections 2023-10-08T12:00:55.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.167+0000 7fd0e1de9640 1 -- 172.21.15.62:0/31940720 wait complete. 2023-10-08T12:00:55.183 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-10-08T12:00:55.313 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.311+0000 7f47307b7640 1 -- 172.21.15.62:0/3649996937 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f47280699f0 msgr2=0x7f47280b7210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:55.313 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.311+0000 7f47307b7640 1 --2- 172.21.15.62:0/3649996937 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f47280699f0 0x7f47280b7210 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f47280669b0 tx=0x7f472401f350 comp rx=0 tx=0).stop 2023-10-08T12:00:55.313 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.311+0000 7f47307b7640 1 -- 172.21.15.62:0/3649996937 shutdown_connections 2023-10-08T12:00:55.313 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.311+0000 7f47307b7640 1 --2- 172.21.15.62:0/3649996937 >> v2:172.21.15.130:3300/0 conn(0x7f472814f8f0 0x7f4728151ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:55.313 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.311+0000 7f47307b7640 1 --2- 172.21.15.62:0/3649996937 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f47280699f0 0x7f47280b7210 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:55.313 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.311+0000 7f47307b7640 1 -- 172.21.15.62:0/3649996937 >> 172.21.15.62:0/3649996937 conn(0x7f472809d610 msgr2=0x7f472809da20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:55.313 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.311+0000 7f47307b7640 1 -- 172.21.15.62:0/3649996937 shutdown_connections 2023-10-08T12:00:55.313 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.311+0000 7f47307b7640 1 -- 172.21.15.62:0/3649996937 wait complete. 2023-10-08T12:00:55.314 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.311+0000 7f47307b7640 1 Processor -- start 2023-10-08T12:00:55.314 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.311+0000 7f47307b7640 1 -- start start 2023-10-08T12:00:55.316 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.315+0000 7f47307b7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f47280699f0 0x7f4728146210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:55.316 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.315+0000 7f47307b7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f47280b7750 0x7f47281df0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:55.316 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.315+0000 7f47307b7640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f472814f8f0 0x7f47280a0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:55.316 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.315+0000 7f47307b7640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4728146750 con 0x7f47280b7750 2023-10-08T12:00:55.316 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.315+0000 7f47307b7640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f472806d370 con 0x7f47280699f0 2023-10-08T12:00:55.316 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.315+0000 7f47307b7640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f472806bef0 con 0x7f472814f8f0 2023-10-08T12:00:55.316 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.315+0000 7f472dd52640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f47280b7750 0x7f47281df0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:55.316 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.315+0000 7f472dd52640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f47280b7750 0x7f47281df0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49456/0 (socket says 172.21.15.62:49456) 2023-10-08T12:00:55.317 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.315+0000 7f472dd52640 1 -- 172.21.15.62:0/2799313969 learned_addr learned my addr 172.21.15.62:0/2799313969 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:55.317 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.315+0000 7f472e553640 1 --2- 172.21.15.62:0/2799313969 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f47280699f0 0x7f4728146210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:55.317 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.315+0000 7f472ed54640 1 --2- 172.21.15.62:0/2799313969 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f472814f8f0 0x7f47280a0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:55.317 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.315+0000 7f472dd52640 1 -- 172.21.15.62:0/2799313969 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f472814f8f0 msgr2=0x7f47280a0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:55.317 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.315+0000 7f472dd52640 1 --2- 172.21.15.62:0/2799313969 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f472814f8f0 0x7f47280a0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:55.317 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.315+0000 7f472dd52640 1 -- 172.21.15.62:0/2799313969 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f47280699f0 msgr2=0x7f4728146210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:55.317 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.315+0000 7f472dd52640 1 --2- 172.21.15.62:0/2799313969 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f47280699f0 0x7f4728146210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:55.317 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.315+0000 7f472dd52640 1 -- 172.21.15.62:0/2799313969 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4724009820 con 0x7f47280b7750 2023-10-08T12:00:55.317 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.315+0000 7f472ed54640 1 --2- 172.21.15.62:0/2799313969 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f472814f8f0 0x7f47280a0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:00:55.317 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.315+0000 7f472e553640 1 --2- 172.21.15.62:0/2799313969 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f47280699f0 0x7f4728146210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:00:55.317 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.315+0000 7f472dd52640 1 --2- 172.21.15.62:0/2799313969 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f47280b7750 0x7f47281df0e0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f471800c480 tx=0x7f471800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:55.318 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.315+0000 7f471effd640 1 -- 172.21.15.62:0/2799313969 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4718005480 con 0x7f47280b7750 2023-10-08T12:00:55.318 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.315+0000 7f471effd640 1 -- 172.21.15.62:0/2799313969 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4718003600 con 0x7f47280b7750 2023-10-08T12:00:55.318 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.315+0000 7f47307b7640 1 -- 172.21.15.62:0/2799313969 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f472806cd20 con 0x7f47280b7750 2023-10-08T12:00:55.318 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.315+0000 7f471effd640 1 -- 172.21.15.62:0/2799313969 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4718003a10 con 0x7f47280b7750 2023-10-08T12:00:55.318 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.315+0000 7f47307b7640 1 -- 172.21.15.62:0/2799313969 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47281df620 con 0x7f47280b7750 2023-10-08T12:00:55.319 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.315+0000 7f47307b7640 1 -- 172.21.15.62:0/2799313969 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f472804da80 con 0x7f47280b7750 2023-10-08T12:00:55.319 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.315+0000 7f471effd640 1 -- 172.21.15.62:0/2799313969 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4718003b70 con 0x7f47280b7750 2023-10-08T12:00:55.319 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.315+0000 7f471effd640 1 --2- 172.21.15.62:0/2799313969 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f470c066470 0x7f470c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:55.319 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.315+0000 7f471effd640 1 -- 172.21.15.62:0/2799313969 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4718083870 con 0x7f47280b7750 2023-10-08T12:00:55.319 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.315+0000 7f472e553640 1 --2- 172.21.15.62:0/2799313969 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f470c066470 0x7f470c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:55.319 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.319+0000 7f472e553640 1 --2- 172.21.15.62:0/2799313969 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f470c066470 0x7f470c068930 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f47240b1000 tx=0x7f472401db90 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:55.321 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.319+0000 7f471effd640 1 -- 172.21.15.62:0/2799313969 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f47180510d0 con 0x7f47280b7750 2023-10-08T12:00:55.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.535+0000 7f47307b7640 1 -- 172.21.15.62:0/2799313969 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f47280b0880 con 0x7f47280b7750 2023-10-08T12:00:55.539 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.539+0000 7f471effd640 1 -- 172.21.15.62:0/2799313969 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f47180546f0 con 0x7f47280b7750 2023-10-08T12:00:55.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.543+0000 7f47307b7640 1 -- 172.21.15.62:0/2799313969 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f470c066470 msgr2=0x7f470c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:55.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.543+0000 7f47307b7640 1 --2- 172.21.15.62:0/2799313969 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f470c066470 0x7f470c068930 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f47240b1000 tx=0x7f472401db90 comp rx=0 tx=0).stop 2023-10-08T12:00:55.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.543+0000 7f47307b7640 1 -- 172.21.15.62:0/2799313969 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f47280b7750 msgr2=0x7f47281df0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:55.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.543+0000 7f47307b7640 1 --2- 172.21.15.62:0/2799313969 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f47280b7750 0x7f47281df0e0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f471800c480 tx=0x7f471800c940 comp rx=0 tx=0).stop 2023-10-08T12:00:55.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.543+0000 7f47307b7640 1 -- 172.21.15.62:0/2799313969 shutdown_connections 2023-10-08T12:00:55.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.543+0000 7f47307b7640 1 --2- 172.21.15.62:0/2799313969 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f470c066470 0x7f470c068930 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:55.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.543+0000 7f47307b7640 1 --2- 172.21.15.62:0/2799313969 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f472814f8f0 0x7f47280a0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:55.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.543+0000 7f47307b7640 1 --2- 172.21.15.62:0/2799313969 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f47280b7750 0x7f47281df0e0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:55.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.543+0000 7f47307b7640 1 --2- 172.21.15.62:0/2799313969 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f47280699f0 0x7f4728146210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:55.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.543+0000 7f47307b7640 1 -- 172.21.15.62:0/2799313969 >> 172.21.15.62:0/2799313969 conn(0x7f472809d610 msgr2=0x7f472809d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:55.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.543+0000 7f47307b7640 1 -- 172.21.15.62:0/2799313969 shutdown_connections 2023-10-08T12:00:55.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.543+0000 7f47307b7640 1 -- 172.21.15.62:0/2799313969 wait complete. 2023-10-08T12:00:55.560 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-10-08T12:00:55.691 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.691+0000 7fd1f29e8640 1 -- 172.21.15.62:0/843791443 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1ec147920 msgr2=0x7fd1ec0b8570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:55.693 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.691+0000 7fd1f29e8640 1 --2- 172.21.15.62:0/843791443 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1ec147920 0x7fd1ec0b8570 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec0718d0 tx=0x7fd1d401c860 comp rx=0 tx=0).stop 2023-10-08T12:00:55.693 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.691+0000 7fd1f29e8640 1 -- 172.21.15.62:0/843791443 shutdown_connections 2023-10-08T12:00:55.693 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.691+0000 7fd1f29e8640 1 --2- 172.21.15.62:0/843791443 >> v2:172.21.15.130:3300/0 conn(0x7fd1ec071410 0x7fd1ec0b6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:55.693 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.691+0000 7fd1f29e8640 1 --2- 172.21.15.62:0/843791443 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1ec147920 0x7fd1ec0b8570 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:55.693 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.691+0000 7fd1f29e8640 1 -- 172.21.15.62:0/843791443 >> 172.21.15.62:0/843791443 conn(0x7fd1ec09c520 msgr2=0x7fd1ec09c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:55.694 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.691+0000 7fd1f29e8640 1 -- 172.21.15.62:0/843791443 shutdown_connections 2023-10-08T12:00:55.694 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.691+0000 7fd1f29e8640 1 -- 172.21.15.62:0/843791443 wait complete. 2023-10-08T12:00:55.696 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.691+0000 7fd1f29e8640 1 Processor -- start 2023-10-08T12:00:55.696 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.691+0000 7fd1f29e8640 1 -- start start 2023-10-08T12:00:55.696 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.691+0000 7fd1f29e8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd1ec071410 0x7fd1ec1e32b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:55.696 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.691+0000 7fd1f29e8640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd1ec0b9260 0x7fd1ec1458f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:55.696 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.691+0000 7fd1f29e8640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1ec147920 0x7fd1ec145e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:55.697 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.691+0000 7fd1f29e8640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ec1e4030 con 0x7fd1ec147920 2023-10-08T12:00:55.697 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.691+0000 7fd1f29e8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ec1e37f0 con 0x7fd1ec071410 2023-10-08T12:00:55.697 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.691+0000 7fd1f29e8640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ec1e3a70 con 0x7fd1ec0b9260 2023-10-08T12:00:55.697 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.691+0000 7fd1f0f85640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1ec147920 0x7fd1ec145e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:55.697 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.691+0000 7fd1f0f85640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1ec147920 0x7fd1ec145e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49474/0 (socket says 172.21.15.62:49474) 2023-10-08T12:00:55.697 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.691+0000 7fd1f0f85640 1 -- 172.21.15.62:0/3955167675 learned_addr learned my addr 172.21.15.62:0/3955167675 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:55.697 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.691+0000 7fd1ebfff640 1 --2- 172.21.15.62:0/3955167675 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd1ec071410 0x7fd1ec1e32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:55.697 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.691+0000 7fd1eb7fe640 1 --2- 172.21.15.62:0/3955167675 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd1ec0b9260 0x7fd1ec1458f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:55.697 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.691+0000 7fd1f0f85640 1 -- 172.21.15.62:0/3955167675 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd1ec0b9260 msgr2=0x7fd1ec1458f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:55.697 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.691+0000 7fd1f0f85640 1 --2- 172.21.15.62:0/3955167675 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd1ec0b9260 0x7fd1ec1458f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:55.697 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.691+0000 7fd1f0f85640 1 -- 172.21.15.62:0/3955167675 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd1ec071410 msgr2=0x7fd1ec1e32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:55.698 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.691+0000 7fd1f0f85640 1 --2- 172.21.15.62:0/3955167675 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd1ec071410 0x7fd1ec1e32b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:55.698 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.691+0000 7fd1f0f85640 1 -- 172.21.15.62:0/3955167675 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1d4009560 con 0x7fd1ec147920 2023-10-08T12:00:55.698 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.695+0000 7fd1f0f85640 1 --2- 172.21.15.62:0/3955167675 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1ec147920 0x7fd1ec145e30 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc00d750 tx=0x7fd1dc00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:55.698 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.695+0000 7fd1e8ff9640 1 -- 172.21.15.62:0/3955167675 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1dc009c30 con 0x7fd1ec147920 2023-10-08T12:00:55.698 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.695+0000 7fd1e8ff9640 1 -- 172.21.15.62:0/3955167675 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd1dc009e80 con 0x7fd1ec147920 2023-10-08T12:00:55.698 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.695+0000 7fd1f29e8640 1 -- 172.21.15.62:0/3955167675 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1ec1e3d50 con 0x7fd1ec147920 2023-10-08T12:00:55.698 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.695+0000 7fd1e8ff9640 1 -- 172.21.15.62:0/3955167675 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1dc005280 con 0x7fd1ec147920 2023-10-08T12:00:55.698 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.695+0000 7fd1f29e8640 1 -- 172.21.15.62:0/3955167675 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1ec0b4e00 con 0x7fd1ec147920 2023-10-08T12:00:55.698 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.695+0000 7fd1f29e8640 1 -- 172.21.15.62:0/3955167675 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1ec0b5be0 con 0x7fd1ec147920 2023-10-08T12:00:55.699 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.695+0000 7fd1e8ff9640 1 -- 172.21.15.62:0/3955167675 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd1dc0053e0 con 0x7fd1ec147920 2023-10-08T12:00:55.699 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.695+0000 7fd1e8ff9640 1 --2- 172.21.15.62:0/3955167675 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fd1d0066470 0x7fd1d0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:55.699 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.695+0000 7fd1e8ff9640 1 -- 172.21.15.62:0/3955167675 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd1dc083c70 con 0x7fd1ec147920 2023-10-08T12:00:55.699 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.695+0000 7fd1ebfff640 1 --2- 172.21.15.62:0/3955167675 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fd1d0066470 0x7fd1d0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:55.699 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.695+0000 7fd1ebfff640 1 --2- 172.21.15.62:0/3955167675 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fd1d0066470 0x7fd1d0068930 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd1e4005530 tx=0x7fd1e4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:55.699 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.699+0000 7fd1e8ff9640 1 -- 172.21.15.62:0/3955167675 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd1dc0514d0 con 0x7fd1ec147920 2023-10-08T12:00:55.903 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.903+0000 7fd1f29e8640 1 -- 172.21.15.62:0/3955167675 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fd1ec145610 con 0x7fd1ec147920 2023-10-08T12:00:55.907 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.907+0000 7fd1e8ff9640 1 -- 172.21.15.62:0/3955167675 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v13) v1 ==== 97+0+0 (secure 0 0 0) 0x7fd1ec145610 con 0x7fd1ec147920 2023-10-08T12:00:55.910 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.907+0000 7fd1f29e8640 1 -- 172.21.15.62:0/3955167675 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fd1d0066470 msgr2=0x7fd1d0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:55.910 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.907+0000 7fd1f29e8640 1 --2- 172.21.15.62:0/3955167675 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fd1d0066470 0x7fd1d0068930 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd1e4005530 tx=0x7fd1e4009040 comp rx=0 tx=0).stop 2023-10-08T12:00:55.910 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.907+0000 7fd1f29e8640 1 -- 172.21.15.62:0/3955167675 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1ec147920 msgr2=0x7fd1ec145e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:55.910 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.907+0000 7fd1f29e8640 1 --2- 172.21.15.62:0/3955167675 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1ec147920 0x7fd1ec145e30 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc00d750 tx=0x7fd1dc00dc10 comp rx=0 tx=0).stop 2023-10-08T12:00:55.910 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.907+0000 7fd1f29e8640 1 -- 172.21.15.62:0/3955167675 shutdown_connections 2023-10-08T12:00:55.910 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.907+0000 7fd1f29e8640 1 --2- 172.21.15.62:0/3955167675 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fd1d0066470 0x7fd1d0068930 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:55.910 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.907+0000 7fd1f29e8640 1 --2- 172.21.15.62:0/3955167675 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd1ec0b9260 0x7fd1ec1458f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:55.910 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.907+0000 7fd1f29e8640 1 --2- 172.21.15.62:0/3955167675 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1ec147920 0x7fd1ec145e30 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:55.910 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.907+0000 7fd1f29e8640 1 --2- 172.21.15.62:0/3955167675 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd1ec071410 0x7fd1ec1e32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:55.910 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.907+0000 7fd1f29e8640 1 -- 172.21.15.62:0/3955167675 >> 172.21.15.62:0/3955167675 conn(0x7fd1ec09c520 msgr2=0x7fd1ec097c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:55.911 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.911+0000 7fd1f29e8640 1 -- 172.21.15.62:0/3955167675 shutdown_connections 2023-10-08T12:00:55.911 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:55.911+0000 7fd1f29e8640 1 -- 172.21.15.62:0/3955167675 wait complete. 2023-10-08T12:00:55.925 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-10-08T12:00:56.056 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.055+0000 7ff3492a5640 1 -- 172.21.15.62:0/1575471270 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3440ba600 msgr2=0x7ff3440baa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:56.056 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.055+0000 7ff3492a5640 1 --2- 172.21.15.62:0/1575471270 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3440ba600 0x7ff3440baa40 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ff344066870 tx=0x7ff32c01f050 comp rx=0 tx=0).stop 2023-10-08T12:00:56.057 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.055+0000 7ff3492a5640 1 -- 172.21.15.62:0/1575471270 shutdown_connections 2023-10-08T12:00:56.057 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.055+0000 7ff3492a5640 1 --2- 172.21.15.62:0/1575471270 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3440ba600 0x7ff3440baa40 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:56.057 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.055+0000 7ff3492a5640 1 --2- 172.21.15.62:0/1575471270 >> v2:172.21.15.130:3300/0 conn(0x7ff344071940 0x7ff34414a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:56.057 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.055+0000 7ff3492a5640 1 -- 172.21.15.62:0/1575471270 >> 172.21.15.62:0/1575471270 conn(0x7ff34409e5b0 msgr2=0x7ff34409e9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:56.057 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.055+0000 7ff3492a5640 1 -- 172.21.15.62:0/1575471270 shutdown_connections 2023-10-08T12:00:56.057 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.055+0000 7ff3492a5640 1 -- 172.21.15.62:0/1575471270 wait complete. 2023-10-08T12:00:56.059 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.055+0000 7ff3492a5640 1 Processor -- start 2023-10-08T12:00:56.059 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.055+0000 7ff3492a5640 1 -- start start 2023-10-08T12:00:56.060 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.059+0000 7ff3492a5640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff344071940 0x7ff3440b1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:56.060 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.059+0000 7ff3492a5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff3440ba600 0x7ff34413d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:56.060 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.059+0000 7ff3492a5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff344140c90 0x7ff3440a1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:56.060 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.059+0000 7ff3492a5640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3440b2310 con 0x7ff344140c90 2023-10-08T12:00:56.060 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.059+0000 7ff3492a5640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3441e12a0 con 0x7ff3440ba600 2023-10-08T12:00:56.060 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.059+0000 7ff3492a5640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3441e1580 con 0x7ff344071940 2023-10-08T12:00:56.060 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.059+0000 7ff3437fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff344140c90 0x7ff3440a1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:56.060 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.059+0000 7ff3437fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff344140c90 0x7ff3440a1b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49492/0 (socket says 172.21.15.62:49492) 2023-10-08T12:00:56.060 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.059+0000 7ff3437fe640 1 -- 172.21.15.62:0/3451810508 learned_addr learned my addr 172.21.15.62:0/3451810508 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:56.060 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.059+0000 7ff3427fc640 1 --2- 172.21.15.62:0/3451810508 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff3440ba600 0x7ff34413d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:56.061 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.059+0000 7ff342ffd640 1 --2- 172.21.15.62:0/3451810508 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff344071940 0x7ff3440b1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:56.061 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.059+0000 7ff3437fe640 1 -- 172.21.15.62:0/3451810508 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff344071940 msgr2=0x7ff3440b1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:56.061 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.059+0000 7ff3437fe640 1 --2- 172.21.15.62:0/3451810508 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff344071940 0x7ff3440b1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:56.061 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.059+0000 7ff3437fe640 1 -- 172.21.15.62:0/3451810508 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff3440ba600 msgr2=0x7ff34413d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:56.061 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.059+0000 7ff3437fe640 1 --2- 172.21.15.62:0/3451810508 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff3440ba600 0x7ff34413d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:56.061 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.059+0000 7ff3437fe640 1 -- 172.21.15.62:0/3451810508 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff32c009560 con 0x7ff344140c90 2023-10-08T12:00:56.061 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.059+0000 7ff3437fe640 1 --2- 172.21.15.62:0/3451810508 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff344140c90 0x7ff3440a1b80 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ff33400b410 tx=0x7ff33400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:56.061 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.059+0000 7ff33b7fe640 1 -- 172.21.15.62:0/3451810508 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff334011830 con 0x7ff344140c90 2023-10-08T12:00:56.061 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.059+0000 7ff33b7fe640 1 -- 172.21.15.62:0/3451810508 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff334011ac0 con 0x7ff344140c90 2023-10-08T12:00:56.061 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.059+0000 7ff3492a5640 1 -- 172.21.15.62:0/3451810508 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff34406d8b0 con 0x7ff344140c90 2023-10-08T12:00:56.061 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.059+0000 7ff33b7fe640 1 -- 172.21.15.62:0/3451810508 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff334010380 con 0x7ff344140c90 2023-10-08T12:00:56.061 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.059+0000 7ff3492a5640 1 -- 172.21.15.62:0/3451810508 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3440991d0 con 0x7ff344140c90 2023-10-08T12:00:56.062 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.059+0000 7ff3492a5640 1 -- 172.21.15.62:0/3451810508 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3441516e0 con 0x7ff344140c90 2023-10-08T12:00:56.062 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.059+0000 7ff33b7fe640 1 -- 172.21.15.62:0/3451810508 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff3340104e0 con 0x7ff344140c90 2023-10-08T12:00:56.063 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.059+0000 7ff33b7fe640 1 --2- 172.21.15.62:0/3451810508 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7ff324066470 0x7ff324068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:56.063 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.059+0000 7ff33b7fe640 1 -- 172.21.15.62:0/3451810508 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff334083b40 con 0x7ff344140c90 2023-10-08T12:00:56.063 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.059+0000 7ff342ffd640 1 --2- 172.21.15.62:0/3451810508 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7ff324066470 0x7ff324068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:56.063 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.063+0000 7ff342ffd640 1 --2- 172.21.15.62:0/3451810508 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7ff324066470 0x7ff324068930 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff33c005c50 tx=0x7ff33c00a3b0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:56.065 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.063+0000 7ff33b7fe640 1 -- 172.21.15.62:0/3451810508 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff334051310 con 0x7ff344140c90 2023-10-08T12:00:56.269 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.267+0000 7ff3492a5640 1 -- 172.21.15.62:0/3451810508 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7ff34404da80 con 0x7ff344140c90 2023-10-08T12:00:56.273 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.271+0000 7ff33b7fe640 1 -- 172.21.15.62:0/3451810508 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v14) v1 ==== 90+0+0 (secure 0 0 0) 0x7ff334059e60 con 0x7ff344140c90 2023-10-08T12:00:56.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.275+0000 7ff3492a5640 1 -- 172.21.15.62:0/3451810508 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7ff324066470 msgr2=0x7ff324068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:56.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.275+0000 7ff3492a5640 1 --2- 172.21.15.62:0/3451810508 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7ff324066470 0x7ff324068930 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff33c005c50 tx=0x7ff33c00a3b0 comp rx=0 tx=0).stop 2023-10-08T12:00:56.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.275+0000 7ff3492a5640 1 -- 172.21.15.62:0/3451810508 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff344140c90 msgr2=0x7ff3440a1b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:56.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.275+0000 7ff3492a5640 1 --2- 172.21.15.62:0/3451810508 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff344140c90 0x7ff3440a1b80 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ff33400b410 tx=0x7ff33400b8d0 comp rx=0 tx=0).stop 2023-10-08T12:00:56.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.275+0000 7ff3492a5640 1 -- 172.21.15.62:0/3451810508 shutdown_connections 2023-10-08T12:00:56.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.275+0000 7ff3492a5640 1 --2- 172.21.15.62:0/3451810508 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7ff324066470 0x7ff324068930 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:56.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.275+0000 7ff3492a5640 1 --2- 172.21.15.62:0/3451810508 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff344140c90 0x7ff3440a1b80 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:56.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.275+0000 7ff3492a5640 1 --2- 172.21.15.62:0/3451810508 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff3440ba600 0x7ff34413d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:56.278 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.275+0000 7ff3492a5640 1 --2- 172.21.15.62:0/3451810508 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff344071940 0x7ff3440b1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:56.278 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.275+0000 7ff3492a5640 1 -- 172.21.15.62:0/3451810508 >> 172.21.15.62:0/3451810508 conn(0x7ff34409e5b0 msgr2=0x7ff34414a180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:56.278 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.275+0000 7ff3492a5640 1 -- 172.21.15.62:0/3451810508 shutdown_connections 2023-10-08T12:00:56.278 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.275+0000 7ff3492a5640 1 -- 172.21.15.62:0/3451810508 wait complete. 2023-10-08T12:00:56.292 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:00:56.407 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.407+0000 7f70982b2640 1 -- 172.21.15.62:0/3515451473 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f707c0051e0 msgr2=0x7f707c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:56.408 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.407+0000 7f70982b2640 1 --2- 172.21.15.62:0/3515451473 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f707c0051e0 0x7f707c00b990 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f70900a0ab0 tx=0x7f708801dfa0 comp rx=0 tx=0).stop 2023-10-08T12:00:56.408 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.407+0000 7f70982b2640 1 -- 172.21.15.62:0/3515451473 shutdown_connections 2023-10-08T12:00:56.408 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.407+0000 7f70982b2640 1 --2- 172.21.15.62:0/3515451473 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f707c0051e0 0x7f707c00b990 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:56.408 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.407+0000 7f70982b2640 1 -- 172.21.15.62:0/3515451473 >> 172.21.15.62:0/3515451473 conn(0x7f709009c520 msgr2=0x7f709009c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:56.408 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.407+0000 7f70982b2640 1 -- 172.21.15.62:0/3515451473 shutdown_connections 2023-10-08T12:00:56.408 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.407+0000 7f70982b2640 1 -- 172.21.15.62:0/3515451473 wait complete. 2023-10-08T12:00:56.410 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.407+0000 7f70982b2640 1 Processor -- start 2023-10-08T12:00:56.410 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.407+0000 7f70982b2640 1 -- start start 2023-10-08T12:00:56.410 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.407+0000 7f70982b2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f707c0051e0 0x7f7090070340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:56.410 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.407+0000 7f70982b2640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70901e0740 0x7f70901e0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:56.411 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.407+0000 7f70982b2640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f709014d1e0 0x7f709014d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:56.411 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.407+0000 7f70982b2640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f709014cd00 con 0x7f707c0051e0 2023-10-08T12:00:56.411 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.407+0000 7f70982b2640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7090070880 con 0x7f70901e0740 2023-10-08T12:00:56.411 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.407+0000 7f70982b2640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f709014e7b0 con 0x7f709014d1e0 2023-10-08T12:00:56.411 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.407+0000 7f709604e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f707c0051e0 0x7f7090070340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:56.411 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.407+0000 7f709604e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f707c0051e0 0x7f7090070340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46200/0 (socket says 172.21.15.62:46200) 2023-10-08T12:00:56.411 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.407+0000 7f709604e640 1 -- 172.21.15.62:0/2874824865 learned_addr learned my addr 172.21.15.62:0/2874824865 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:56.411 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.411+0000 7f709684f640 1 --2- 172.21.15.62:0/2874824865 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f709014d1e0 0x7f709014d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:56.411 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.411+0000 7f709584d640 1 --2- 172.21.15.62:0/2874824865 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70901e0740 0x7f70901e0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:56.411 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.411+0000 7f709604e640 1 -- 172.21.15.62:0/2874824865 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f709014d1e0 msgr2=0x7f709014d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:56.411 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.411+0000 7f709604e640 1 --2- 172.21.15.62:0/2874824865 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f709014d1e0 0x7f709014d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:56.412 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.411+0000 7f709604e640 1 -- 172.21.15.62:0/2874824865 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70901e0740 msgr2=0x7f70901e0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:56.412 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.411+0000 7f709604e640 1 --2- 172.21.15.62:0/2874824865 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70901e0740 0x7f70901e0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:56.412 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.411+0000 7f709604e640 1 -- 172.21.15.62:0/2874824865 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70901e1100 con 0x7f707c0051e0 2023-10-08T12:00:56.412 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.411+0000 7f709604e640 1 --2- 172.21.15.62:0/2874824865 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f707c0051e0 0x7f7090070340 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f7084000c10 tx=0x7f7084001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:56.412 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.411+0000 7f7082ffd640 1 -- 172.21.15.62:0/2874824865 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7084011870 con 0x7f707c0051e0 2023-10-08T12:00:56.412 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.411+0000 7f7082ffd640 1 -- 172.21.15.62:0/2874824865 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7084011ac0 con 0x7f707c0051e0 2023-10-08T12:00:56.412 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.411+0000 7f70982b2640 1 -- 172.21.15.62:0/2874824865 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f709014c640 con 0x7f707c0051e0 2023-10-08T12:00:56.412 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.411+0000 7f7082ffd640 1 -- 172.21.15.62:0/2874824865 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7084011e90 con 0x7f707c0051e0 2023-10-08T12:00:56.412 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.411+0000 7f70982b2640 1 -- 172.21.15.62:0/2874824865 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f709014e3b0 con 0x7f707c0051e0 2023-10-08T12:00:56.413 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.411+0000 7f70982b2640 1 -- 172.21.15.62:0/2874824865 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f709004da80 con 0x7f707c0051e0 2023-10-08T12:00:56.413 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.411+0000 7f7082ffd640 1 -- 172.21.15.62:0/2874824865 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f708401a400 con 0x7f707c0051e0 2023-10-08T12:00:56.413 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.411+0000 7f7082ffd640 1 --2- 172.21.15.62:0/2874824865 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f7074066470 0x7f7074068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:56.413 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.411+0000 7f7082ffd640 1 -- 172.21.15.62:0/2874824865 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7084084740 con 0x7f707c0051e0 2023-10-08T12:00:56.414 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.411+0000 7f709584d640 1 --2- 172.21.15.62:0/2874824865 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f7074066470 0x7f7074068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:56.414 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.411+0000 7f709584d640 1 --2- 172.21.15.62:0/2874824865 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f7074066470 0x7f7074068930 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f70901455c0 tx=0x7f708c0017f0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:56.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.415+0000 7f7082ffd640 1 -- 172.21.15.62:0/2874824865 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7084051fa0 con 0x7f707c0051e0 2023-10-08T12:00:56.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.571+0000 7f70982b2640 1 -- 172.21.15.62:0/2874824865 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f709006b4f0 con 0x7f707c0051e0 2023-10-08T12:00:56.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.571+0000 7f7082ffd640 1 -- 172.21.15.62:0/2874824865 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+12833 (secure 0 0 0) 0x7f70840555c0 con 0x7f707c0051e0 2023-10-08T12:00:56.574 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T12:00:56.574 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":26,"fsid":"3e777930-c2c1-4f2b-a903-c07ee4ca2c52","created":"2023-10-08T11:59:54.510229+0000","modified":"2023-10-08T12:00:53.682477+0000","last_up_change":"2023-10-08T12:00:06.783998+0000","last_in_change":"2023-10-08T11:59:57.847944+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:00:07.189433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7bc3070a-7240-43d9-9ec3-397b68a37e2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6820","nonce":2227876905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6824","nonce":2227876905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6831","nonce":2227876905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6828","nonce":2227876905}]},"public_addr":"172.21.15.62:6820/2227876905","cluster_addr":"172.21.15.62:6824/2227876905","heartbeat_back_addr":"172.21.15.62:6831/2227876905","heartbeat_front_addr":"172.21.15.62:6828/2227876905","state":["exists","up"]},{"osd":1,"uuid":"5e0fa1f5-9ddc-4882-b460-5578bb571003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6801","nonce":315660906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6803","nonce":315660906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6808","nonce":315660906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6805","nonce":315660906}]},"public_addr":"172.21.15.62:6801/315660906","cluster_addr":"172.21.15.62:6803/315660906","heartbeat_back_addr":"172.21.15.62:6808/315660906","heartbeat_front_addr":"172.21.15.62:6805/315660906","state":["exists","up"]},{"osd":2,"uuid":"262b5ee9-4243-4309-a14f-88ad4e8bf812","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6807","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6809","nonce":3784842938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6811","nonce":3784842938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6815","nonce":3784842938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6813","nonce":3784842938}]},"public_addr":"172.21.15.62:6809/3784842938","cluster_addr":"172.21.15.62:6811/3784842938","heartbeat_back_addr":"172.21.15.62:6815/3784842938","heartbeat_front_addr":"172.21.15.62:6813/3784842938","state":["exists","up"]},{"osd":3,"uuid":"1770bdb8-c12b-43b1-aaab-1d6b6fd18f4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6817","nonce":3385303160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6821","nonce":3385303160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6827","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6829","nonce":3385303160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6823","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6825","nonce":3385303160}]},"public_addr":"172.21.15.62:6817/3385303160","cluster_addr":"172.21.15.62:6821/3385303160","heartbeat_back_addr":"172.21.15.62:6829/3385303160","heartbeat_front_addr":"172.21.15.62:6825/3385303160","state":["exists","up"]},{"osd":4,"uuid":"74c73631-9351-494a-8246-28ee86e9f862","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6807","nonce":1174056987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6809","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6811","nonce":1174056987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6820","nonce":1174056987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6813","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6816","nonce":1174056987}]},"public_addr":"172.21.15.130:6807/1174056987","cluster_addr":"172.21.15.130:6811/1174056987","heartbeat_back_addr":"172.21.15.130:6820/1174056987","heartbeat_front_addr":"172.21.15.130:6816/1174056987","state":["exists","up"]},{"osd":5,"uuid":"1040f389-272c-41d6-ae76-70c04d09afa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6801","nonce":561928414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6803","nonce":561928414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6815","nonce":561928414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6808","nonce":561928414}]},"public_addr":"172.21.15.130:6801/561928414","cluster_addr":"172.21.15.130:6803/561928414","heartbeat_back_addr":"172.21.15.130:6815/561928414","heartbeat_front_addr":"172.21.15.130:6808/561928414","state":["exists","up"]},{"osd":6,"uuid":"178553eb-03e1-4ab8-9826-4f5997e6da0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6810","nonce":2877303015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6817","nonce":2877303015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6823","nonce":2877303015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6819","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6821","nonce":2877303015}]},"public_addr":"172.21.15.130:6810/2877303015","cluster_addr":"172.21.15.130:6817/2877303015","heartbeat_back_addr":"172.21.15.130:6823/2877303015","heartbeat_front_addr":"172.21.15.130:6821/2877303015","state":["exists","up"]},{"osd":7,"uuid":"b6581c8f-30b1-4dfd-b7b6-94b579128835","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6825","nonce":680009774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6827","nonce":680009774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6831","nonce":680009774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6829","nonce":680009774}]},"public_addr":"172.21.15.130:6825/680009774","cluster_addr":"172.21.15.130:6827/680009774","heartbeat_back_addr":"172.21.15.130:6831/680009774","heartbeat_front_addr":"172.21.15.130:6829/680009774","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.505543+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.394383+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.456652+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.529168+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.235414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.392158+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.347556+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.432039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:00:56.576 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.575+0000 7f70982b2640 1 -- 172.21.15.62:0/2874824865 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f7074066470 msgr2=0x7f7074068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:56.576 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.575+0000 7f70982b2640 1 --2- 172.21.15.62:0/2874824865 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f7074066470 0x7f7074068930 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f70901455c0 tx=0x7f708c0017f0 comp rx=0 tx=0).stop 2023-10-08T12:00:56.576 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.575+0000 7f70982b2640 1 -- 172.21.15.62:0/2874824865 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f707c0051e0 msgr2=0x7f7090070340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:56.576 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.575+0000 7f70982b2640 1 --2- 172.21.15.62:0/2874824865 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f707c0051e0 0x7f7090070340 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f7084000c10 tx=0x7f7084001640 comp rx=0 tx=0).stop 2023-10-08T12:00:56.576 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.575+0000 7f70982b2640 1 -- 172.21.15.62:0/2874824865 shutdown_connections 2023-10-08T12:00:56.576 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.575+0000 7f70982b2640 1 --2- 172.21.15.62:0/2874824865 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f7074066470 0x7f7074068930 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:56.576 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.575+0000 7f70982b2640 1 --2- 172.21.15.62:0/2874824865 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f709014d1e0 0x7f709014d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:56.576 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.575+0000 7f70982b2640 1 --2- 172.21.15.62:0/2874824865 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70901e0740 0x7f70901e0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:56.577 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.575+0000 7f70982b2640 1 --2- 172.21.15.62:0/2874824865 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f707c0051e0 0x7f7090070340 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:56.577 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.575+0000 7f70982b2640 1 -- 172.21.15.62:0/2874824865 >> 172.21.15.62:0/2874824865 conn(0x7f709009c520 msgr2=0x7f709009c900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:56.577 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.575+0000 7f70982b2640 1 -- 172.21.15.62:0/2874824865 shutdown_connections 2023-10-08T12:00:56.577 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.575+0000 7f70982b2640 1 -- 172.21.15.62:0/2874824865 wait complete. 2023-10-08T12:00:56.591 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T12:00:07.189433+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T12:00:56.592 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T12:00:56.709 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.707+0000 7fac6d02c640 1 -- 172.21.15.62:0/2127091332 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac50003980 msgr2=0x7fac50003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:56.710 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.707+0000 7fac6d02c640 1 --2- 172.21.15.62:0/2127091332 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac50003980 0x7fac50003da0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fac5c005fd0 tx=0x7fac5c01cd80 comp rx=0 tx=0).stop 2023-10-08T12:00:56.710 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.707+0000 7fac6759e640 1 -- 172.21.15.62:0/2127091332 reap_dead start 2023-10-08T12:00:56.710 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.707+0000 7fac6d02c640 1 -- 172.21.15.62:0/2127091332 shutdown_connections 2023-10-08T12:00:56.713 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.707+0000 7fac6d02c640 1 -- 172.21.15.62:0/2127091332 >> 172.21.15.62:0/2127091332 conn(0x7fac6809c520 msgr2=0x7fac6809c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:56.713 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.707+0000 7fac6d02c640 1 -- 172.21.15.62:0/2127091332 shutdown_connections 2023-10-08T12:00:56.713 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.707+0000 7fac6d02c640 1 -- 172.21.15.62:0/2127091332 wait complete. 2023-10-08T12:00:56.716 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.711+0000 7fac6d02c640 1 Processor -- start 2023-10-08T12:00:56.716 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.711+0000 7fac6d02c640 1 -- start start 2023-10-08T12:00:56.716 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.711+0000 7fac6d02c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac50003980 0x7fac68140ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:56.716 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.711+0000 7fac6d02c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac68070830 0x7fac681439e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:56.716 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.711+0000 7fac6d02c640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fac6813b8a0 0x7fac6813bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:56.716 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.711+0000 7fac6d02c640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac6806f220 con 0x7fac68070830 2023-10-08T12:00:56.716 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.711+0000 7fac6d02c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac68141400 con 0x7fac50003980 2023-10-08T12:00:56.716 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.711+0000 7fac6d02c640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac68141b20 con 0x7fac6813b8a0 2023-10-08T12:00:56.717 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.711+0000 7fac6659c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac68070830 0x7fac681439e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:56.717 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.711+0000 7fac6659c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac68070830 0x7fac681439e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46214/0 (socket says 172.21.15.62:46214) 2023-10-08T12:00:56.717 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.711+0000 7fac6659c640 1 -- 172.21.15.62:0/2072075061 learned_addr learned my addr 172.21.15.62:0/2072075061 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:56.717 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.711+0000 7fac66d9d640 1 --2- 172.21.15.62:0/2072075061 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac50003980 0x7fac68140ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:56.717 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.711+0000 7fac6759e640 1 --2- 172.21.15.62:0/2072075061 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fac6813b8a0 0x7fac6813bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:56.717 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.711+0000 7fac6659c640 1 -- 172.21.15.62:0/2072075061 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fac6813b8a0 msgr2=0x7fac6813bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:56.717 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.711+0000 7fac6659c640 1 --2- 172.21.15.62:0/2072075061 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fac6813b8a0 0x7fac6813bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:56.717 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.711+0000 7fac6659c640 1 -- 172.21.15.62:0/2072075061 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac50003980 msgr2=0x7fac68140ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:56.717 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.711+0000 7fac6659c640 1 --2- 172.21.15.62:0/2072075061 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac50003980 0x7fac68140ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:56.717 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.711+0000 7fac6659c640 1 -- 172.21.15.62:0/2072075061 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac6806e650 con 0x7fac68070830 2023-10-08T12:00:56.717 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.711+0000 7fac6659c640 1 --2- 172.21.15.62:0/2072075061 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac68070830 0x7fac681439e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fac58000c10 tx=0x7fac5800eb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:56.718 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.711+0000 7fac4f7fe640 1 -- 172.21.15.62:0/2072075061 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac58004460 con 0x7fac68070830 2023-10-08T12:00:56.718 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.711+0000 7fac4f7fe640 1 -- 172.21.15.62:0/2072075061 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fac5800ee50 con 0x7fac68070830 2023-10-08T12:00:56.718 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.711+0000 7fac6d02c640 1 -- 172.21.15.62:0/2072075061 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac6806e930 con 0x7fac68070830 2023-10-08T12:00:56.718 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.711+0000 7fac4f7fe640 1 -- 172.21.15.62:0/2072075061 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac5800ca10 con 0x7fac68070830 2023-10-08T12:00:56.718 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.711+0000 7fac6d02c640 1 -- 172.21.15.62:0/2072075061 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac6813c290 con 0x7fac68070830 2023-10-08T12:00:56.718 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.711+0000 7fac6d02c640 1 -- 172.21.15.62:0/2072075061 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac68070550 con 0x7fac68070830 2023-10-08T12:00:56.718 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.711+0000 7fac4f7fe640 1 -- 172.21.15.62:0/2072075061 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fac5800cb70 con 0x7fac68070830 2023-10-08T12:00:56.718 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.715+0000 7fac4f7fe640 1 --2- 172.21.15.62:0/2072075061 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fac54066470 0x7fac54068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:56.718 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.715+0000 7fac4f7fe640 1 -- 172.21.15.62:0/2072075061 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fac58084590 con 0x7fac68070830 2023-10-08T12:00:56.718 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.715+0000 7fac66d9d640 1 --2- 172.21.15.62:0/2072075061 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fac54066470 0x7fac54068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:56.719 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.715+0000 7fac66d9d640 1 --2- 172.21.15.62:0/2072075061 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fac54066470 0x7fac54068930 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fac5c0b0000 tx=0x7fac5c0a7040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:56.719 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.719+0000 7fac4f7fe640 1 -- 172.21.15.62:0/2072075061 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fac68070550 con 0x7fac68070830 2023-10-08T12:00:56.872 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.871+0000 7fac6d02c640 1 -- 172.21.15.62:0/2072075061 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fac68070550 con 0x7fac68070830 2023-10-08T12:00:56.872 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.871+0000 7fac4f7fe640 1 -- 172.21.15.62:0/2072075061 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fac68070550 con 0x7fac68070830 2023-10-08T12:00:56.873 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2023-10-08T12:00:56.875 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.875+0000 7fac6d02c640 1 -- 172.21.15.62:0/2072075061 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fac54066470 msgr2=0x7fac54068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:56.875 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.875+0000 7fac6d02c640 1 --2- 172.21.15.62:0/2072075061 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fac54066470 0x7fac54068930 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fac5c0b0000 tx=0x7fac5c0a7040 comp rx=0 tx=0).stop 2023-10-08T12:00:56.875 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.875+0000 7fac6d02c640 1 -- 172.21.15.62:0/2072075061 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac68070830 msgr2=0x7fac681439e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:56.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.875+0000 7fac6d02c640 1 --2- 172.21.15.62:0/2072075061 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac68070830 0x7fac681439e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fac58000c10 tx=0x7fac5800eb40 comp rx=0 tx=0).stop 2023-10-08T12:00:56.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.875+0000 7fac6d02c640 1 -- 172.21.15.62:0/2072075061 shutdown_connections 2023-10-08T12:00:56.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.875+0000 7fac6d02c640 1 --2- 172.21.15.62:0/2072075061 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fac54066470 0x7fac54068930 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:56.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.875+0000 7fac6d02c640 1 --2- 172.21.15.62:0/2072075061 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fac6813b8a0 0x7fac6813bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:56.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.875+0000 7fac6d02c640 1 --2- 172.21.15.62:0/2072075061 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac68070830 0x7fac681439e0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:56.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.875+0000 7fac6d02c640 1 --2- 172.21.15.62:0/2072075061 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac50003980 0x7fac68140ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:56.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.875+0000 7fac6d02c640 1 -- 172.21.15.62:0/2072075061 >> 172.21.15.62:0/2072075061 conn(0x7fac6809c520 msgr2=0x7fac68098a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:56.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.875+0000 7fac6d02c640 1 -- 172.21.15.62:0/2072075061 shutdown_connections 2023-10-08T12:00:56.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:56.875+0000 7fac6d02c640 1 -- 172.21.15.62:0/2072075061 wait complete. 2023-10-08T12:00:56.893 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-08T12:00:57.010 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.011+0000 7f3f8ffff640 1 -- 172.21.15.62:0/637467746 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f940a5e30 con 0x7f3f980718c0 2023-10-08T12:00:57.011 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.011+0000 7f3f9f5c8640 1 -- 172.21.15.62:0/637467746 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f980718c0 msgr2=0x7f3f980b5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:57.011 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.011+0000 7f3f9f5c8640 1 --2- 172.21.15.62:0/637467746 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f980718c0 0x7f3f980b5170 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3f94009840 tx=0x7f3f9401c800 comp rx=0 tx=0).stop 2023-10-08T12:00:57.011 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.011+0000 7f3f9f5c8640 1 -- 172.21.15.62:0/637467746 shutdown_connections 2023-10-08T12:00:57.011 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.011+0000 7f3f9f5c8640 1 --2- 172.21.15.62:0/637467746 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3f980b6a60 0x7f3f9814a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:57.011 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.011+0000 7f3f9f5c8640 1 --2- 172.21.15.62:0/637467746 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f980718c0 0x7f3f980b5170 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:57.012 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.011+0000 7f3f9f5c8640 1 -- 172.21.15.62:0/637467746 >> 172.21.15.62:0/637467746 conn(0x7f3f9809c520 msgr2=0x7f3f9809c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:57.012 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.011+0000 7f3f9f5c8640 1 -- 172.21.15.62:0/637467746 shutdown_connections 2023-10-08T12:00:57.012 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.011+0000 7f3f9f5c8640 1 -- 172.21.15.62:0/637467746 wait complete. 2023-10-08T12:00:57.015 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.011+0000 7f3f9f5c8640 1 Processor -- start 2023-10-08T12:00:57.015 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.011+0000 7f3f9f5c8640 1 -- start start 2023-10-08T12:00:57.015 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.011+0000 7f3f9f5c8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f980718c0 0x7f3f980b3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:57.015 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.011+0000 7f3f9f5c8640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3f980b6a60 0x7f3f980a0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:57.016 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.011+0000 7f3f9f5c8640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f9814a790 0x7f3f980706e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:57.016 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.011+0000 7f3f9f5c8640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f980b4290 con 0x7f3f9814a790 2023-10-08T12:00:57.016 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.011+0000 7f3f9f5c8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f980b4a80 con 0x7f3f980718c0 2023-10-08T12:00:57.017 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.011+0000 7f3f9f5c8640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9813eb30 con 0x7f3f980b6a60 2023-10-08T12:00:57.017 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.011+0000 7f3f9db65640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f9814a790 0x7f3f980706e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:57.017 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.011+0000 7f3f9db65640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f9814a790 0x7f3f980706e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46224/0 (socket says 172.21.15.62:46224) 2023-10-08T12:00:57.017 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.011+0000 7f3f9db65640 1 -- 172.21.15.62:0/1673274089 learned_addr learned my addr 172.21.15.62:0/1673274089 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:57.017 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.011+0000 7f3f9d364640 1 --2- 172.21.15.62:0/1673274089 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f980718c0 0x7f3f980b3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:57.018 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.011+0000 7f3f9cb63640 1 --2- 172.21.15.62:0/1673274089 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3f980b6a60 0x7f3f980a0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:57.018 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.011+0000 7f3f9db65640 1 -- 172.21.15.62:0/1673274089 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3f980b6a60 msgr2=0x7f3f980a0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:57.018 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.011+0000 7f3f9db65640 1 --2- 172.21.15.62:0/1673274089 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3f980b6a60 0x7f3f980a0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:57.018 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.011+0000 7f3f9db65640 1 -- 172.21.15.62:0/1673274089 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f980718c0 msgr2=0x7f3f980b3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:57.019 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.011+0000 7f3f9db65640 1 --2- 172.21.15.62:0/1673274089 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f980718c0 0x7f3f980b3d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:57.019 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.011+0000 7f3f9db65640 1 -- 172.21.15.62:0/1673274089 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f940094a0 con 0x7f3f9814a790 2023-10-08T12:00:57.019 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.011+0000 7f3f9cb63640 1 --2- 172.21.15.62:0/1673274089 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3f980b6a60 0x7f3f980a0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:00:57.019 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.011+0000 7f3f9db65640 1 --2- 172.21.15.62:0/1673274089 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f9814a790 0x7f3f980706e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f3f9000c730 tx=0x7f3f9000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:57.020 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.011+0000 7f3f8dffb640 1 -- 172.21.15.62:0/1673274089 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f90006d60 con 0x7f3f9814a790 2023-10-08T12:00:57.020 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.011+0000 7f3f8dffb640 1 -- 172.21.15.62:0/1673274089 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3f90003980 con 0x7f3f9814a790 2023-10-08T12:00:57.020 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.011+0000 7f3f9f5c8640 1 -- 172.21.15.62:0/1673274089 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f980b2e60 con 0x7f3f9814a790 2023-10-08T12:00:57.020 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.011+0000 7f3f8dffb640 1 -- 172.21.15.62:0/1673274089 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f90003d90 con 0x7f3f9814a790 2023-10-08T12:00:57.020 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.011+0000 7f3f9f5c8640 1 -- 172.21.15.62:0/1673274089 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f980b2660 con 0x7f3f9814a790 2023-10-08T12:00:57.020 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.015+0000 7f3f9f5c8640 1 -- 172.21.15.62:0/1673274089 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f9804da80 con 0x7f3f9814a790 2023-10-08T12:00:57.021 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.015+0000 7f3f8dffb640 1 -- 172.21.15.62:0/1673274089 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3f900052e0 con 0x7f3f9814a790 2023-10-08T12:00:57.021 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.015+0000 7f3f8dffb640 1 --2- 172.21.15.62:0/1673274089 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f3f7c066470 0x7f3f7c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:57.021 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.015+0000 7f3f8dffb640 1 -- 172.21.15.62:0/1673274089 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3f90083a70 con 0x7f3f9814a790 2023-10-08T12:00:57.021 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.015+0000 7f3f9d364640 1 --2- 172.21.15.62:0/1673274089 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f3f7c066470 0x7f3f7c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:57.021 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.015+0000 7f3f9d364640 1 --2- 172.21.15.62:0/1673274089 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f3f7c066470 0x7f3f7c068930 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3f940af000 tx=0x7f3f9401b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:57.022 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.019+0000 7f3f8dffb640 1 -- 172.21.15.62:0/1673274089 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3f900512d0 con 0x7f3f9814a790 2023-10-08T12:00:57.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.167+0000 7f3f9f5c8640 1 -- 172.21.15.62:0/1673274089 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f3f9809d260 con 0x7f3f9814a790 2023-10-08T12:00:57.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.167+0000 7f3f8dffb640 1 -- 172.21.15.62:0/1673274089 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v26) v1 ==== 84+0+65 (secure 0 0 0) 0x7f3f900548f0 con 0x7f3f9814a790 2023-10-08T12:00:57.169 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T12:00:57.170 INFO:teuthology.orchestra.run.smithi062.stdout:[ 2023-10-08T12:00:57.170 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-10-08T12:00:57.170 INFO:teuthology.orchestra.run.smithi062.stdout: "poolnum": 1, 2023-10-08T12:00:57.170 INFO:teuthology.orchestra.run.smithi062.stdout: "poolname": ".mgr" 2023-10-08T12:00:57.170 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-10-08T12:00:57.170 INFO:teuthology.orchestra.run.smithi062.stdout:] 2023-10-08T12:00:57.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.171+0000 7f3f9f5c8640 1 -- 172.21.15.62:0/1673274089 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f3f7c066470 msgr2=0x7f3f7c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:57.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.171+0000 7f3f9f5c8640 1 --2- 172.21.15.62:0/1673274089 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f3f7c066470 0x7f3f7c068930 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3f940af000 tx=0x7f3f9401b040 comp rx=0 tx=0).stop 2023-10-08T12:00:57.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.171+0000 7f3f9f5c8640 1 -- 172.21.15.62:0/1673274089 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f9814a790 msgr2=0x7f3f980706e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:57.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.171+0000 7f3f9f5c8640 1 --2- 172.21.15.62:0/1673274089 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f9814a790 0x7f3f980706e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f3f9000c730 tx=0x7f3f9000cbf0 comp rx=0 tx=0).stop 2023-10-08T12:00:57.172 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.171+0000 7f3f9f5c8640 1 -- 172.21.15.62:0/1673274089 shutdown_connections 2023-10-08T12:00:57.172 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.171+0000 7f3f9f5c8640 1 --2- 172.21.15.62:0/1673274089 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f3f7c066470 0x7f3f7c068930 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:57.172 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.171+0000 7f3f9f5c8640 1 --2- 172.21.15.62:0/1673274089 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3f980b6a60 0x7f3f980a0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:57.172 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.171+0000 7f3f9f5c8640 1 --2- 172.21.15.62:0/1673274089 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f9814a790 0x7f3f980706e0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:57.172 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.171+0000 7f3f9f5c8640 1 --2- 172.21.15.62:0/1673274089 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f980718c0 0x7f3f980b3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:57.172 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.171+0000 7f3f9f5c8640 1 -- 172.21.15.62:0/1673274089 >> 172.21.15.62:0/1673274089 conn(0x7f3f9809c520 msgr2=0x7f3f9809b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:57.172 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.171+0000 7f3f9f5c8640 1 -- 172.21.15.62:0/1673274089 shutdown_connections 2023-10-08T12:00:57.172 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.171+0000 7f3f9f5c8640 1 -- 172.21.15.62:0/1673274089 wait complete. 2023-10-08T12:00:57.187 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-08T12:00:57.187 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-08T12:00:57.315 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.315+0000 7f8e4974f640 1 -- 172.21.15.62:0/2361547487 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e300039b0 msgr2=0x7f8e30003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:57.315 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.315+0000 7f8e4974f640 1 --2- 172.21.15.62:0/2361547487 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e300039b0 0x7f8e30003dd0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f8e34009b30 tx=0x7f8e3401d250 comp rx=0 tx=0).stop 2023-10-08T12:00:57.315 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.315+0000 7f8e437fe640 1 -- 172.21.15.62:0/2361547487 reap_dead start 2023-10-08T12:00:57.315 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.315+0000 7f8e4974f640 1 -- 172.21.15.62:0/2361547487 shutdown_connections 2023-10-08T12:00:57.315 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.315+0000 7f8e4974f640 1 -- 172.21.15.62:0/2361547487 >> 172.21.15.62:0/2361547487 conn(0x7f8e440beac0 msgr2=0x7f8e440beed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:57.316 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.315+0000 7f8e4974f640 1 -- 172.21.15.62:0/2361547487 shutdown_connections 2023-10-08T12:00:57.316 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.315+0000 7f8e4974f640 1 -- 172.21.15.62:0/2361547487 wait complete. 2023-10-08T12:00:57.319 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.315+0000 7f8e4974f640 1 Processor -- start 2023-10-08T12:00:57.319 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.315+0000 7f8e4974f640 1 -- start start 2023-10-08T12:00:57.319 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.315+0000 7f8e4974f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e300039b0 0x7f8e44143c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:57.319 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.315+0000 7f8e4974f640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8e44146310 0x7f8e44146790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:57.320 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.315+0000 7f8e4974f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e441dfbd0 0x7f8e441e0050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:57.320 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.315+0000 7f8e4974f640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e441df7b0 con 0x7f8e300039b0 2023-10-08T12:00:57.320 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.315+0000 7f8e4974f640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e44144150 con 0x7f8e441dfbd0 2023-10-08T12:00:57.320 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.315+0000 7f8e4974f640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e441e0590 con 0x7f8e44146310 2023-10-08T12:00:57.320 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.315+0000 7f8e42ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e300039b0 0x7f8e44143c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:57.320 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.315+0000 7f8e42ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e300039b0 0x7f8e44143c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46248/0 (socket says 172.21.15.62:46248) 2023-10-08T12:00:57.320 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.315+0000 7f8e42ffd640 1 -- 172.21.15.62:0/2875412384 learned_addr learned my addr 172.21.15.62:0/2875412384 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:57.320 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.315+0000 7f8e427fc640 1 --2- 172.21.15.62:0/2875412384 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8e44146310 0x7f8e44146790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:57.320 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.315+0000 7f8e437fe640 1 --2- 172.21.15.62:0/2875412384 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e441dfbd0 0x7f8e441e0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:57.320 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.315+0000 7f8e42ffd640 1 -- 172.21.15.62:0/2875412384 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8e44146310 msgr2=0x7f8e44146790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:57.321 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.315+0000 7f8e42ffd640 1 --2- 172.21.15.62:0/2875412384 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8e44146310 0x7f8e44146790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:57.321 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.315+0000 7f8e42ffd640 1 -- 172.21.15.62:0/2875412384 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e441dfbd0 msgr2=0x7f8e441e0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:57.321 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.315+0000 7f8e42ffd640 1 --2- 172.21.15.62:0/2875412384 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e441dfbd0 0x7f8e441e0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:57.321 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.315+0000 7f8e42ffd640 1 -- 172.21.15.62:0/2875412384 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e440bc900 con 0x7f8e300039b0 2023-10-08T12:00:57.321 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.315+0000 7f8e437fe640 1 --2- 172.21.15.62:0/2875412384 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e441dfbd0 0x7f8e441e0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:00:57.321 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.315+0000 7f8e42ffd640 1 --2- 172.21.15.62:0/2875412384 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e300039b0 0x7f8e44143c10 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f8e3401d080 tx=0x7f8e34005590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:57.321 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.315+0000 7f8e3b7fe640 1 -- 172.21.15.62:0/2875412384 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e34004230 con 0x7f8e300039b0 2023-10-08T12:00:57.321 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.315+0000 7f8e3b7fe640 1 -- 172.21.15.62:0/2875412384 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8e340044a0 con 0x7f8e300039b0 2023-10-08T12:00:57.321 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.315+0000 7f8e4974f640 1 -- 172.21.15.62:0/2875412384 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e441cf1a0 con 0x7f8e300039b0 2023-10-08T12:00:57.322 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.315+0000 7f8e3b7fe640 1 -- 172.21.15.62:0/2875412384 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e34004930 con 0x7f8e300039b0 2023-10-08T12:00:57.322 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.315+0000 7f8e4974f640 1 -- 172.21.15.62:0/2875412384 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e44145850 con 0x7f8e300039b0 2023-10-08T12:00:57.322 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.319+0000 7f8e4974f640 1 -- 172.21.15.62:0/2875412384 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e441dfa20 con 0x7f8e300039b0 2023-10-08T12:00:57.322 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.319+0000 7f8e3b7fe640 1 -- 172.21.15.62:0/2875412384 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8e340b3070 con 0x7f8e300039b0 2023-10-08T12:00:57.322 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.319+0000 7f8e3b7fe640 1 --2- 172.21.15.62:0/2875412384 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f8e24066470 0x7f8e24068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:57.322 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.319+0000 7f8e3b7fe640 1 -- 172.21.15.62:0/2875412384 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8e3411e9b0 con 0x7f8e300039b0 2023-10-08T12:00:57.322 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.319+0000 7f8e427fc640 1 --2- 172.21.15.62:0/2875412384 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f8e24066470 0x7f8e24068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:57.323 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.319+0000 7f8e427fc640 1 --2- 172.21.15.62:0/2875412384 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f8e24066470 0x7f8e24068930 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8e440a4ca0 tx=0x7f8e2c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:57.323 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.323+0000 7f8e3b7fe640 1 -- 172.21.15.62:0/2875412384 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8e340ec210 con 0x7f8e300039b0 2023-10-08T12:00:57.475 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.475+0000 7f8e4974f640 1 -- 172.21.15.62:0/2875412384 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f8e44066a30 con 0x7f8e300039b0 2023-10-08T12:00:57.820 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.819+0000 7f8e3b7fe640 1 -- 172.21.15.62:0/2875412384 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v27) v1 ==== 138+0+0 (secure 0 0 0) 0x7f8e340ba0b0 con 0x7f8e300039b0 2023-10-08T12:00:57.820 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_metadata' created 2023-10-08T12:00:57.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.823+0000 7f8e4974f640 1 -- 172.21.15.62:0/2875412384 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f8e24066470 msgr2=0x7f8e24068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:57.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.823+0000 7f8e4974f640 1 --2- 172.21.15.62:0/2875412384 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f8e24066470 0x7f8e24068930 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8e440a4ca0 tx=0x7f8e2c009040 comp rx=0 tx=0).stop 2023-10-08T12:00:57.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.823+0000 7f8e4974f640 1 -- 172.21.15.62:0/2875412384 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e300039b0 msgr2=0x7f8e44143c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:57.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.823+0000 7f8e4974f640 1 --2- 172.21.15.62:0/2875412384 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e300039b0 0x7f8e44143c10 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f8e3401d080 tx=0x7f8e34005590 comp rx=0 tx=0).stop 2023-10-08T12:00:57.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.823+0000 7f8e4974f640 1 -- 172.21.15.62:0/2875412384 shutdown_connections 2023-10-08T12:00:57.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.823+0000 7f8e4974f640 1 --2- 172.21.15.62:0/2875412384 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f8e24066470 0x7f8e24068930 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:57.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.823+0000 7f8e4974f640 1 --2- 172.21.15.62:0/2875412384 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8e44146310 0x7f8e44146790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:57.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.823+0000 7f8e4974f640 1 --2- 172.21.15.62:0/2875412384 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e441dfbd0 0x7f8e441e0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:57.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.823+0000 7f8e4974f640 1 --2- 172.21.15.62:0/2875412384 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e300039b0 0x7f8e44143c10 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:57.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.823+0000 7f8e4974f640 1 -- 172.21.15.62:0/2875412384 >> 172.21.15.62:0/2875412384 conn(0x7f8e440beac0 msgr2=0x7f8e44069790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:57.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.823+0000 7f8e4974f640 1 -- 172.21.15.62:0/2875412384 shutdown_connections 2023-10-08T12:00:57.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.823+0000 7f8e4974f640 1 -- 172.21.15.62:0/2875412384 wait complete. 2023-10-08T12:00:57.848 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-08T12:00:57.988 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.987+0000 7f61aa5b5640 1 -- 172.21.15.62:0/3765792025 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6188004d10 msgr2=0x7f6188005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:57.988 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.987+0000 7f61aa5b5640 1 --2- 172.21.15.62:0/3765792025 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6188004d10 0x7f6188005190 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f619c009ee0 tx=0x7f619c01d5d0 comp rx=0 tx=0).stop 2023-10-08T12:00:57.989 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.987+0000 7f61a8b52640 1 -- 172.21.15.62:0/3765792025 reap_dead start 2023-10-08T12:00:57.989 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.987+0000 7f61aa5b5640 1 -- 172.21.15.62:0/3765792025 shutdown_connections 2023-10-08T12:00:57.989 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.987+0000 7f61aa5b5640 1 -- 172.21.15.62:0/3765792025 >> 172.21.15.62:0/3765792025 conn(0x7f61a40a0540 msgr2=0x7f61a40a0950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:57.989 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.987+0000 7f61aa5b5640 1 -- 172.21.15.62:0/3765792025 shutdown_connections 2023-10-08T12:00:57.989 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.987+0000 7f61aa5b5640 1 -- 172.21.15.62:0/3765792025 wait complete. 2023-10-08T12:00:57.991 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.987+0000 7f61aa5b5640 1 Processor -- start 2023-10-08T12:00:57.991 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.987+0000 7f61aa5b5640 1 -- start start 2023-10-08T12:00:57.992 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.991+0000 7f61aa5b5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6188004d10 0x7f61a41e5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:57.992 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.991+0000 7f61aa5b5640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f61a4147ce0 0x7f61a41e2310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:57.992 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.991+0000 7f61aa5b5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f61a41e2850 0x7f61a413ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:57.992 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.991+0000 7f61aa5b5640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61a41e1ee0 con 0x7f6188004d10 2023-10-08T12:00:57.992 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.991+0000 7f61aa5b5640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61a41e6380 con 0x7f61a41e2850 2023-10-08T12:00:57.992 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.991+0000 7f61aa5b5640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61a41e2ce0 con 0x7f61a4147ce0 2023-10-08T12:00:57.992 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.991+0000 7f61a3fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6188004d10 0x7f61a41e5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:57.992 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.991+0000 7f61a3fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6188004d10 0x7f61a41e5430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46266/0 (socket says 172.21.15.62:46266) 2023-10-08T12:00:57.992 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.991+0000 7f61a3fff640 1 -- 172.21.15.62:0/2893069211 learned_addr learned my addr 172.21.15.62:0/2893069211 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:57.993 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.991+0000 7f61a8b52640 1 --2- 172.21.15.62:0/2893069211 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f61a41e2850 0x7f61a413ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:57.993 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.991+0000 7f61a37fe640 1 --2- 172.21.15.62:0/2893069211 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f61a4147ce0 0x7f61a41e2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:57.993 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.991+0000 7f61a3fff640 1 -- 172.21.15.62:0/2893069211 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f61a4147ce0 msgr2=0x7f61a41e2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:57.993 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.991+0000 7f61a3fff640 1 --2- 172.21.15.62:0/2893069211 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f61a4147ce0 0x7f61a41e2310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:57.993 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.991+0000 7f61a3fff640 1 -- 172.21.15.62:0/2893069211 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f61a41e2850 msgr2=0x7f61a413ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:57.993 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.991+0000 7f61a3fff640 1 --2- 172.21.15.62:0/2893069211 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f61a41e2850 0x7f61a413ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:57.993 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.991+0000 7f61a3fff640 1 -- 172.21.15.62:0/2893069211 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61a4148160 con 0x7f6188004d10 2023-10-08T12:00:57.993 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.991+0000 7f61a8b52640 1 --2- 172.21.15.62:0/2893069211 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f61a41e2850 0x7f61a413ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:00:57.993 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.991+0000 7f61a3fff640 1 --2- 172.21.15.62:0/2893069211 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6188004d10 0x7f61a41e5430 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f6194000fc0 tx=0x7f6194003a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:57.993 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.991+0000 7f61a0ff9640 1 -- 172.21.15.62:0/2893069211 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6194011900 con 0x7f6188004d10 2023-10-08T12:00:57.994 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.991+0000 7f61a0ff9640 1 -- 172.21.15.62:0/2893069211 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6194011a60 con 0x7f6188004d10 2023-10-08T12:00:57.994 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.991+0000 7f61aa5b5640 1 -- 172.21.15.62:0/2893069211 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61a41e5ae0 con 0x7f6188004d10 2023-10-08T12:00:57.994 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.991+0000 7f61a0ff9640 1 -- 172.21.15.62:0/2893069211 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6194011e10 con 0x7f6188004d10 2023-10-08T12:00:57.994 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.991+0000 7f61aa5b5640 1 -- 172.21.15.62:0/2893069211 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61a41e60a0 con 0x7f6188004d10 2023-10-08T12:00:57.994 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.991+0000 7f61aa5b5640 1 -- 172.21.15.62:0/2893069211 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61a41e2030 con 0x7f6188004d10 2023-10-08T12:00:57.995 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.991+0000 7f61a0ff9640 1 -- 172.21.15.62:0/2893069211 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f619400f430 con 0x7f6188004d10 2023-10-08T12:00:57.995 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.991+0000 7f61a0ff9640 1 --2- 172.21.15.62:0/2893069211 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f618c066470 0x7f618c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:57.995 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.991+0000 7f61a0ff9640 1 -- 172.21.15.62:0/2893069211 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f6194084a40 con 0x7f6188004d10 2023-10-08T12:00:57.995 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.991+0000 7f61a37fe640 1 --2- 172.21.15.62:0/2893069211 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f618c066470 0x7f618c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:57.995 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.995+0000 7f61a37fe640 1 --2- 172.21.15.62:0/2893069211 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f618c066470 0x7f618c068930 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f61a40b9c40 tx=0x7f61900091e0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:57.997 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:57.995+0000 7f61a0ff9640 1 -- 172.21.15.62:0/2893069211 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f61a41e2030 con 0x7f6188004d10 2023-10-08T12:00:58.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:58.155+0000 7f61aa5b5640 1 -- 172.21.15.62:0/2893069211 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f61a41e2030 con 0x7f6188004d10 2023-10-08T12:00:58.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:58.823+0000 7f61a0ff9640 1 -- 172.21.15.62:0/2893069211 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v28) v1 ==== 170+0+0 (secure 0 0 0) 0x7f61a41e2030 con 0x7f6188004d10 2023-10-08T12:00:58.825 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_data' created 2023-10-08T12:00:58.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:58.827+0000 7f61aa5b5640 1 -- 172.21.15.62:0/2893069211 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f618c066470 msgr2=0x7f618c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:58.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:58.827+0000 7f61aa5b5640 1 --2- 172.21.15.62:0/2893069211 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f618c066470 0x7f618c068930 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f61a40b9c40 tx=0x7f61900091e0 comp rx=0 tx=0).stop 2023-10-08T12:00:58.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:58.827+0000 7f61aa5b5640 1 -- 172.21.15.62:0/2893069211 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6188004d10 msgr2=0x7f61a41e5430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:58.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:58.827+0000 7f61aa5b5640 1 --2- 172.21.15.62:0/2893069211 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6188004d10 0x7f61a41e5430 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f6194000fc0 tx=0x7f6194003a90 comp rx=0 tx=0).stop 2023-10-08T12:00:58.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:58.827+0000 7f61aa5b5640 1 -- 172.21.15.62:0/2893069211 shutdown_connections 2023-10-08T12:00:58.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:58.827+0000 7f61aa5b5640 1 --2- 172.21.15.62:0/2893069211 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f618c066470 0x7f618c068930 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:58.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:58.827+0000 7f61aa5b5640 1 --2- 172.21.15.62:0/2893069211 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f61a4147ce0 0x7f61a41e2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:58.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:58.827+0000 7f61aa5b5640 1 --2- 172.21.15.62:0/2893069211 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f61a41e2850 0x7f61a413ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:58.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:58.827+0000 7f61aa5b5640 1 --2- 172.21.15.62:0/2893069211 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6188004d10 0x7f61a41e5430 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:58.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:58.827+0000 7f61aa5b5640 1 -- 172.21.15.62:0/2893069211 >> 172.21.15.62:0/2893069211 conn(0x7f61a40a0540 msgr2=0x7f61a413ee40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:58.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:58.827+0000 7f61aa5b5640 1 -- 172.21.15.62:0/2893069211 shutdown_connections 2023-10-08T12:00:58.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:58.827+0000 7f61aa5b5640 1 -- 172.21.15.62:0/2893069211 wait complete. 2023-10-08T12:00:58.867 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-08T12:00:58.996 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:58.994+0000 7f58eb5bb640 1 -- 172.21.15.62:0/3888713725 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58d00047d0 msgr2=0x7f58d0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:58.996 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:58.994+0000 7f58eb5bb640 1 --2- 172.21.15.62:0/3888713725 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58d00047d0 0x7f58d0004c50 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f58d4006fb0 tx=0x7f58d401cfa0 comp rx=0 tx=0).stop 2023-10-08T12:00:58.996 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:58.994+0000 7f58eb5bb640 1 -- 172.21.15.62:0/3888713725 shutdown_connections 2023-10-08T12:00:58.996 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:58.994+0000 7f58eb5bb640 1 --2- 172.21.15.62:0/3888713725 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58d00047d0 0x7f58d0004c50 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:58.996 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:58.994+0000 7f58eb5bb640 1 -- 172.21.15.62:0/3888713725 >> 172.21.15.62:0/3888713725 conn(0x7f58e409c520 msgr2=0x7f58e409c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:58.997 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:58.994+0000 7f58eb5bb640 1 -- 172.21.15.62:0/3888713725 shutdown_connections 2023-10-08T12:00:58.997 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:58.994+0000 7f58eb5bb640 1 -- 172.21.15.62:0/3888713725 wait complete. 2023-10-08T12:00:58.997 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:58.994+0000 7f58eb5bb640 1 Processor -- start 2023-10-08T12:00:58.997 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:58.994+0000 7f58eb5bb640 1 -- start start 2023-10-08T12:00:58.999 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:58.998+0000 7f58eb5bb640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f58d00047d0 0x7f58e41d6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:58.999 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:58.998+0000 7f58eb5bb640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f58e40b3d00 0x7f58e40b4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:58.999 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:58.998+0000 7f58eb5bb640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58e4148900 0x7f58e4148d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:58.999 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:58.998+0000 7f58eb5bb640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58e40b29b0 con 0x7f58e4148900 2023-10-08T12:00:59.000 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:58.998+0000 7f58eb5bb640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58e41d6bd0 con 0x7f58d00047d0 2023-10-08T12:00:59.000 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:58.998+0000 7f58eb5bb640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58e40b4bb0 con 0x7f58e40b3d00 2023-10-08T12:00:59.000 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:58.998+0000 7f58e9b58640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58e4148900 0x7f58e4148d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:59.000 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:58.998+0000 7f58e9b58640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58e4148900 0x7f58e4148d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46290/0 (socket says 172.21.15.62:46290) 2023-10-08T12:00:59.000 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:58.998+0000 7f58e9b58640 1 -- 172.21.15.62:0/2272102696 learned_addr learned my addr 172.21.15.62:0/2272102696 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:00:59.000 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:58.998+0000 7f58e8b56640 1 --2- 172.21.15.62:0/2272102696 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f58e40b3d00 0x7f58e40b4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:59.000 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:58.998+0000 7f58e9357640 1 --2- 172.21.15.62:0/2272102696 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f58d00047d0 0x7f58e41d6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:59.000 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:58.998+0000 7f58e9b58640 1 -- 172.21.15.62:0/2272102696 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f58e40b3d00 msgr2=0x7f58e40b4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:59.000 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:58.998+0000 7f58e9b58640 1 --2- 172.21.15.62:0/2272102696 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f58e40b3d00 0x7f58e40b4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:59.000 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:58.998+0000 7f58e9b58640 1 -- 172.21.15.62:0/2272102696 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f58d00047d0 msgr2=0x7f58e41d6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:59.000 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:58.998+0000 7f58e9b58640 1 --2- 172.21.15.62:0/2272102696 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f58d00047d0 0x7f58e41d6690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:59.000 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:58.998+0000 7f58e9b58640 1 -- 172.21.15.62:0/2272102696 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58e40b38e0 con 0x7f58e4148900 2023-10-08T12:00:59.001 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:58.998+0000 7f58e9b58640 1 --2- 172.21.15.62:0/2272102696 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58e4148900 0x7f58e4148d60 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f58e40b6fb0 tx=0x7f58dc00fed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:59.001 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:58.998+0000 7f58d9ffb640 1 -- 172.21.15.62:0/2272102696 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58dc003e50 con 0x7f58e4148900 2023-10-08T12:00:59.001 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:58.998+0000 7f58d9ffb640 1 -- 172.21.15.62:0/2272102696 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f58dc004c20 con 0x7f58e4148900 2023-10-08T12:00:59.001 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:58.998+0000 7f58d9ffb640 1 -- 172.21.15.62:0/2272102696 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58dc00d870 con 0x7f58e4148900 2023-10-08T12:00:59.001 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:58.998+0000 7f58eb5bb640 1 -- 172.21.15.62:0/2272102696 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58e40b4eb0 con 0x7f58e4148900 2023-10-08T12:00:59.001 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:58.998+0000 7f58eb5bb640 1 -- 172.21.15.62:0/2272102696 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58e409f130 con 0x7f58e4148900 2023-10-08T12:00:59.002 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:58.998+0000 7f58eb5bb640 1 -- 172.21.15.62:0/2272102696 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58e409f690 con 0x7f58e4148900 2023-10-08T12:00:59.002 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:58.998+0000 7f58d9ffb640 1 -- 172.21.15.62:0/2272102696 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f58dc019070 con 0x7f58e4148900 2023-10-08T12:00:59.002 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:58.998+0000 7f58d9ffb640 1 --2- 172.21.15.62:0/2272102696 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f58c8066460 0x7f58c8068920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:00:59.002 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:58.998+0000 7f58d9ffb640 1 -- 172.21.15.62:0/2272102696 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f58dc084690 con 0x7f58e4148900 2023-10-08T12:00:59.002 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:59.002+0000 7f58e9357640 1 --2- 172.21.15.62:0/2272102696 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f58c8066460 0x7f58c8068920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:00:59.002 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:59.002+0000 7f58e9357640 1 --2- 172.21.15.62:0/2272102696 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f58c8066460 0x7f58c8068920 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f58e0000c10 tx=0x7f58e00060f0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:00:59.006 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:59.006+0000 7f58d9ffb640 1 -- 172.21.15.62:0/2272102696 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f58e409f690 con 0x7f58e4148900 2023-10-08T12:00:59.196 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:59.194+0000 7f58eb5bb640 1 -- 172.21.15.62:0/2272102696 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f58e409f690 con 0x7f58e4148900 2023-10-08T12:00:59.531 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2023-10-08T12:00:59.531 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-10-08T12:00:59.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:59.854+0000 7f58d9ffb640 1 -- 172.21.15.62:0/2272102696 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7f58e409f690 con 0x7f58e4148900 2023-10-08T12:00:59.856 INFO:teuthology.orchestra.run.smithi062.stderr:new fs with metadata pool 4 and data pool 5 2023-10-08T12:00:59.859 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:59.858+0000 7f58eb5bb640 1 -- 172.21.15.62:0/2272102696 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f58c8066460 msgr2=0x7f58c8068920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:59.859 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:59.858+0000 7f58eb5bb640 1 --2- 172.21.15.62:0/2272102696 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f58c8066460 0x7f58c8068920 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f58e0000c10 tx=0x7f58e00060f0 comp rx=0 tx=0).stop 2023-10-08T12:00:59.859 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:59.858+0000 7f58eb5bb640 1 -- 172.21.15.62:0/2272102696 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58e4148900 msgr2=0x7f58e4148d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:00:59.859 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:59.858+0000 7f58eb5bb640 1 --2- 172.21.15.62:0/2272102696 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58e4148900 0x7f58e4148d60 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f58e40b6fb0 tx=0x7f58dc00fed0 comp rx=0 tx=0).stop 2023-10-08T12:00:59.860 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:59.858+0000 7f58eb5bb640 1 -- 172.21.15.62:0/2272102696 shutdown_connections 2023-10-08T12:00:59.860 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:59.858+0000 7f58eb5bb640 1 --2- 172.21.15.62:0/2272102696 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f58c8066460 0x7f58c8068920 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:59.860 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:59.858+0000 7f58eb5bb640 1 --2- 172.21.15.62:0/2272102696 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f58e40b3d00 0x7f58e40b4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:59.860 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:59.858+0000 7f58eb5bb640 1 --2- 172.21.15.62:0/2272102696 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58e4148900 0x7f58e4148d60 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:59.860 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:59.858+0000 7f58eb5bb640 1 --2- 172.21.15.62:0/2272102696 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f58d00047d0 0x7f58e41d6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:00:59.860 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:59.858+0000 7f58eb5bb640 1 -- 172.21.15.62:0/2272102696 >> 172.21.15.62:0/2272102696 conn(0x7f58e409c520 msgr2=0x7f58e40b0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:00:59.860 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:59.858+0000 7f58eb5bb640 1 -- 172.21.15.62:0/2272102696 shutdown_connections 2023-10-08T12:00:59.860 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:00:59.858+0000 7f58eb5bb640 1 -- 172.21.15.62:0/2272102696 wait complete. 2023-10-08T12:00:59.886 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:01:00.011 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.010+0000 7efe33c28640 1 -- 172.21.15.62:0/3241424918 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe180047d0 msgr2=0x7efe18004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:01:00.011 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.010+0000 7efe33c28640 1 --2- 172.21.15.62:0/3241424918 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe180047d0 0x7efe18004c50 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7efe280016b0 tx=0x7efe2801c780 comp rx=0 tx=0).stop 2023-10-08T12:01:00.011 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.010+0000 7efe33c28640 1 -- 172.21.15.62:0/3241424918 shutdown_connections 2023-10-08T12:01:00.011 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.010+0000 7efe33c28640 1 --2- 172.21.15.62:0/3241424918 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe180047d0 0x7efe18004c50 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:00.011 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.010+0000 7efe33c28640 1 -- 172.21.15.62:0/3241424918 >> 172.21.15.62:0/3241424918 conn(0x7efe2c09c520 msgr2=0x7efe2c09c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:01:00.011 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.010+0000 7efe33c28640 1 -- 172.21.15.62:0/3241424918 shutdown_connections 2023-10-08T12:01:00.011 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.010+0000 7efe33c28640 1 -- 172.21.15.62:0/3241424918 wait complete. 2023-10-08T12:01:00.012 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.010+0000 7efe33c28640 1 Processor -- start 2023-10-08T12:01:00.012 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.010+0000 7efe33c28640 1 -- start start 2023-10-08T12:01:00.014 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.010+0000 7efe33c28640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe180047d0 0x7efe2c140dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:01:00.014 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.010+0000 7efe33c28640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efe2c140600 0x7efe2c0b20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:01:00.014 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.010+0000 7efe33c28640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efe2c0b4060 0x7efe2c0b4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:01:00.014 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.010+0000 7efe33c28640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe2c141310 con 0x7efe180047d0 2023-10-08T12:01:00.015 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.010+0000 7efe33c28640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe2c0b25e0 con 0x7efe2c0b4060 2023-10-08T12:01:00.015 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.010+0000 7efe33c28640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe2c13f2c0 con 0x7efe2c140600 2023-10-08T12:01:00.015 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.010+0000 7efe319c4640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe180047d0 0x7efe2c140dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:01:00.015 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.010+0000 7efe319c4640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe180047d0 0x7efe2c140dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46300/0 (socket says 172.21.15.62:46300) 2023-10-08T12:01:00.015 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.010+0000 7efe319c4640 1 -- 172.21.15.62:0/2105276878 learned_addr learned my addr 172.21.15.62:0/2105276878 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:01:00.015 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.010+0000 7efe311c3640 1 --2- 172.21.15.62:0/2105276878 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efe2c140600 0x7efe2c0b20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:01:00.015 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.010+0000 7efe321c5640 1 --2- 172.21.15.62:0/2105276878 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efe2c0b4060 0x7efe2c0b4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:01:00.015 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.014+0000 7efe319c4640 1 -- 172.21.15.62:0/2105276878 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efe2c140600 msgr2=0x7efe2c0b20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:01:00.015 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.014+0000 7efe319c4640 1 --2- 172.21.15.62:0/2105276878 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efe2c140600 0x7efe2c0b20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:00.015 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.014+0000 7efe319c4640 1 -- 172.21.15.62:0/2105276878 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efe2c0b4060 msgr2=0x7efe2c0b4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:01:00.015 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.014+0000 7efe319c4640 1 --2- 172.21.15.62:0/2105276878 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efe2c0b4060 0x7efe2c0b4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:00.015 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.014+0000 7efe319c4640 1 -- 172.21.15.62:0/2105276878 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe2c13f5a0 con 0x7efe180047d0 2023-10-08T12:01:00.016 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.014+0000 7efe319c4640 1 --2- 172.21.15.62:0/2105276878 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe180047d0 0x7efe2c140dd0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7efe1c00fa00 tx=0x7efe1c00fec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:01:00.016 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.014+0000 7efe227fc640 1 -- 172.21.15.62:0/2105276878 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe1c00bcb0 con 0x7efe180047d0 2023-10-08T12:01:00.016 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.014+0000 7efe227fc640 1 -- 172.21.15.62:0/2105276878 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7efe1c004030 con 0x7efe180047d0 2023-10-08T12:01:00.016 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.014+0000 7efe227fc640 1 -- 172.21.15.62:0/2105276878 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe1c004420 con 0x7efe180047d0 2023-10-08T12:01:00.016 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.014+0000 7efe33c28640 1 -- 172.21.15.62:0/2105276878 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe2c13f880 con 0x7efe180047d0 2023-10-08T12:01:00.016 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.014+0000 7efe33c28640 1 -- 172.21.15.62:0/2105276878 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe2c0b2890 con 0x7efe180047d0 2023-10-08T12:01:00.017 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.014+0000 7efe33c28640 1 -- 172.21.15.62:0/2105276878 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe2c04da80 con 0x7efe180047d0 2023-10-08T12:01:00.017 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.014+0000 7efe227fc640 1 -- 172.21.15.62:0/2105276878 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7efe1c003600 con 0x7efe180047d0 2023-10-08T12:01:00.017 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.014+0000 7efe227fc640 1 --2- 172.21.15.62:0/2105276878 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7efe10066470 0x7efe10068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:01:00.017 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.014+0000 7efe227fc640 1 -- 172.21.15.62:0/2105276878 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efe1c0849c0 con 0x7efe180047d0 2023-10-08T12:01:00.017 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.014+0000 7efe311c3640 1 --2- 172.21.15.62:0/2105276878 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7efe10066470 0x7efe10068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:01:00.017 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.014+0000 7efe311c3640 1 --2- 172.21.15.62:0/2105276878 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7efe10066470 0x7efe10068930 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7efe28001680 tx=0x7efe28019520 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:01:00.020 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.018+0000 7efe227fc640 1 -- 172.21.15.62:0/2105276878 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7efe1c051ef0 con 0x7efe180047d0 2023-10-08T12:01:00.178 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.178+0000 7efe33c28640 1 -- 172.21.15.62:0/2105276878 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efe2c1409e0 con 0x7efe180047d0 2023-10-08T12:01:00.179 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.178+0000 7efe227fc640 1 -- 172.21.15.62:0/2105276878 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+16558 (secure 0 0 0) 0x7efe1c020020 con 0x7efe180047d0 2023-10-08T12:01:00.180 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T12:01:00.180 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":29,"fsid":"3e777930-c2c1-4f2b-a903-c07ee4ca2c52","created":"2023-10-08T11:59:54.510229+0000","modified":"2023-10-08T12:00:59.197763+0000","last_up_change":"2023-10-08T12:00:06.783998+0000","last_in_change":"2023-10-08T11:59:57.847944+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:00:07.189433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:00:57.515935+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-08T12:00:58.196426+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7bc3070a-7240-43d9-9ec3-397b68a37e2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6820","nonce":2227876905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6824","nonce":2227876905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6831","nonce":2227876905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6828","nonce":2227876905}]},"public_addr":"172.21.15.62:6820/2227876905","cluster_addr":"172.21.15.62:6824/2227876905","heartbeat_back_addr":"172.21.15.62:6831/2227876905","heartbeat_front_addr":"172.21.15.62:6828/2227876905","state":["exists","up"]},{"osd":1,"uuid":"5e0fa1f5-9ddc-4882-b460-5578bb571003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6801","nonce":315660906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6803","nonce":315660906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6808","nonce":315660906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6805","nonce":315660906}]},"public_addr":"172.21.15.62:6801/315660906","cluster_addr":"172.21.15.62:6803/315660906","heartbeat_back_addr":"172.21.15.62:6808/315660906","heartbeat_front_addr":"172.21.15.62:6805/315660906","state":["exists","up"]},{"osd":2,"uuid":"262b5ee9-4243-4309-a14f-88ad4e8bf812","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6807","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6809","nonce":3784842938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6811","nonce":3784842938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6815","nonce":3784842938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6813","nonce":3784842938}]},"public_addr":"172.21.15.62:6809/3784842938","cluster_addr":"172.21.15.62:6811/3784842938","heartbeat_back_addr":"172.21.15.62:6815/3784842938","heartbeat_front_addr":"172.21.15.62:6813/3784842938","state":["exists","up"]},{"osd":3,"uuid":"1770bdb8-c12b-43b1-aaab-1d6b6fd18f4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6817","nonce":3385303160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6821","nonce":3385303160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6827","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6829","nonce":3385303160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6823","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6825","nonce":3385303160}]},"public_addr":"172.21.15.62:6817/3385303160","cluster_addr":"172.21.15.62:6821/3385303160","heartbeat_back_addr":"172.21.15.62:6829/3385303160","heartbeat_front_addr":"172.21.15.62:6825/3385303160","state":["exists","up"]},{"osd":4,"uuid":"74c73631-9351-494a-8246-28ee86e9f862","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6807","nonce":1174056987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6809","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6811","nonce":1174056987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6820","nonce":1174056987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6813","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6816","nonce":1174056987}]},"public_addr":"172.21.15.130:6807/1174056987","cluster_addr":"172.21.15.130:6811/1174056987","heartbeat_back_addr":"172.21.15.130:6820/1174056987","heartbeat_front_addr":"172.21.15.130:6816/1174056987","state":["exists","up"]},{"osd":5,"uuid":"1040f389-272c-41d6-ae76-70c04d09afa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6801","nonce":561928414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6803","nonce":561928414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6815","nonce":561928414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6808","nonce":561928414}]},"public_addr":"172.21.15.130:6801/561928414","cluster_addr":"172.21.15.130:6803/561928414","heartbeat_back_addr":"172.21.15.130:6815/561928414","heartbeat_front_addr":"172.21.15.130:6808/561928414","state":["exists","up"]},{"osd":6,"uuid":"178553eb-03e1-4ab8-9826-4f5997e6da0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6810","nonce":2877303015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6817","nonce":2877303015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6823","nonce":2877303015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6819","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6821","nonce":2877303015}]},"public_addr":"172.21.15.130:6810/2877303015","cluster_addr":"172.21.15.130:6817/2877303015","heartbeat_back_addr":"172.21.15.130:6823/2877303015","heartbeat_front_addr":"172.21.15.130:6821/2877303015","state":["exists","up"]},{"osd":7,"uuid":"b6581c8f-30b1-4dfd-b7b6-94b579128835","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6825","nonce":680009774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6827","nonce":680009774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6831","nonce":680009774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6829","nonce":680009774}]},"public_addr":"172.21.15.130:6825/680009774","cluster_addr":"172.21.15.130:6827/680009774","heartbeat_back_addr":"172.21.15.130:6831/680009774","heartbeat_front_addr":"172.21.15.130:6829/680009774","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.505543+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.394383+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.456652+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.529168+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.235414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.392158+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.347556+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.432039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:01:00.182 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.182+0000 7efe33c28640 1 -- 172.21.15.62:0/2105276878 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7efe10066470 msgr2=0x7efe10068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:01:00.182 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.182+0000 7efe33c28640 1 --2- 172.21.15.62:0/2105276878 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7efe10066470 0x7efe10068930 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7efe28001680 tx=0x7efe28019520 comp rx=0 tx=0).stop 2023-10-08T12:01:00.182 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.182+0000 7efe33c28640 1 -- 172.21.15.62:0/2105276878 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe180047d0 msgr2=0x7efe2c140dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:01:00.182 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.182+0000 7efe33c28640 1 --2- 172.21.15.62:0/2105276878 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe180047d0 0x7efe2c140dd0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7efe1c00fa00 tx=0x7efe1c00fec0 comp rx=0 tx=0).stop 2023-10-08T12:01:00.183 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.182+0000 7efe33c28640 1 -- 172.21.15.62:0/2105276878 shutdown_connections 2023-10-08T12:01:00.183 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.182+0000 7efe33c28640 1 --2- 172.21.15.62:0/2105276878 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7efe10066470 0x7efe10068930 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:00.183 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.182+0000 7efe33c28640 1 --2- 172.21.15.62:0/2105276878 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efe2c140600 0x7efe2c0b20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:00.183 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.182+0000 7efe33c28640 1 --2- 172.21.15.62:0/2105276878 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efe2c0b4060 0x7efe2c0b4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:00.183 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.182+0000 7efe33c28640 1 --2- 172.21.15.62:0/2105276878 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe180047d0 0x7efe2c140dd0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:00.183 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.182+0000 7efe33c28640 1 -- 172.21.15.62:0/2105276878 >> 172.21.15.62:0/2105276878 conn(0x7efe2c09c520 msgr2=0x7efe2c149290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:01:00.183 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.182+0000 7efe33c28640 1 -- 172.21.15.62:0/2105276878 shutdown_connections 2023-10-08T12:01:00.183 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.182+0000 7efe33c28640 1 -- 172.21.15.62:0/2105276878 wait complete. 2023-10-08T12:01:00.201 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:01:00.328 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.326+0000 7fe207c9f640 1 -- 172.21.15.62:0/2414343820 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2000699f0 msgr2=0x7fe2000b1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:01:00.328 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.326+0000 7fe207c9f640 1 --2- 172.21.15.62:0/2414343820 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2000699f0 0x7fe2000b1570 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc009840 tx=0x7fe1fc01c800 comp rx=0 tx=0).stop 2023-10-08T12:01:00.328 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.326+0000 7fe207c9f640 1 -- 172.21.15.62:0/2414343820 shutdown_connections 2023-10-08T12:01:00.328 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.326+0000 7fe207c9f640 1 --2- 172.21.15.62:0/2414343820 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2000699f0 0x7fe2000b1570 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:00.328 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.326+0000 7fe207c9f640 1 -- 172.21.15.62:0/2414343820 >> 172.21.15.62:0/2414343820 conn(0x7fe2000b82f0 msgr2=0x7fe2000b8700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:01:00.328 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.326+0000 7fe207c9f640 1 -- 172.21.15.62:0/2414343820 shutdown_connections 2023-10-08T12:01:00.329 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.326+0000 7fe207c9f640 1 -- 172.21.15.62:0/2414343820 wait complete. 2023-10-08T12:01:00.329 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.326+0000 7fe207c9f640 1 Processor -- start 2023-10-08T12:01:00.329 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.326+0000 7fe207c9f640 1 -- start start 2023-10-08T12:01:00.331 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.330+0000 7fe207c9f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2000699f0 0x7fe200149f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:01:00.331 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.330+0000 7fe207c9f640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe2000b1ab0 0x7fe2001e32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:01:00.331 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.330+0000 7fe207c9f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe20014b180 0x7fe2000b3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:01:00.332 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.330+0000 7fe207c9f640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2000b3680 con 0x7fe2000699f0 2023-10-08T12:01:00.332 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.330+0000 7fe207c9f640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2001e3810 con 0x7fe20014b180 2023-10-08T12:01:00.332 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.330+0000 7fe207c9f640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2000b49d0 con 0x7fe2000b1ab0 2023-10-08T12:01:00.332 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.330+0000 7fe205a3b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2000699f0 0x7fe200149f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:01:00.332 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.330+0000 7fe205a3b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2000699f0 0x7fe200149f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46318/0 (socket says 172.21.15.62:46318) 2023-10-08T12:01:00.332 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.330+0000 7fe205a3b640 1 -- 172.21.15.62:0/1479678003 learned_addr learned my addr 172.21.15.62:0/1479678003 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:01:00.332 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.330+0000 7fe205a3b640 1 -- 172.21.15.62:0/1479678003 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe2000b1ab0 msgr2=0x7fe2001e32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:01:00.332 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.330+0000 7fe20623c640 1 --2- 172.21.15.62:0/1479678003 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe20014b180 0x7fe2000b3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:01:00.332 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.330+0000 7fe20523a640 1 --2- 172.21.15.62:0/1479678003 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe2000b1ab0 0x7fe2001e32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:01:00.332 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.330+0000 7fe205a3b640 1 --2- 172.21.15.62:0/1479678003 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe2000b1ab0 0x7fe2001e32d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:00.332 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.330+0000 7fe205a3b640 1 -- 172.21.15.62:0/1479678003 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe20014b180 msgr2=0x7fe2000b3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:01:00.333 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.330+0000 7fe205a3b640 1 --2- 172.21.15.62:0/1479678003 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe20014b180 0x7fe2000b3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:00.333 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.330+0000 7fe205a3b640 1 -- 172.21.15.62:0/1479678003 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1fc0094a0 con 0x7fe2000699f0 2023-10-08T12:01:00.333 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.330+0000 7fe20623c640 1 --2- 172.21.15.62:0/1479678003 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe20014b180 0x7fe2000b3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:01:00.333 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.330+0000 7fe205a3b640 1 --2- 172.21.15.62:0/1479678003 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2000699f0 0x7fe200149f30 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc009790 tx=0x7fe1fc0a5720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:01:00.333 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.330+0000 7fe1f27fc640 1 -- 172.21.15.62:0/1479678003 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1fc0042c0 con 0x7fe2000699f0 2023-10-08T12:01:00.333 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.330+0000 7fe1f27fc640 1 -- 172.21.15.62:0/1479678003 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe1fc004510 con 0x7fe2000699f0 2023-10-08T12:01:00.333 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.330+0000 7fe1f27fc640 1 -- 172.21.15.62:0/1479678003 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1fc005280 con 0x7fe2000699f0 2023-10-08T12:01:00.333 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.330+0000 7fe207c9f640 1 -- 172.21.15.62:0/1479678003 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2000b5020 con 0x7fe2000699f0 2023-10-08T12:01:00.333 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.330+0000 7fe207c9f640 1 -- 172.21.15.62:0/1479678003 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2000b3920 con 0x7fe2000699f0 2023-10-08T12:01:00.334 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.330+0000 7fe207c9f640 1 -- 172.21.15.62:0/1479678003 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2000b4e80 con 0x7fe2000699f0 2023-10-08T12:01:00.334 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.330+0000 7fe1f27fc640 1 -- 172.21.15.62:0/1479678003 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe1fc0b4040 con 0x7fe2000699f0 2023-10-08T12:01:00.334 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.330+0000 7fe1f27fc640 1 --2- 172.21.15.62:0/1479678003 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fe1e4066470 0x7fe1e4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:01:00.334 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.330+0000 7fe1f27fc640 1 -- 172.21.15.62:0/1479678003 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe1fc11dcf0 con 0x7fe2000699f0 2023-10-08T12:01:00.334 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.330+0000 7fe20523a640 1 --2- 172.21.15.62:0/1479678003 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fe1e4066470 0x7fe1e4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:01:00.335 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.334+0000 7fe20523a640 1 --2- 172.21.15.62:0/1479678003 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fe1e4066470 0x7fe1e4068930 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe2000b3e20 tx=0x7fe1f4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:01:00.337 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.334+0000 7fe1f27fc640 1 -- 172.21.15.62:0/1479678003 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe2000b4e80 con 0x7fe2000699f0 2023-10-08T12:01:00.500 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.498+0000 7fe207c9f640 1 -- 172.21.15.62:0/1479678003 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe2000b4e80 con 0x7fe2000699f0 2023-10-08T12:01:00.501 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.498+0000 7fe1f27fc640 1 -- 172.21.15.62:0/1479678003 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+16545 (secure 0 0 0) 0x7fe2000b4e80 con 0x7fe2000699f0 2023-10-08T12:01:00.502 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T12:01:00.502 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":30,"fsid":"3e777930-c2c1-4f2b-a903-c07ee4ca2c52","created":"2023-10-08T11:59:54.510229+0000","modified":"2023-10-08T12:01:00.265361+0000","last_up_change":"2023-10-08T12:00:06.783998+0000","last_in_change":"2023-10-08T11:59:57.847944+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:00:07.189433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:00:57.515935+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-08T12:00:58.196426+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7bc3070a-7240-43d9-9ec3-397b68a37e2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6820","nonce":2227876905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6824","nonce":2227876905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6831","nonce":2227876905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6828","nonce":2227876905}]},"public_addr":"172.21.15.62:6820/2227876905","cluster_addr":"172.21.15.62:6824/2227876905","heartbeat_back_addr":"172.21.15.62:6831/2227876905","heartbeat_front_addr":"172.21.15.62:6828/2227876905","state":["exists","up"]},{"osd":1,"uuid":"5e0fa1f5-9ddc-4882-b460-5578bb571003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6801","nonce":315660906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6803","nonce":315660906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6808","nonce":315660906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6805","nonce":315660906}]},"public_addr":"172.21.15.62:6801/315660906","cluster_addr":"172.21.15.62:6803/315660906","heartbeat_back_addr":"172.21.15.62:6808/315660906","heartbeat_front_addr":"172.21.15.62:6805/315660906","state":["exists","up"]},{"osd":2,"uuid":"262b5ee9-4243-4309-a14f-88ad4e8bf812","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6807","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6809","nonce":3784842938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6811","nonce":3784842938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6815","nonce":3784842938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6813","nonce":3784842938}]},"public_addr":"172.21.15.62:6809/3784842938","cluster_addr":"172.21.15.62:6811/3784842938","heartbeat_back_addr":"172.21.15.62:6815/3784842938","heartbeat_front_addr":"172.21.15.62:6813/3784842938","state":["exists","up"]},{"osd":3,"uuid":"1770bdb8-c12b-43b1-aaab-1d6b6fd18f4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6817","nonce":3385303160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6821","nonce":3385303160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6827","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6829","nonce":3385303160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6823","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6825","nonce":3385303160}]},"public_addr":"172.21.15.62:6817/3385303160","cluster_addr":"172.21.15.62:6821/3385303160","heartbeat_back_addr":"172.21.15.62:6829/3385303160","heartbeat_front_addr":"172.21.15.62:6825/3385303160","state":["exists","up"]},{"osd":4,"uuid":"74c73631-9351-494a-8246-28ee86e9f862","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6807","nonce":1174056987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6809","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6811","nonce":1174056987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6820","nonce":1174056987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6813","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6816","nonce":1174056987}]},"public_addr":"172.21.15.130:6807/1174056987","cluster_addr":"172.21.15.130:6811/1174056987","heartbeat_back_addr":"172.21.15.130:6820/1174056987","heartbeat_front_addr":"172.21.15.130:6816/1174056987","state":["exists","up"]},{"osd":5,"uuid":"1040f389-272c-41d6-ae76-70c04d09afa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6801","nonce":561928414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6803","nonce":561928414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6815","nonce":561928414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6808","nonce":561928414}]},"public_addr":"172.21.15.130:6801/561928414","cluster_addr":"172.21.15.130:6803/561928414","heartbeat_back_addr":"172.21.15.130:6815/561928414","heartbeat_front_addr":"172.21.15.130:6808/561928414","state":["exists","up"]},{"osd":6,"uuid":"178553eb-03e1-4ab8-9826-4f5997e6da0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6810","nonce":2877303015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6817","nonce":2877303015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6823","nonce":2877303015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6819","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6821","nonce":2877303015}]},"public_addr":"172.21.15.130:6810/2877303015","cluster_addr":"172.21.15.130:6817/2877303015","heartbeat_back_addr":"172.21.15.130:6823/2877303015","heartbeat_front_addr":"172.21.15.130:6821/2877303015","state":["exists","up"]},{"osd":7,"uuid":"b6581c8f-30b1-4dfd-b7b6-94b579128835","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6825","nonce":680009774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6827","nonce":680009774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6831","nonce":680009774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6829","nonce":680009774}]},"public_addr":"172.21.15.130:6825/680009774","cluster_addr":"172.21.15.130:6827/680009774","heartbeat_back_addr":"172.21.15.130:6831/680009774","heartbeat_front_addr":"172.21.15.130:6829/680009774","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.505543+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.394383+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.456652+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.529168+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.235414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.392158+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.347556+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.432039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:01:00.506 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.502+0000 7fe207c9f640 1 -- 172.21.15.62:0/1479678003 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fe1e4066470 msgr2=0x7fe1e4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:01:00.506 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.502+0000 7fe207c9f640 1 --2- 172.21.15.62:0/1479678003 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fe1e4066470 0x7fe1e4068930 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe2000b3e20 tx=0x7fe1f4009040 comp rx=0 tx=0).stop 2023-10-08T12:01:00.506 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.502+0000 7fe207c9f640 1 -- 172.21.15.62:0/1479678003 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2000699f0 msgr2=0x7fe200149f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:01:00.506 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.502+0000 7fe207c9f640 1 --2- 172.21.15.62:0/1479678003 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2000699f0 0x7fe200149f30 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc009790 tx=0x7fe1fc0a5720 comp rx=0 tx=0).stop 2023-10-08T12:01:00.506 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.502+0000 7fe207c9f640 1 -- 172.21.15.62:0/1479678003 shutdown_connections 2023-10-08T12:01:00.507 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.502+0000 7fe207c9f640 1 --2- 172.21.15.62:0/1479678003 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fe1e4066470 0x7fe1e4068930 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:00.507 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.502+0000 7fe207c9f640 1 --2- 172.21.15.62:0/1479678003 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe2000b1ab0 0x7fe2001e32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:00.507 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.502+0000 7fe207c9f640 1 --2- 172.21.15.62:0/1479678003 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe20014b180 0x7fe2000b3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:00.507 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.502+0000 7fe207c9f640 1 --2- 172.21.15.62:0/1479678003 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2000699f0 0x7fe200149f30 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:00.507 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.502+0000 7fe207c9f640 1 -- 172.21.15.62:0/1479678003 >> 172.21.15.62:0/1479678003 conn(0x7fe2000b82f0 msgr2=0x7fe20006a190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:01:00.507 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.502+0000 7fe207c9f640 1 -- 172.21.15.62:0/1479678003 shutdown_connections 2023-10-08T12:01:00.507 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.502+0000 7fe207c9f640 1 -- 172.21.15.62:0/1479678003 wait complete. 2023-10-08T12:01:00.522 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-08T12:01:00.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.654+0000 7f8da3c7a640 1 -- 172.21.15.62:0/1743348451 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d88004d10 msgr2=0x7f8d88005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:01:00.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.654+0000 7f8da3c7a640 1 --2- 172.21.15.62:0/1743348451 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d88004d10 0x7f8d88005190 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f8d9400c590 tx=0x7f8d9401d320 comp rx=0 tx=0).stop 2023-10-08T12:01:00.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.654+0000 7f8da2217640 1 -- 172.21.15.62:0/1743348451 reap_dead start 2023-10-08T12:01:00.656 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.654+0000 7f8da3c7a640 1 -- 172.21.15.62:0/1743348451 shutdown_connections 2023-10-08T12:01:00.656 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.654+0000 7f8da3c7a640 1 -- 172.21.15.62:0/1743348451 >> 172.21.15.62:0/1743348451 conn(0x7f8d9c0b82f0 msgr2=0x7f8d9c0b8700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:01:00.656 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.654+0000 7f8da3c7a640 1 -- 172.21.15.62:0/1743348451 shutdown_connections 2023-10-08T12:01:00.656 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.654+0000 7f8da3c7a640 1 -- 172.21.15.62:0/1743348451 wait complete. 2023-10-08T12:01:00.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.654+0000 7f8da3c7a640 1 Processor -- start 2023-10-08T12:01:00.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.654+0000 7f8da3c7a640 1 -- start start 2023-10-08T12:01:00.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.654+0000 7f8da3c7a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d9c09bd10 0x7f8d9c1e0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:01:00.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.654+0000 7f8da3c7a640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8d9c1dcca0 0x7f8d9c140c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:01:00.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.654+0000 7f8da3c7a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8d9c1411d0 0x7f8d9c0985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:01:00.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.654+0000 7f8da3c7a640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9c099b70 con 0x7f8d9c09bd10 2023-10-08T12:01:00.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.654+0000 7f8da3c7a640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9c0a1080 con 0x7f8d9c1411d0 2023-10-08T12:01:00.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.654+0000 7f8da3c7a640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9c1e1100 con 0x7f8d9c1dcca0 2023-10-08T12:01:00.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.654+0000 7f8da1a16640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d9c09bd10 0x7f8d9c1e0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:01:00.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.654+0000 7f8da1a16640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d9c09bd10 0x7f8d9c1e0bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46338/0 (socket says 172.21.15.62:46338) 2023-10-08T12:01:00.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.654+0000 7f8da1a16640 1 -- 172.21.15.62:0/1347144715 learned_addr learned my addr 172.21.15.62:0/1347144715 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:01:00.660 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.654+0000 7f8da1215640 1 --2- 172.21.15.62:0/1347144715 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8d9c1dcca0 0x7f8d9c140c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:01:00.660 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.654+0000 7f8da2217640 1 --2- 172.21.15.62:0/1347144715 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8d9c1411d0 0x7f8d9c0985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:01:00.660 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.654+0000 7f8da1a16640 1 -- 172.21.15.62:0/1347144715 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8d9c1dcca0 msgr2=0x7f8d9c140c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:01:00.660 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.654+0000 7f8da1a16640 1 --2- 172.21.15.62:0/1347144715 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8d9c1dcca0 0x7f8d9c140c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:00.660 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.654+0000 7f8da1a16640 1 -- 172.21.15.62:0/1347144715 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8d9c1411d0 msgr2=0x7f8d9c0985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:01:00.660 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.654+0000 7f8da1a16640 1 --2- 172.21.15.62:0/1347144715 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8d9c1411d0 0x7f8d9c0985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:00.661 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.654+0000 7f8da1a16640 1 -- 172.21.15.62:0/1347144715 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d9c0a12d0 con 0x7f8d9c09bd10 2023-10-08T12:01:00.661 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.654+0000 7f8da1215640 1 --2- 172.21.15.62:0/1347144715 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8d9c1dcca0 0x7f8d9c140c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:01:00.661 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.654+0000 7f8da1a16640 1 --2- 172.21.15.62:0/1347144715 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d9c09bd10 0x7f8d9c1e0bc0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c006fd0 tx=0x7f8d8c001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:01:00.661 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.654+0000 7f8d927fc640 1 -- 172.21.15.62:0/1347144715 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d8c011870 con 0x7f8d9c09bd10 2023-10-08T12:01:00.661 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.654+0000 7f8d927fc640 1 -- 172.21.15.62:0/1347144715 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8d8c011ac0 con 0x7f8d9c09bd10 2023-10-08T12:01:00.661 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.654+0000 7f8da3c7a640 1 -- 172.21.15.62:0/1347144715 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d9c1e03c0 con 0x7f8d9c09bd10 2023-10-08T12:01:00.661 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.654+0000 7f8d927fc640 1 -- 172.21.15.62:0/1347144715 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d8c001d50 con 0x7f8d9c09bd10 2023-10-08T12:01:00.661 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.654+0000 7f8da3c7a640 1 -- 172.21.15.62:0/1347144715 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d9c09c4e0 con 0x7f8d9c09bd10 2023-10-08T12:01:00.662 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.658+0000 7f8da3c7a640 1 -- 172.21.15.62:0/1347144715 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d9c1e0220 con 0x7f8d9c09bd10 2023-10-08T12:01:00.663 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.658+0000 7f8d927fc640 1 -- 172.21.15.62:0/1347144715 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8d8c01a400 con 0x7f8d9c09bd10 2023-10-08T12:01:00.663 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.658+0000 7f8d927fc640 1 --2- 172.21.15.62:0/1347144715 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f8d80066470 0x7f8d80068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:01:00.663 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.658+0000 7f8d927fc640 1 -- 172.21.15.62:0/1347144715 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8d8c084c40 con 0x7f8d9c09bd10 2023-10-08T12:01:00.663 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.658+0000 7f8da1215640 1 --2- 172.21.15.62:0/1347144715 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f8d80066470 0x7f8d80068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:01:00.663 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.658+0000 7f8da1215640 1 --2- 172.21.15.62:0/1347144715 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f8d80066470 0x7f8d80068930 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c0a1580 tx=0x7f8d980091e0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:01:00.664 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.662+0000 7f8d927fc640 1 -- 172.21.15.62:0/1347144715 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8d9c1e0220 con 0x7f8d9c09bd10 2023-10-08T12:01:00.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:00.854+0000 7f8da3c7a640 1 -- 172.21.15.62:0/1347144715 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f8d9c1e0220 con 0x7f8d9c09bd10 2023-10-08T12:01:01.870 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:01.870+0000 7f8d927fc640 1 -- 172.21.15.62:0/1347144715 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7f8d9c1e0220 con 0x7f8d9c09bd10 2023-10-08T12:01:01.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:01.870+0000 7f8da3c7a640 1 -- 172.21.15.62:0/1347144715 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f8d80066470 msgr2=0x7f8d80068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:01:01.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:01.870+0000 7f8da3c7a640 1 --2- 172.21.15.62:0/1347144715 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f8d80066470 0x7f8d80068930 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c0a1580 tx=0x7f8d980091e0 comp rx=0 tx=0).stop 2023-10-08T12:01:01.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:01.870+0000 7f8da3c7a640 1 -- 172.21.15.62:0/1347144715 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d9c09bd10 msgr2=0x7f8d9c1e0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:01:01.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:01.870+0000 7f8da3c7a640 1 --2- 172.21.15.62:0/1347144715 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d9c09bd10 0x7f8d9c1e0bc0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c006fd0 tx=0x7f8d8c001640 comp rx=0 tx=0).stop 2023-10-08T12:01:01.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:01.870+0000 7f8da3c7a640 1 -- 172.21.15.62:0/1347144715 shutdown_connections 2023-10-08T12:01:01.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:01.870+0000 7f8da3c7a640 1 --2- 172.21.15.62:0/1347144715 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f8d80066470 0x7f8d80068930 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:01.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:01.870+0000 7f8da3c7a640 1 --2- 172.21.15.62:0/1347144715 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8d9c1dcca0 0x7f8d9c140c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:01.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:01.870+0000 7f8da3c7a640 1 --2- 172.21.15.62:0/1347144715 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8d9c1411d0 0x7f8d9c0985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:01.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:01.870+0000 7f8da3c7a640 1 --2- 172.21.15.62:0/1347144715 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d9c09bd10 0x7f8d9c1e0bc0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:01.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:01.870+0000 7f8da3c7a640 1 -- 172.21.15.62:0/1347144715 >> 172.21.15.62:0/1347144715 conn(0x7f8d9c0b82f0 msgr2=0x7f8d9c06a020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:01:01.875 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:01.874+0000 7f8da3c7a640 1 -- 172.21.15.62:0/1347144715 shutdown_connections 2023-10-08T12:01:01.875 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:01.874+0000 7f8da3c7a640 1 -- 172.21.15.62:0/1347144715 wait complete. 2023-10-08T12:01:01.897 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-10-08T12:01:01.897 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-08T12:01:02.035 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:02.034+0000 7f04b5cde640 1 -- 172.21.15.62:0/3052573790 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f04b00b9260 msgr2=0x7f04b00b8570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:01:02.035 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:02.034+0000 7f04b5cde640 1 --2- 172.21.15.62:0/3052573790 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f04b00b9260 0x7f04b00b8570 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f04a0009840 tx=0x7f04a001c800 comp rx=0 tx=0).stop 2023-10-08T12:01:02.035 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:02.034+0000 7f04b5cde640 1 -- 172.21.15.62:0/3052573790 shutdown_connections 2023-10-08T12:01:02.035 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:02.034+0000 7f04b5cde640 1 --2- 172.21.15.62:0/3052573790 >> v2:172.21.15.130:3300/0 conn(0x7f04b0147920 0x7f04b00b6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:02.035 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:02.034+0000 7f04b5cde640 1 --2- 172.21.15.62:0/3052573790 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f04b00b9260 0x7f04b00b8570 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:02.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:02.034+0000 7f04b5cde640 1 -- 172.21.15.62:0/3052573790 >> 172.21.15.62:0/3052573790 conn(0x7f04b009c520 msgr2=0x7f04b009c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:01:02.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:02.034+0000 7f04b5cde640 1 -- 172.21.15.62:0/3052573790 shutdown_connections 2023-10-08T12:01:02.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:02.034+0000 7f04b5cde640 1 -- 172.21.15.62:0/3052573790 wait complete. 2023-10-08T12:01:02.044 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:02.034+0000 7f04b5cde640 1 Processor -- start 2023-10-08T12:01:02.044 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:02.034+0000 7f04b5cde640 1 -- start start 2023-10-08T12:01:02.044 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:02.034+0000 7f04b5cde640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f04b0071410 0x7f04b01459b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:01:02.044 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:02.034+0000 7f04b5cde640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f04b00b9260 0x7f04b01e1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:01:02.045 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:02.034+0000 7f04b5cde640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f04b0147920 0x7f04b014f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:01:02.045 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:02.034+0000 7f04b5cde640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b0145ef0 con 0x7f04b0147920 2023-10-08T12:01:02.046 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:02.034+0000 7f04b5cde640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b014af90 con 0x7f04b00b9260 2023-10-08T12:01:02.046 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:02.034+0000 7f04b5cde640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04b01e5b00 con 0x7f04b0071410 2023-10-08T12:01:02.046 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:02.034+0000 7f04affff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f04b0147920 0x7f04b014f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:01:02.046 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:02.034+0000 7f04affff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f04b0147920 0x7f04b014f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46344/0 (socket says 172.21.15.62:46344) 2023-10-08T12:01:02.046 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:02.034+0000 7f04affff640 1 -- 172.21.15.62:0/1681445051 learned_addr learned my addr 172.21.15.62:0/1681445051 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:01:02.046 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:02.034+0000 7f04af7fe640 1 --2- 172.21.15.62:0/1681445051 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f04b0071410 0x7f04b01459b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:01:02.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:02.034+0000 7f04aeffd640 1 --2- 172.21.15.62:0/1681445051 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f04b00b9260 0x7f04b01e1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:01:02.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:02.034+0000 7f04affff640 1 -- 172.21.15.62:0/1681445051 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f04b0071410 msgr2=0x7f04b01459b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:01:02.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:02.034+0000 7f04affff640 1 --2- 172.21.15.62:0/1681445051 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f04b0071410 0x7f04b01459b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:02.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:02.034+0000 7f04affff640 1 -- 172.21.15.62:0/1681445051 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f04b00b9260 msgr2=0x7f04b01e1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:01:02.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:02.034+0000 7f04affff640 1 --2- 172.21.15.62:0/1681445051 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f04b00b9260 0x7f04b01e1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:02.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:02.034+0000 7f04affff640 1 -- 172.21.15.62:0/1681445051 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04a00094a0 con 0x7f04b0147920 2023-10-08T12:01:02.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:02.034+0000 7f04af7fe640 1 --2- 172.21.15.62:0/1681445051 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f04b0071410 0x7f04b01459b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:01:02.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:02.034+0000 7f04affff640 1 --2- 172.21.15.62:0/1681445051 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f04b0147920 0x7f04b014f6f0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f04a800c790 tx=0x7f04a800cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:01:02.048 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:02.034+0000 7f0497fff640 1 -- 172.21.15.62:0/1681445051 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a800cea0 con 0x7f04b0147920 2023-10-08T12:01:02.048 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:02.034+0000 7f0497fff640 1 -- 172.21.15.62:0/1681445051 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f04a8003b80 con 0x7f04b0147920 2023-10-08T12:01:02.048 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:02.038+0000 7f04b5cde640 1 -- 172.21.15.62:0/1681445051 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04b014a890 con 0x7f04b0147920 2023-10-08T12:01:02.048 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:02.038+0000 7f0497fff640 1 -- 172.21.15.62:0/1681445051 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a800a850 con 0x7f04b0147920 2023-10-08T12:01:02.048 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:02.038+0000 7f04b5cde640 1 -- 172.21.15.62:0/1681445051 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04b01e5790 con 0x7f04b0147920 2023-10-08T12:01:02.048 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:02.038+0000 7f04b5cde640 1 -- 172.21.15.62:0/1681445051 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04b00b5be0 con 0x7f04b0147920 2023-10-08T12:01:02.048 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:02.038+0000 7f0497fff640 1 -- 172.21.15.62:0/1681445051 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f04a800a9b0 con 0x7f04b0147920 2023-10-08T12:01:02.049 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:02.038+0000 7f0497fff640 1 --2- 172.21.15.62:0/1681445051 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f049c0664a0 0x7f049c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:01:02.049 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:02.038+0000 7f0497fff640 1 -- 172.21.15.62:0/1681445051 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f04a8084820 con 0x7f04b0147920 2023-10-08T12:01:02.049 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:02.038+0000 7f04af7fe640 1 --2- 172.21.15.62:0/1681445051 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f049c0664a0 0x7f049c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:01:02.049 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:02.038+0000 7f04af7fe640 1 --2- 172.21.15.62:0/1681445051 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f049c0664a0 0x7f049c068960 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f04a00af000 tx=0x7f04a001b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:01:02.049 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:02.042+0000 7f0497fff640 1 -- 172.21.15.62:0/1681445051 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f04a8051e10 con 0x7f04b0147920 2023-10-08T12:01:02.232 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:02.230+0000 7f04b5cde640 1 -- 172.21.15.62:0/1681445051 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f04b004da80 con 0x7f04b0147920 2023-10-08T12:01:02.873 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:02.870+0000 7f0497fff640 1 -- 172.21.15.62:0/1681445051 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f04a80222e0 con 0x7f04b0147920 2023-10-08T12:01:02.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:02.874+0000 7f04b5cde640 1 -- 172.21.15.62:0/1681445051 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f049c0664a0 msgr2=0x7f049c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:01:02.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:02.874+0000 7f04b5cde640 1 --2- 172.21.15.62:0/1681445051 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f049c0664a0 0x7f049c068960 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f04a00af000 tx=0x7f04a001b040 comp rx=0 tx=0).stop 2023-10-08T12:01:02.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:02.874+0000 7f04b5cde640 1 -- 172.21.15.62:0/1681445051 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f04b0147920 msgr2=0x7f04b014f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:01:02.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:02.874+0000 7f04b5cde640 1 --2- 172.21.15.62:0/1681445051 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f04b0147920 0x7f04b014f6f0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f04a800c790 tx=0x7f04a800cc50 comp rx=0 tx=0).stop 2023-10-08T12:01:02.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:02.874+0000 7f04b5cde640 1 -- 172.21.15.62:0/1681445051 shutdown_connections 2023-10-08T12:01:02.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:02.874+0000 7f04b5cde640 1 --2- 172.21.15.62:0/1681445051 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f049c0664a0 0x7f049c068960 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:02.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:02.874+0000 7f04b5cde640 1 --2- 172.21.15.62:0/1681445051 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f04b0147920 0x7f04b014f6f0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:02.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:02.874+0000 7f04b5cde640 1 --2- 172.21.15.62:0/1681445051 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f04b00b9260 0x7f04b01e1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:02.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:02.874+0000 7f04b5cde640 1 --2- 172.21.15.62:0/1681445051 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f04b0071410 0x7f04b01459b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:02.877 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:02.874+0000 7f04b5cde640 1 -- 172.21.15.62:0/1681445051 >> 172.21.15.62:0/1681445051 conn(0x7f04b009c520 msgr2=0x7f04b0097f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:01:02.877 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:02.874+0000 7f04b5cde640 1 -- 172.21.15.62:0/1681445051 shutdown_connections 2023-10-08T12:01:02.877 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:02.874+0000 7f04b5cde640 1 -- 172.21.15.62:0/1681445051 wait complete. 2023-10-08T12:01:02.895 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-08T12:01:02.896 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:01:03.026 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.026+0000 7f268fdd8640 1 -- 172.21.15.62:0/3364976704 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26880bb140 msgr2=0x7f26880bbc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:01:03.026 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.026+0000 7f268fdd8640 1 --2- 172.21.15.62:0/3364976704 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26880bb140 0x7f26880bbc60 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f2678009900 tx=0x7f267801c850 comp rx=0 tx=0).stop 2023-10-08T12:01:03.027 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.026+0000 7f268fdd8640 1 -- 172.21.15.62:0/3364976704 shutdown_connections 2023-10-08T12:01:03.027 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.026+0000 7f268fdd8640 1 --2- 172.21.15.62:0/3364976704 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26880bb140 0x7f26880bbc60 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:03.027 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.026+0000 7f268fdd8640 1 --2- 172.21.15.62:0/3364976704 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f26880b8630 0x7f26880ba590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:03.027 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.026+0000 7f268fdd8640 1 -- 172.21.15.62:0/3364976704 >> 172.21.15.62:0/3364976704 conn(0x7f268809e540 msgr2=0x7f268809e950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:01:03.027 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.026+0000 7f268fdd8640 1 -- 172.21.15.62:0/3364976704 shutdown_connections 2023-10-08T12:01:03.027 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.026+0000 7f268fdd8640 1 -- 172.21.15.62:0/3364976704 wait complete. 2023-10-08T12:01:03.029 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.026+0000 7f268fdd8640 1 Processor -- start 2023-10-08T12:01:03.029 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.026+0000 7f268fdd8640 1 -- start start 2023-10-08T12:01:03.029 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.026+0000 7f268fdd8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f26880b8630 0x7f26880a0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:01:03.030 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.026+0000 7f268fdd8640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26880bb140 0x7f26881e56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:01:03.030 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.026+0000 7f268fdd8640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f26880bc1a0 0x7f268813fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:01:03.030 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.026+0000 7f268fdd8640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26880a1130 con 0x7f26880bb140 2023-10-08T12:01:03.030 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.026+0000 7f268fdd8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f268806a8a0 con 0x7f26880b8630 2023-10-08T12:01:03.030 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.026+0000 7f268fdd8640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f268806add0 con 0x7f26880bc1a0 2023-10-08T12:01:03.030 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.026+0000 7f268d373640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26880bb140 0x7f26881e56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:01:03.030 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.026+0000 7f268d373640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26880bb140 0x7f26881e56c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46368/0 (socket says 172.21.15.62:46368) 2023-10-08T12:01:03.030 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.026+0000 7f268d373640 1 -- 172.21.15.62:0/629303785 learned_addr learned my addr 172.21.15.62:0/629303785 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:01:03.030 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.026+0000 7f268db74640 1 --2- 172.21.15.62:0/629303785 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f26880b8630 0x7f26880a0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:01:03.030 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.026+0000 7f268d373640 1 -- 172.21.15.62:0/629303785 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f26880bc1a0 msgr2=0x7f268813fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:01:03.030 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.026+0000 7f268e375640 1 --2- 172.21.15.62:0/629303785 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f26880bc1a0 0x7f268813fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:01:03.030 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.026+0000 7f268d373640 1 --2- 172.21.15.62:0/629303785 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f26880bc1a0 0x7f268813fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:03.031 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.026+0000 7f268d373640 1 -- 172.21.15.62:0/629303785 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f26880b8630 msgr2=0x7f26880a0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:01:03.031 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.026+0000 7f268d373640 1 --2- 172.21.15.62:0/629303785 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f26880b8630 0x7f26880a0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:03.031 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.026+0000 7f268d373640 1 -- 172.21.15.62:0/629303785 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2678009560 con 0x7f26880bb140 2023-10-08T12:01:03.031 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.026+0000 7f268db74640 1 --2- 172.21.15.62:0/629303785 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f26880b8630 0x7f26880a0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:01:03.031 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.026+0000 7f268d373640 1 --2- 172.21.15.62:0/629303785 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26880bb140 0x7f26881e56c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f267801af00 tx=0x7f26780040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:01:03.031 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.026+0000 7f267e7fc640 1 -- 172.21.15.62:0/629303785 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26780044d0 con 0x7f26880bb140 2023-10-08T12:01:03.031 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.026+0000 7f267e7fc640 1 -- 172.21.15.62:0/629303785 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2678005110 con 0x7f26880bb140 2023-10-08T12:01:03.031 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.026+0000 7f267e7fc640 1 -- 172.21.15.62:0/629303785 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2678005520 con 0x7f26880bb140 2023-10-08T12:01:03.031 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.026+0000 7f268fdd8640 1 -- 172.21.15.62:0/629303785 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f268806aaf0 con 0x7f26880bb140 2023-10-08T12:01:03.031 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.026+0000 7f268fdd8640 1 -- 172.21.15.62:0/629303785 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26880a1730 con 0x7f26880bb140 2023-10-08T12:01:03.032 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.030+0000 7f268fdd8640 1 -- 172.21.15.62:0/629303785 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2688144db0 con 0x7f26880bb140 2023-10-08T12:01:03.032 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.030+0000 7f267e7fc640 1 -- 172.21.15.62:0/629303785 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f26780b4040 con 0x7f26880bb140 2023-10-08T12:01:03.032 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.030+0000 7f267e7fc640 1 --2- 172.21.15.62:0/629303785 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f266c0664a0 0x7f266c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:01:03.032 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.030+0000 7f267e7fc640 1 -- 172.21.15.62:0/629303785 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f267811de10 con 0x7f26880bb140 2023-10-08T12:01:03.033 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.030+0000 7f268db74640 1 --2- 172.21.15.62:0/629303785 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f266c0664a0 0x7f266c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:01:03.033 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.030+0000 7f268db74640 1 --2- 172.21.15.62:0/629303785 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f266c0664a0 0x7f266c068960 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2684005fd0 tx=0x7f2684005da0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:01:03.035 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.034+0000 7f267e7fc640 1 -- 172.21.15.62:0/629303785 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2688144db0 con 0x7f26880bb140 2023-10-08T12:01:03.221 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.218+0000 7f268fdd8640 1 -- 172.21.15.62:0/629303785 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2688144db0 con 0x7f26880bb140 2023-10-08T12:01:03.222 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.222+0000 7f267e7fc640 1 -- 172.21.15.62:0/629303785 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4125 (secure 0 0 0) 0x7f2688144db0 con 0x7f26880bb140 2023-10-08T12:01:03.222 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T12:01:03.223 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4640,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/2660860288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":2660860288},{"type":"v1","addr":"172.21.15.130:6835","nonce":2660860288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5052,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6834/1276558017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":1276558017},{"type":"v1","addr":"172.21.15.62:6834","nonce":1276558017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T12:00:59.198090+0000","modified":"2023-10-08T12:01:02.234023+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5055},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5055":{"gid":5055,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6835/4173823127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":4173823127},{"type":"v1","addr":"172.21.15.62:6835","nonce":4173823127}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-08T12:01:03.223 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 16 2023-10-08T12:01:03.224 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.222+0000 7f268fdd8640 1 -- 172.21.15.62:0/629303785 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f266c0664a0 msgr2=0x7f266c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:01:03.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.222+0000 7f268fdd8640 1 --2- 172.21.15.62:0/629303785 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f266c0664a0 0x7f266c068960 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2684005fd0 tx=0x7f2684005da0 comp rx=0 tx=0).stop 2023-10-08T12:01:03.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.222+0000 7f268fdd8640 1 -- 172.21.15.62:0/629303785 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26880bb140 msgr2=0x7f26881e56c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:01:03.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.222+0000 7f268fdd8640 1 --2- 172.21.15.62:0/629303785 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26880bb140 0x7f26881e56c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f267801af00 tx=0x7f26780040e0 comp rx=0 tx=0).stop 2023-10-08T12:01:03.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.222+0000 7f268fdd8640 1 -- 172.21.15.62:0/629303785 shutdown_connections 2023-10-08T12:01:03.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.222+0000 7f268fdd8640 1 --2- 172.21.15.62:0/629303785 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f266c0664a0 0x7f266c068960 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:03.226 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.222+0000 7f268fdd8640 1 --2- 172.21.15.62:0/629303785 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f26880bc1a0 0x7f268813fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:03.226 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.222+0000 7f268fdd8640 1 --2- 172.21.15.62:0/629303785 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26880bb140 0x7f26881e56c0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:03.226 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.222+0000 7f268fdd8640 1 --2- 172.21.15.62:0/629303785 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f26880b8630 0x7f26880a0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:03.227 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.222+0000 7f268fdd8640 1 -- 172.21.15.62:0/629303785 >> 172.21.15.62:0/629303785 conn(0x7f268809e540 msgr2=0x7f26880bb9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:01:03.227 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.222+0000 7f268fdd8640 1 -- 172.21.15.62:0/629303785 shutdown_connections 2023-10-08T12:01:03.227 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.222+0000 7f268fdd8640 1 -- 172.21.15.62:0/629303785 wait complete. 2023-10-08T12:01:03.240 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:01:03.359 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.358+0000 7f1f7a412640 1 -- 172.21.15.62:0/986912578 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1f740b9e60 msgr2=0x7f1f740b5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:01:03.359 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.358+0000 7f1f7a412640 1 --2- 172.21.15.62:0/986912578 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1f740b9e60 0x7f1f740b5b00 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f1f740b7220 tx=0x7f1f6401f560 comp rx=0 tx=0).stop 2023-10-08T12:01:03.359 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.358+0000 7f1f7a412640 1 -- 172.21.15.62:0/986912578 shutdown_connections 2023-10-08T12:01:03.359 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.358+0000 7f1f7a412640 1 --2- 172.21.15.62:0/986912578 >> v2:172.21.15.130:3300/0 conn(0x7f1f740b09e0 0x7f1f740b0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:03.359 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.358+0000 7f1f7a412640 1 --2- 172.21.15.62:0/986912578 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1f740ba240 0x7f1f7406b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:03.359 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.358+0000 7f1f7a412640 1 --2- 172.21.15.62:0/986912578 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1f740b9e60 0x7f1f740b5b00 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:03.360 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.358+0000 7f1f7a412640 1 -- 172.21.15.62:0/986912578 >> 172.21.15.62:0/986912578 conn(0x7f1f7409c520 msgr2=0x7f1f7409c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:01:03.360 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.358+0000 7f1f7a412640 1 -- 172.21.15.62:0/986912578 shutdown_connections 2023-10-08T12:01:03.360 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.358+0000 7f1f7a412640 1 -- 172.21.15.62:0/986912578 wait complete. 2023-10-08T12:01:03.362 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.358+0000 7f1f7a412640 1 Processor -- start 2023-10-08T12:01:03.362 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.358+0000 7f1f7a412640 1 -- start start 2023-10-08T12:01:03.362 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.358+0000 7f1f7a412640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1f740b09e0 0x7f1f740a00a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:01:03.362 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.358+0000 7f1f7a412640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1f740b9e60 0x7f1f74147070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:01:03.362 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.358+0000 7f1f7a412640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f740ba240 0x7f1f741475b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:01:03.363 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.358+0000 7f1f7a412640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f74148f40 con 0x7f1f740b09e0 2023-10-08T12:01:03.363 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.358+0000 7f1f7a412640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f74146bc0 con 0x7f1f740ba240 2023-10-08T12:01:03.363 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.358+0000 7f1f7a412640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f741df9c0 con 0x7f1f740b9e60 2023-10-08T12:01:03.363 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.358+0000 7f1f73fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1f740b09e0 0x7f1f740a00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:01:03.363 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.358+0000 7f1f73fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1f740b09e0 0x7f1f740a00a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46398/0 (socket says 172.21.15.62:46398) 2023-10-08T12:01:03.363 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.358+0000 7f1f73fff640 1 -- 172.21.15.62:0/1455076864 learned_addr learned my addr 172.21.15.62:0/1455076864 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:01:03.363 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.358+0000 7f1f789af640 1 --2- 172.21.15.62:0/1455076864 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f740ba240 0x7f1f741475b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:01:03.363 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.358+0000 7f1f737fe640 1 --2- 172.21.15.62:0/1455076864 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1f740b9e60 0x7f1f74147070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:01:03.363 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.358+0000 7f1f73fff640 1 -- 172.21.15.62:0/1455076864 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1f740b9e60 msgr2=0x7f1f74147070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:01:03.363 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.358+0000 7f1f73fff640 1 --2- 172.21.15.62:0/1455076864 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1f740b9e60 0x7f1f74147070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:03.364 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.358+0000 7f1f73fff640 1 -- 172.21.15.62:0/1455076864 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f740ba240 msgr2=0x7f1f741475b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:01:03.364 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.358+0000 7f1f73fff640 1 --2- 172.21.15.62:0/1455076864 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f740ba240 0x7f1f741475b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:03.364 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.358+0000 7f1f73fff640 1 -- 172.21.15.62:0/1455076864 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f640098e0 con 0x7f1f740b09e0 2023-10-08T12:01:03.364 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.358+0000 7f1f789af640 1 --2- 172.21.15.62:0/1455076864 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f740ba240 0x7f1f741475b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:01:03.364 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.358+0000 7f1f737fe640 1 --2- 172.21.15.62:0/1455076864 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1f740b9e60 0x7f1f74147070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:01:03.364 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.358+0000 7f1f73fff640 1 --2- 172.21.15.62:0/1455076864 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1f740b09e0 0x7f1f740a00a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f1f64000f90 tx=0x7f1f640b14c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:01:03.364 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.358+0000 7f1f70ff9640 1 -- 172.21.15.62:0/1455076864 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f640be070 con 0x7f1f740b09e0 2023-10-08T12:01:03.364 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.358+0000 7f1f70ff9640 1 -- 172.21.15.62:0/1455076864 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1f640aa040 con 0x7f1f740b09e0 2023-10-08T12:01:03.365 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.358+0000 7f1f7a412640 1 -- 172.21.15.62:0/1455076864 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f741dfca0 con 0x7f1f740b09e0 2023-10-08T12:01:03.365 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.358+0000 7f1f70ff9640 1 -- 172.21.15.62:0/1455076864 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f64003980 con 0x7f1f740b09e0 2023-10-08T12:01:03.365 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.358+0000 7f1f7a412640 1 -- 172.21.15.62:0/1455076864 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f741dff80 con 0x7f1f740b09e0 2023-10-08T12:01:03.365 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.362+0000 7f1f7a412640 1 -- 172.21.15.62:0/1455076864 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f74146d30 con 0x7f1f740b09e0 2023-10-08T12:01:03.366 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.362+0000 7f1f70ff9640 1 -- 172.21.15.62:0/1455076864 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f1f640b8040 con 0x7f1f740b09e0 2023-10-08T12:01:03.366 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.362+0000 7f1f70ff9640 1 --2- 172.21.15.62:0/1455076864 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f1f60066470 0x7f1f60068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:01:03.366 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.362+0000 7f1f70ff9640 1 -- 172.21.15.62:0/1455076864 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1f64121f10 con 0x7f1f740b09e0 2023-10-08T12:01:03.366 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.362+0000 7f1f737fe640 1 --2- 172.21.15.62:0/1455076864 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f1f60066470 0x7f1f60068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:01:03.366 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.362+0000 7f1f737fe640 1 --2- 172.21.15.62:0/1455076864 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f1f60066470 0x7f1f60068930 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1f68005fd0 tx=0x7f1f68005d40 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:01:03.367 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.366+0000 7f1f70ff9640 1 -- 172.21.15.62:0/1455076864 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1f640ef420 con 0x7f1f740b09e0 2023-10-08T12:01:03.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.522+0000 7f1f7a412640 1 -- 172.21.15.62:0/1455076864 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1f7404da80 con 0x7f1f740b09e0 2023-10-08T12:01:03.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.526+0000 7f1f70ff9640 1 -- 172.21.15.62:0/1455076864 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+16545 (secure 0 0 0) 0x7f1f640b6020 con 0x7f1f740b09e0 2023-10-08T12:01:03.528 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T12:01:03.528 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":30,"fsid":"3e777930-c2c1-4f2b-a903-c07ee4ca2c52","created":"2023-10-08T11:59:54.510229+0000","modified":"2023-10-08T12:01:00.265361+0000","last_up_change":"2023-10-08T12:00:06.783998+0000","last_in_change":"2023-10-08T11:59:57.847944+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:00:07.189433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:00:57.515935+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-08T12:00:58.196426+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7bc3070a-7240-43d9-9ec3-397b68a37e2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6820","nonce":2227876905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6824","nonce":2227876905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6831","nonce":2227876905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2227876905},{"type":"v1","addr":"172.21.15.62:6828","nonce":2227876905}]},"public_addr":"172.21.15.62:6820/2227876905","cluster_addr":"172.21.15.62:6824/2227876905","heartbeat_back_addr":"172.21.15.62:6831/2227876905","heartbeat_front_addr":"172.21.15.62:6828/2227876905","state":["exists","up"]},{"osd":1,"uuid":"5e0fa1f5-9ddc-4882-b460-5578bb571003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6801","nonce":315660906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6803","nonce":315660906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6808","nonce":315660906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":315660906},{"type":"v1","addr":"172.21.15.62:6805","nonce":315660906}]},"public_addr":"172.21.15.62:6801/315660906","cluster_addr":"172.21.15.62:6803/315660906","heartbeat_back_addr":"172.21.15.62:6808/315660906","heartbeat_front_addr":"172.21.15.62:6805/315660906","state":["exists","up"]},{"osd":2,"uuid":"262b5ee9-4243-4309-a14f-88ad4e8bf812","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6807","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6809","nonce":3784842938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6811","nonce":3784842938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6815","nonce":3784842938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":3784842938},{"type":"v1","addr":"172.21.15.62:6813","nonce":3784842938}]},"public_addr":"172.21.15.62:6809/3784842938","cluster_addr":"172.21.15.62:6811/3784842938","heartbeat_back_addr":"172.21.15.62:6815/3784842938","heartbeat_front_addr":"172.21.15.62:6813/3784842938","state":["exists","up"]},{"osd":3,"uuid":"1770bdb8-c12b-43b1-aaab-1d6b6fd18f4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6817","nonce":3385303160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6821","nonce":3385303160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6827","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6829","nonce":3385303160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6823","nonce":3385303160},{"type":"v1","addr":"172.21.15.62:6825","nonce":3385303160}]},"public_addr":"172.21.15.62:6817/3385303160","cluster_addr":"172.21.15.62:6821/3385303160","heartbeat_back_addr":"172.21.15.62:6829/3385303160","heartbeat_front_addr":"172.21.15.62:6825/3385303160","state":["exists","up"]},{"osd":4,"uuid":"74c73631-9351-494a-8246-28ee86e9f862","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6807","nonce":1174056987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6809","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6811","nonce":1174056987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6820","nonce":1174056987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6813","nonce":1174056987},{"type":"v1","addr":"172.21.15.130:6816","nonce":1174056987}]},"public_addr":"172.21.15.130:6807/1174056987","cluster_addr":"172.21.15.130:6811/1174056987","heartbeat_back_addr":"172.21.15.130:6820/1174056987","heartbeat_front_addr":"172.21.15.130:6816/1174056987","state":["exists","up"]},{"osd":5,"uuid":"1040f389-272c-41d6-ae76-70c04d09afa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6801","nonce":561928414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6803","nonce":561928414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6815","nonce":561928414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":561928414},{"type":"v1","addr":"172.21.15.130:6808","nonce":561928414}]},"public_addr":"172.21.15.130:6801/561928414","cluster_addr":"172.21.15.130:6803/561928414","heartbeat_back_addr":"172.21.15.130:6815/561928414","heartbeat_front_addr":"172.21.15.130:6808/561928414","state":["exists","up"]},{"osd":6,"uuid":"178553eb-03e1-4ab8-9826-4f5997e6da0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6810","nonce":2877303015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6817","nonce":2877303015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6823","nonce":2877303015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6819","nonce":2877303015},{"type":"v1","addr":"172.21.15.130:6821","nonce":2877303015}]},"public_addr":"172.21.15.130:6810/2877303015","cluster_addr":"172.21.15.130:6817/2877303015","heartbeat_back_addr":"172.21.15.130:6823/2877303015","heartbeat_front_addr":"172.21.15.130:6821/2877303015","state":["exists","up"]},{"osd":7,"uuid":"b6581c8f-30b1-4dfd-b7b6-94b579128835","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6825","nonce":680009774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6827","nonce":680009774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6831","nonce":680009774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":680009774},{"type":"v1","addr":"172.21.15.130:6829","nonce":680009774}]},"public_addr":"172.21.15.130:6825/680009774","cluster_addr":"172.21.15.130:6827/680009774","heartbeat_back_addr":"172.21.15.130:6831/680009774","heartbeat_front_addr":"172.21.15.130:6829/680009774","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.505543+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.394383+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.456652+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.529168+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.235414+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.392158+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.347556+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:00:03.432039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:01:03.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.526+0000 7f1f7a412640 1 -- 172.21.15.62:0/1455076864 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f1f60066470 msgr2=0x7f1f60068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:01:03.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.526+0000 7f1f7a412640 1 --2- 172.21.15.62:0/1455076864 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f1f60066470 0x7f1f60068930 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1f68005fd0 tx=0x7f1f68005d40 comp rx=0 tx=0).stop 2023-10-08T12:01:03.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.526+0000 7f1f7a412640 1 -- 172.21.15.62:0/1455076864 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1f740b09e0 msgr2=0x7f1f740a00a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:01:03.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.526+0000 7f1f7a412640 1 --2- 172.21.15.62:0/1455076864 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1f740b09e0 0x7f1f740a00a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f1f64000f90 tx=0x7f1f640b14c0 comp rx=0 tx=0).stop 2023-10-08T12:01:03.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.526+0000 7f1f7a412640 1 -- 172.21.15.62:0/1455076864 shutdown_connections 2023-10-08T12:01:03.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.526+0000 7f1f7a412640 1 --2- 172.21.15.62:0/1455076864 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f1f60066470 0x7f1f60068930 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:03.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.526+0000 7f1f7a412640 1 --2- 172.21.15.62:0/1455076864 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1f740b9e60 0x7f1f74147070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:03.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.526+0000 7f1f7a412640 1 --2- 172.21.15.62:0/1455076864 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f740ba240 0x7f1f741475b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:03.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.526+0000 7f1f7a412640 1 --2- 172.21.15.62:0/1455076864 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1f740b09e0 0x7f1f740a00a0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:03.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.526+0000 7f1f7a412640 1 -- 172.21.15.62:0/1455076864 >> 172.21.15.62:0/1455076864 conn(0x7f1f7409c520 msgr2=0x7f1f7406aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:01:03.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.530+0000 7f1f7a412640 1 -- 172.21.15.62:0/1455076864 shutdown_connections 2023-10-08T12:01:03.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.530+0000 7f1f7a412640 1 -- 172.21.15.62:0/1455076864 wait complete. 2023-10-08T12:01:03.547 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-08T12:01:03.547 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T12:01:03.674 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.674+0000 7f34758d5640 1 -- 172.21.15.62:0/2608175028 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f34700b8570 msgr2=0x7f34700b8a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:01:03.675 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.674+0000 7f34758d5640 1 --2- 172.21.15.62:0/2608175028 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f34700b8570 0x7f34700b8a00 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f3468009bc0 tx=0x7f346801cb40 comp rx=0 tx=0).stop 2023-10-08T12:01:03.675 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.674+0000 7f34758d5640 1 -- 172.21.15.62:0/2608175028 shutdown_connections 2023-10-08T12:01:03.675 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.674+0000 7f34758d5640 1 --2- 172.21.15.62:0/2608175028 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f34700b8570 0x7f34700b8a00 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:03.675 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.674+0000 7f34758d5640 1 -- 172.21.15.62:0/2608175028 >> 172.21.15.62:0/2608175028 conn(0x7f347009c520 msgr2=0x7f347009c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:01:03.675 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.674+0000 7f34758d5640 1 -- 172.21.15.62:0/2608175028 shutdown_connections 2023-10-08T12:01:03.675 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.674+0000 7f34758d5640 1 -- 172.21.15.62:0/2608175028 wait complete. 2023-10-08T12:01:03.677 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.674+0000 7f34758d5640 1 Processor -- start 2023-10-08T12:01:03.678 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.674+0000 7f34758d5640 1 -- start start 2023-10-08T12:01:03.678 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.674+0000 7f34758d5640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f34700718c0 0x7f34701e0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:01:03.678 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.674+0000 7f34758d5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f34700b5170 0x7f3470141e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:01:03.678 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.674+0000 7f34758d5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f34700b8570 0x7f34701499e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:01:03.678 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.674+0000 7f34758d5640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34701e00e0 con 0x7f34700b5170 2023-10-08T12:01:03.678 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.674+0000 7f34758d5640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34701e0380 con 0x7f34700b8570 2023-10-08T12:01:03.678 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.674+0000 7f34758d5640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34701e0660 con 0x7f34700718c0 2023-10-08T12:01:03.678 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.674+0000 7f346e7fc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f34700b5170 0x7f3470141e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:01:03.679 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.674+0000 7f346e7fc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f34700b5170 0x7f3470141e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46424/0 (socket says 172.21.15.62:46424) 2023-10-08T12:01:03.679 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.674+0000 7f346e7fc640 1 -- 172.21.15.62:0/3998118850 learned_addr learned my addr 172.21.15.62:0/3998118850 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:01:03.679 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.674+0000 7f346effd640 1 --2- 172.21.15.62:0/3998118850 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f34700718c0 0x7f34701e0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:01:03.679 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.674+0000 7f346f7fe640 1 --2- 172.21.15.62:0/3998118850 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f34700b8570 0x7f34701499e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:01:03.679 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.674+0000 7f346e7fc640 1 -- 172.21.15.62:0/3998118850 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f34700718c0 msgr2=0x7f34701e0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:01:03.679 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.674+0000 7f346e7fc640 1 --2- 172.21.15.62:0/3998118850 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f34700718c0 0x7f34701e0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:03.679 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.674+0000 7f346e7fc640 1 -- 172.21.15.62:0/3998118850 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f34700b8570 msgr2=0x7f34701499e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:01:03.679 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.674+0000 7f346e7fc640 1 --2- 172.21.15.62:0/3998118850 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f34700b8570 0x7f34701499e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:03.679 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.674+0000 7f346e7fc640 1 -- 172.21.15.62:0/3998118850 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3468009820 con 0x7f34700b5170 2023-10-08T12:01:03.680 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.674+0000 7f346effd640 1 --2- 172.21.15.62:0/3998118850 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f34700718c0 0x7f34701e0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:01:03.680 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.674+0000 7f346e7fc640 1 --2- 172.21.15.62:0/3998118850 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f34700b5170 0x7f3470141e00 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f346400c4d0 tx=0x7f346400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:01:03.680 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.674+0000 7f3457fff640 1 -- 172.21.15.62:0/3998118850 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3464005480 con 0x7f34700b5170 2023-10-08T12:01:03.680 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.674+0000 7f3457fff640 1 -- 172.21.15.62:0/3998118850 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f34640036f0 con 0x7f34700b5170 2023-10-08T12:01:03.680 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.674+0000 7f34758d5640 1 -- 172.21.15.62:0/3998118850 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3470143fe0 con 0x7f34700b5170 2023-10-08T12:01:03.680 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.674+0000 7f3457fff640 1 -- 172.21.15.62:0/3998118850 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3464003b00 con 0x7f34700b5170 2023-10-08T12:01:03.680 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.674+0000 7f34758d5640 1 -- 172.21.15.62:0/3998118850 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3470141a50 con 0x7f34700b5170 2023-10-08T12:01:03.681 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.678+0000 7f34758d5640 1 -- 172.21.15.62:0/3998118850 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f347004da80 con 0x7f34700b5170 2023-10-08T12:01:03.681 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.678+0000 7f3457fff640 1 -- 172.21.15.62:0/3998118850 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3464003c60 con 0x7f34700b5170 2023-10-08T12:01:03.681 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.678+0000 7f3457fff640 1 --2- 172.21.15.62:0/3998118850 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f345c0664a0 0x7f345c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:01:03.682 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.678+0000 7f3457fff640 1 -- 172.21.15.62:0/3998118850 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f34640836b0 con 0x7f34700b5170 2023-10-08T12:01:03.686 INFO:tasks.ceph.mds.c.smithi062.stderr:2023-10-08T12:01:03.678+0000 7ffa5ed60640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T12:01:03.686 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.678+0000 7f346effd640 1 --2- 172.21.15.62:0/3998118850 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f345c0664a0 0x7f345c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:01:03.686 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.678+0000 7f346effd640 1 --2- 172.21.15.62:0/3998118850 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f345c0664a0 0x7f345c068960 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3460003e40 tx=0x7f3460009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:01:03.686 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.682+0000 7f3457fff640 1 -- 172.21.15.62:0/3998118850 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3464050bf0 con 0x7f34700b5170 2023-10-08T12:01:03.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.834+0000 7f34758d5640 1 -- 172.21.15.62:0/3998118850 --> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3470152360 con 0x7f345c0664a0 2023-10-08T12:01:03.857 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.854+0000 7f3457fff640 1 -- 172.21.15.62:0/3998118850 <== mgr.4111 v2:172.21.15.130:6832/826384843 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264571 (secure 0 0 0) 0x7f3470152360 con 0x7f345c0664a0 2023-10-08T12:01:03.860 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T12:01:03.861 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2023-10-08T12:01:03.862 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.858+0000 7f34758d5640 1 -- 172.21.15.62:0/3998118850 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f345c0664a0 msgr2=0x7f345c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:01:03.862 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.858+0000 7f34758d5640 1 --2- 172.21.15.62:0/3998118850 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f345c0664a0 0x7f345c068960 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3460003e40 tx=0x7f3460009040 comp rx=0 tx=0).stop 2023-10-08T12:01:03.863 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.858+0000 7f34758d5640 1 -- 172.21.15.62:0/3998118850 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f34700b5170 msgr2=0x7f3470141e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:01:03.863 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.858+0000 7f34758d5640 1 --2- 172.21.15.62:0/3998118850 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f34700b5170 0x7f3470141e00 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f346400c4d0 tx=0x7f346400c990 comp rx=0 tx=0).stop 2023-10-08T12:01:03.863 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.858+0000 7f34758d5640 1 -- 172.21.15.62:0/3998118850 shutdown_connections 2023-10-08T12:01:03.863 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.858+0000 7f34758d5640 1 --2- 172.21.15.62:0/3998118850 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f345c0664a0 0x7f345c068960 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:03.863 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.858+0000 7f34758d5640 1 --2- 172.21.15.62:0/3998118850 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f34700b8570 0x7f34701499e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:03.863 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.858+0000 7f34758d5640 1 --2- 172.21.15.62:0/3998118850 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f34700b5170 0x7f3470141e00 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:03.863 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.858+0000 7f34758d5640 1 --2- 172.21.15.62:0/3998118850 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f34700718c0 0x7f34701e0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:03.863 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.858+0000 7f34758d5640 1 -- 172.21.15.62:0/3998118850 >> 172.21.15.62:0/3998118850 conn(0x7f347009c520 msgr2=0x7f347006b2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:01:03.863 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.858+0000 7f34758d5640 1 -- 172.21.15.62:0/3998118850 shutdown_connections 2023-10-08T12:01:03.863 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:03.858+0000 7f34758d5640 1 -- 172.21.15.62:0/3998118850 wait complete. 2023-10-08T12:01:03.879 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":51,"stamp":"2023-10-08T12:01:03.125807+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":139,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220056,"kb_used_data":3848,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754664,"statfs":{"total":773094113280,"available":772868775936,"internally_reserved":0,"allocated":3940352,"data_stored":2217820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":72,"apply_latency_ms":72,"commit_latency_ns":72000000,"apply_latency_ns":72000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.302776"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.488786+0000","last_change":"2023-10-08T12:00:59.328912+0000","last_active":"2023-10-08T12:01:00.488786+0000","last_peered":"2023-10-08T12:01:00.488786+0000","last_clean":"2023-10-08T12:01:00.488786+0000","last_became_active":"2023-10-08T12:00:59.327949+0000","last_became_peered":"2023-10-08T12:00:59.327949+0000","last_unstale":"2023-10-08T12:01:00.488786+0000","last_undegraded":"2023-10-08T12:01:00.488786+0000","last_fullsized":"2023-10-08T12:01:00.488786+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:24:55.963122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.491370+0000","last_change":"2023-10-08T12:00:59.306546+0000","last_active":"2023-10-08T12:01:00.491370+0000","last_peered":"2023-10-08T12:01:00.491370+0000","last_clean":"2023-10-08T12:01:00.491370+0000","last_became_active":"2023-10-08T12:00:59.305842+0000","last_became_peered":"2023-10-08T12:00:59.305842+0000","last_unstale":"2023-10-08T12:01:00.491370+0000","last_undegraded":"2023-10-08T12:01:00.491370+0000","last_fullsized":"2023-10-08T12:01:00.491370+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:34:52.628775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.276570+0000","last_change":"2023-10-08T12:00:59.299204+0000","last_active":"2023-10-08T12:01:00.276570+0000","last_peered":"2023-10-08T12:01:00.276570+0000","last_clean":"2023-10-08T12:01:00.276570+0000","last_became_active":"2023-10-08T12:00:59.298508+0000","last_became_peered":"2023-10-08T12:00:59.298508+0000","last_unstale":"2023-10-08T12:01:00.276570+0000","last_undegraded":"2023-10-08T12:01:00.276570+0000","last_fullsized":"2023-10-08T12:01:00.276570+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:36:38.358206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.491117+0000","last_change":"2023-10-08T12:00:59.315841+0000","last_active":"2023-10-08T12:01:00.491117+0000","last_peered":"2023-10-08T12:01:00.491117+0000","last_clean":"2023-10-08T12:01:00.491117+0000","last_became_active":"2023-10-08T12:00:59.315067+0000","last_became_peered":"2023-10-08T12:00:59.315067+0000","last_unstale":"2023-10-08T12:01:00.491117+0000","last_undegraded":"2023-10-08T12:01:00.491117+0000","last_fullsized":"2023-10-08T12:01:00.491117+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:38:47.575293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.493536+0000","last_change":"2023-10-08T12:00:59.295891+0000","last_active":"2023-10-08T12:01:00.493536+0000","last_peered":"2023-10-08T12:01:00.493536+0000","last_clean":"2023-10-08T12:01:00.493536+0000","last_became_active":"2023-10-08T12:00:59.295385+0000","last_became_peered":"2023-10-08T12:00:59.295385+0000","last_unstale":"2023-10-08T12:01:00.493536+0000","last_undegraded":"2023-10-08T12:01:00.493536+0000","last_fullsized":"2023-10-08T12:01:00.493536+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:23:13.468633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.491036+0000","last_change":"2023-10-08T12:00:59.316182+0000","last_active":"2023-10-08T12:01:00.491036+0000","last_peered":"2023-10-08T12:01:00.491036+0000","last_clean":"2023-10-08T12:01:00.491036+0000","last_became_active":"2023-10-08T12:00:59.315456+0000","last_became_peered":"2023-10-08T12:00:59.315456+0000","last_unstale":"2023-10-08T12:01:00.491036+0000","last_undegraded":"2023-10-08T12:01:00.491036+0000","last_fullsized":"2023-10-08T12:01:00.491036+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:26:46.589443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.492273+0000","last_change":"2023-10-08T12:00:59.319487+0000","last_active":"2023-10-08T12:01:00.492273+0000","last_peered":"2023-10-08T12:01:00.492273+0000","last_clean":"2023-10-08T12:01:00.492273+0000","last_became_active":"2023-10-08T12:00:59.318719+0000","last_became_peered":"2023-10-08T12:00:59.318719+0000","last_unstale":"2023-10-08T12:01:00.492273+0000","last_undegraded":"2023-10-08T12:01:00.492273+0000","last_fullsized":"2023-10-08T12:01:00.492273+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:13:53.948012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.491685+0000","last_change":"2023-10-08T12:00:59.317272+0000","last_active":"2023-10-08T12:01:00.491685+0000","last_peered":"2023-10-08T12:01:00.491685+0000","last_clean":"2023-10-08T12:01:00.491685+0000","last_became_active":"2023-10-08T12:00:59.312616+0000","last_became_peered":"2023-10-08T12:00:59.312616+0000","last_unstale":"2023-10-08T12:01:00.491685+0000","last_undegraded":"2023-10-08T12:01:00.491685+0000","last_fullsized":"2023-10-08T12:01:00.491685+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:52:49.534592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.278507+0000","last_change":"2023-10-08T12:00:59.310072+0000","last_active":"2023-10-08T12:01:00.278507+0000","last_peered":"2023-10-08T12:01:00.278507+0000","last_clean":"2023-10-08T12:01:00.278507+0000","last_became_active":"2023-10-08T12:00:59.309213+0000","last_became_peered":"2023-10-08T12:00:59.309213+0000","last_unstale":"2023-10-08T12:01:00.278507+0000","last_undegraded":"2023-10-08T12:01:00.278507+0000","last_fullsized":"2023-10-08T12:01:00.278507+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:52:49.534592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.492617+0000","last_change":"2023-10-08T12:00:59.308146+0000","last_active":"2023-10-08T12:01:00.492617+0000","last_peered":"2023-10-08T12:01:00.492617+0000","last_clean":"2023-10-08T12:01:00.492617+0000","last_became_active":"2023-10-08T12:00:59.306815+0000","last_became_peered":"2023-10-08T12:00:59.306815+0000","last_unstale":"2023-10-08T12:01:00.492617+0000","last_undegraded":"2023-10-08T12:01:00.492617+0000","last_fullsized":"2023-10-08T12:01:00.492617+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:46:58.018052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.492423+0000","last_change":"2023-10-08T12:00:59.320469+0000","last_active":"2023-10-08T12:01:00.492423+0000","last_peered":"2023-10-08T12:01:00.492423+0000","last_clean":"2023-10-08T12:01:00.492423+0000","last_became_active":"2023-10-08T12:00:59.319570+0000","last_became_peered":"2023-10-08T12:00:59.319570+0000","last_unstale":"2023-10-08T12:01:00.492423+0000","last_undegraded":"2023-10-08T12:01:00.492423+0000","last_fullsized":"2023-10-08T12:01:00.492423+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:10:26.342879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.276055+0000","last_change":"2023-10-08T12:00:59.297464+0000","last_active":"2023-10-08T12:01:00.276055+0000","last_peered":"2023-10-08T12:01:00.276055+0000","last_clean":"2023-10-08T12:01:00.276055+0000","last_became_active":"2023-10-08T12:00:59.296704+0000","last_became_peered":"2023-10-08T12:00:59.296704+0000","last_unstale":"2023-10-08T12:01:00.276055+0000","last_undegraded":"2023-10-08T12:01:00.276055+0000","last_fullsized":"2023-10-08T12:01:00.276055+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:48:11.695180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.493676+0000","last_change":"2023-10-08T12:00:59.296170+0000","last_active":"2023-10-08T12:01:00.493676+0000","last_peered":"2023-10-08T12:01:00.493676+0000","last_clean":"2023-10-08T12:01:00.493676+0000","last_became_active":"2023-10-08T12:00:59.295664+0000","last_became_peered":"2023-10-08T12:00:59.295664+0000","last_unstale":"2023-10-08T12:01:00.493676+0000","last_undegraded":"2023-10-08T12:01:00.493676+0000","last_fullsized":"2023-10-08T12:01:00.493676+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:23:43.231108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.491179+0000","last_change":"2023-10-08T12:00:59.300150+0000","last_active":"2023-10-08T12:01:00.491179+0000","last_peered":"2023-10-08T12:01:00.491179+0000","last_clean":"2023-10-08T12:01:00.491179+0000","last_became_active":"2023-10-08T12:00:59.299633+0000","last_became_peered":"2023-10-08T12:00:59.299633+0000","last_unstale":"2023-10-08T12:01:00.491179+0000","last_undegraded":"2023-10-08T12:01:00.491179+0000","last_fullsized":"2023-10-08T12:01:00.491179+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:50:14.850224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.277358+0000","last_change":"2023-10-08T12:00:59.312944+0000","last_active":"2023-10-08T12:01:00.277358+0000","last_peered":"2023-10-08T12:01:00.277358+0000","last_clean":"2023-10-08T12:01:00.277358+0000","last_became_active":"2023-10-08T12:00:59.312211+0000","last_became_peered":"2023-10-08T12:00:59.312211+0000","last_unstale":"2023-10-08T12:01:00.277358+0000","last_undegraded":"2023-10-08T12:01:00.277358+0000","last_fullsized":"2023-10-08T12:01:00.277358+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:34:52.628775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.492892+0000","last_change":"2023-10-08T12:00:59.316166+0000","last_active":"2023-10-08T12:01:00.492892+0000","last_peered":"2023-10-08T12:01:00.492892+0000","last_clean":"2023-10-08T12:01:00.492892+0000","last_became_active":"2023-10-08T12:00:59.314446+0000","last_became_peered":"2023-10-08T12:00:59.314446+0000","last_unstale":"2023-10-08T12:01:00.492892+0000","last_undegraded":"2023-10-08T12:01:00.492892+0000","last_fullsized":"2023-10-08T12:01:00.492892+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:50:14.850224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.492806+0000","last_change":"2023-10-08T12:00:59.313914+0000","last_active":"2023-10-08T12:01:00.492806+0000","last_peered":"2023-10-08T12:01:00.492806+0000","last_clean":"2023-10-08T12:01:00.492806+0000","last_became_active":"2023-10-08T12:00:59.313104+0000","last_became_peered":"2023-10-08T12:00:59.313104+0000","last_unstale":"2023-10-08T12:01:00.492806+0000","last_undegraded":"2023-10-08T12:01:00.492806+0000","last_fullsized":"2023-10-08T12:01:00.492806+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:26:46.589443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.491692+0000","last_change":"2023-10-08T12:00:59.310991+0000","last_active":"2023-10-08T12:01:00.491692+0000","last_peered":"2023-10-08T12:01:00.491692+0000","last_clean":"2023-10-08T12:01:00.491692+0000","last_became_active":"2023-10-08T12:00:59.308914+0000","last_became_peered":"2023-10-08T12:00:59.308914+0000","last_unstale":"2023-10-08T12:01:00.491692+0000","last_undegraded":"2023-10-08T12:01:00.491692+0000","last_fullsized":"2023-10-08T12:01:00.491692+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:59:51.948361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.491619+0000","last_change":"2023-10-08T12:00:59.299080+0000","last_active":"2023-10-08T12:01:00.491619+0000","last_peered":"2023-10-08T12:01:00.491619+0000","last_clean":"2023-10-08T12:01:00.491619+0000","last_became_active":"2023-10-08T12:00:59.298311+0000","last_became_peered":"2023-10-08T12:00:59.298311+0000","last_unstale":"2023-10-08T12:01:00.491619+0000","last_undegraded":"2023-10-08T12:01:00.491619+0000","last_fullsized":"2023-10-08T12:01:00.491619+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:56:51.310559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.494111+0000","last_change":"2023-10-08T12:00:59.291240+0000","last_active":"2023-10-08T12:01:00.494111+0000","last_peered":"2023-10-08T12:01:00.494111+0000","last_clean":"2023-10-08T12:01:00.494111+0000","last_became_active":"2023-10-08T12:00:59.290470+0000","last_became_peered":"2023-10-08T12:00:59.290470+0000","last_unstale":"2023-10-08T12:01:00.494111+0000","last_undegraded":"2023-10-08T12:01:00.494111+0000","last_fullsized":"2023-10-08T12:01:00.494111+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:18:13.195755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.276320+0000","last_change":"2023-10-08T12:00:59.309527+0000","last_active":"2023-10-08T12:01:00.276320+0000","last_peered":"2023-10-08T12:01:00.276320+0000","last_clean":"2023-10-08T12:01:00.276320+0000","last_became_active":"2023-10-08T12:00:59.308805+0000","last_became_peered":"2023-10-08T12:00:59.308805+0000","last_unstale":"2023-10-08T12:01:00.276320+0000","last_undegraded":"2023-10-08T12:01:00.276320+0000","last_fullsized":"2023-10-08T12:01:00.276320+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:39:49.343216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.276530+0000","last_change":"2023-10-08T12:00:59.308602+0000","last_active":"2023-10-08T12:01:00.276530+0000","last_peered":"2023-10-08T12:01:00.276530+0000","last_clean":"2023-10-08T12:01:00.276530+0000","last_became_active":"2023-10-08T12:00:59.307874+0000","last_became_peered":"2023-10-08T12:00:59.307874+0000","last_unstale":"2023-10-08T12:01:00.276530+0000","last_undegraded":"2023-10-08T12:01:00.276530+0000","last_fullsized":"2023-10-08T12:01:00.276530+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:10:58.996032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.270325+0000","last_change":"2023-10-08T12:00:59.314810+0000","last_active":"2023-10-08T12:01:00.270325+0000","last_peered":"2023-10-08T12:01:00.270325+0000","last_clean":"2023-10-08T12:01:00.270325+0000","last_became_active":"2023-10-08T12:00:59.314330+0000","last_became_peered":"2023-10-08T12:00:59.314330+0000","last_unstale":"2023-10-08T12:01:00.270325+0000","last_undegraded":"2023-10-08T12:01:00.270325+0000","last_fullsized":"2023-10-08T12:01:00.270325+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:46:01.385644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.274926+0000","last_change":"2023-10-08T12:00:59.297318+0000","last_active":"2023-10-08T12:01:00.274926+0000","last_peered":"2023-10-08T12:01:00.274926+0000","last_clean":"2023-10-08T12:01:00.274926+0000","last_became_active":"2023-10-08T12:00:59.296222+0000","last_became_peered":"2023-10-08T12:00:59.296222+0000","last_unstale":"2023-10-08T12:01:00.274926+0000","last_undegraded":"2023-10-08T12:01:00.274926+0000","last_fullsized":"2023-10-08T12:01:00.274926+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:38:47.575293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.492700+0000","last_change":"2023-10-08T12:00:59.315135+0000","last_active":"2023-10-08T12:01:00.492700+0000","last_peered":"2023-10-08T12:01:00.492700+0000","last_clean":"2023-10-08T12:01:00.492700+0000","last_became_active":"2023-10-08T12:00:59.313654+0000","last_became_peered":"2023-10-08T12:00:59.313654+0000","last_unstale":"2023-10-08T12:01:00.492700+0000","last_undegraded":"2023-10-08T12:01:00.492700+0000","last_fullsized":"2023-10-08T12:01:00.492700+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:10:26.342879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.492032+0000","last_change":"2023-10-08T12:00:59.307172+0000","last_active":"2023-10-08T12:01:00.492032+0000","last_peered":"2023-10-08T12:01:00.492032+0000","last_clean":"2023-10-08T12:01:00.492032+0000","last_became_active":"2023-10-08T12:00:59.306320+0000","last_became_peered":"2023-10-08T12:00:59.306320+0000","last_unstale":"2023-10-08T12:01:00.492032+0000","last_undegraded":"2023-10-08T12:01:00.492032+0000","last_fullsized":"2023-10-08T12:01:00.492032+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:01:53.038702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.492008+0000","last_change":"2023-10-08T12:00:59.315493+0000","last_active":"2023-10-08T12:01:00.492008+0000","last_peered":"2023-10-08T12:01:00.492008+0000","last_clean":"2023-10-08T12:01:00.492008+0000","last_became_active":"2023-10-08T12:00:59.314765+0000","last_became_peered":"2023-10-08T12:00:59.314765+0000","last_unstale":"2023-10-08T12:01:00.492008+0000","last_undegraded":"2023-10-08T12:01:00.492008+0000","last_fullsized":"2023-10-08T12:01:00.492008+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:48:11.695180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.276373+0000","last_change":"2023-10-08T12:00:59.301740+0000","last_active":"2023-10-08T12:01:00.276373+0000","last_peered":"2023-10-08T12:01:00.276373+0000","last_clean":"2023-10-08T12:01:00.276373+0000","last_became_active":"2023-10-08T12:00:59.301009+0000","last_became_peered":"2023-10-08T12:00:59.301009+0000","last_unstale":"2023-10-08T12:01:00.276373+0000","last_undegraded":"2023-10-08T12:01:00.276373+0000","last_fullsized":"2023-10-08T12:01:00.276373+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:46:58.018052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.277282+0000","last_change":"2023-10-08T12:00:59.306972+0000","last_active":"2023-10-08T12:01:00.277282+0000","last_peered":"2023-10-08T12:01:00.277282+0000","last_clean":"2023-10-08T12:01:00.277282+0000","last_became_active":"2023-10-08T12:00:59.306239+0000","last_became_peered":"2023-10-08T12:00:59.306239+0000","last_unstale":"2023-10-08T12:01:00.277282+0000","last_undegraded":"2023-10-08T12:01:00.277282+0000","last_fullsized":"2023-10-08T12:01:00.277282+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:59:21.171602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.492112+0000","last_change":"2023-10-08T12:00:59.319944+0000","last_active":"2023-10-08T12:01:00.492112+0000","last_peered":"2023-10-08T12:01:00.492112+0000","last_clean":"2023-10-08T12:01:00.492112+0000","last_became_active":"2023-10-08T12:00:59.319135+0000","last_became_peered":"2023-10-08T12:00:59.319135+0000","last_unstale":"2023-10-08T12:01:00.492112+0000","last_undegraded":"2023-10-08T12:01:00.492112+0000","last_fullsized":"2023-10-08T12:01:00.492112+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:35:21.196573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.488524+0000","last_change":"2023-10-08T12:00:59.302015+0000","last_active":"2023-10-08T12:01:00.488524+0000","last_peered":"2023-10-08T12:01:00.488524+0000","last_clean":"2023-10-08T12:01:00.488524+0000","last_became_active":"2023-10-08T12:00:59.301258+0000","last_became_peered":"2023-10-08T12:00:59.301258+0000","last_unstale":"2023-10-08T12:01:00.488524+0000","last_undegraded":"2023-10-08T12:01:00.488524+0000","last_fullsized":"2023-10-08T12:01:00.488524+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:46:01.385644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.491847+0000","last_change":"2023-10-08T12:00:59.316672+0000","last_active":"2023-10-08T12:01:00.491847+0000","last_peered":"2023-10-08T12:01:00.491847+0000","last_clean":"2023-10-08T12:01:00.491847+0000","last_became_active":"2023-10-08T12:00:59.315393+0000","last_became_peered":"2023-10-08T12:00:59.315393+0000","last_unstale":"2023-10-08T12:01:00.491847+0000","last_undegraded":"2023-10-08T12:01:00.491847+0000","last_fullsized":"2023-10-08T12:01:00.491847+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:04:55.650551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.270805+0000","last_change":"2023-10-08T12:00:59.314538+0000","last_active":"2023-10-08T12:01:00.270805+0000","last_peered":"2023-10-08T12:01:00.270805+0000","last_clean":"2023-10-08T12:01:00.270805+0000","last_became_active":"2023-10-08T12:00:59.313914+0000","last_became_peered":"2023-10-08T12:00:59.313914+0000","last_unstale":"2023-10-08T12:01:00.270805+0000","last_undegraded":"2023-10-08T12:01:00.270805+0000","last_fullsized":"2023-10-08T12:01:00.270805+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:39:49.343216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"29'4","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.488950+0000","last_change":"2023-10-08T12:00:58.867252+0000","last_active":"2023-10-08T12:01:00.488950+0000","last_peered":"2023-10-08T12:01:00.488950+0000","last_clean":"2023-10-08T12:01:00.488950+0000","last_became_active":"2023-10-08T12:00:58.866544+0000","last_became_peered":"2023-10-08T12:00:58.866544+0000","last_unstale":"2023-10-08T12:01:00.488950+0000","last_undegraded":"2023-10-08T12:01:00.488950+0000","last_fullsized":"2023-10-08T12:01:00.488950+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_clean_scrub_stamp":"2023-10-08T12:00:57.809995+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:40:18.668295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.488978+0000","last_change":"2023-10-08T12:00:59.316154+0000","last_active":"2023-10-08T12:01:00.488978+0000","last_peered":"2023-10-08T12:01:00.488978+0000","last_clean":"2023-10-08T12:01:00.488978+0000","last_became_active":"2023-10-08T12:00:59.315415+0000","last_became_peered":"2023-10-08T12:00:59.315415+0000","last_unstale":"2023-10-08T12:01:00.488978+0000","last_undegraded":"2023-10-08T12:01:00.488978+0000","last_fullsized":"2023-10-08T12:01:00.488978+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:04:21.118922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"29'1","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.270850+0000","last_change":"2023-10-08T12:00:58.865199+0000","last_active":"2023-10-08T12:01:00.270850+0000","last_peered":"2023-10-08T12:01:00.270850+0000","last_clean":"2023-10-08T12:01:00.270850+0000","last_became_active":"2023-10-08T12:00:58.864908+0000","last_became_peered":"2023-10-08T12:00:58.864908+0000","last_unstale":"2023-10-08T12:01:00.270850+0000","last_undegraded":"2023-10-08T12:01:00.270850+0000","last_fullsized":"2023-10-08T12:01:00.270850+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_clean_scrub_stamp":"2023-10-08T12:00:57.809995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:34:11.481822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.277800+0000","last_change":"2023-10-08T12:00:59.308985+0000","last_active":"2023-10-08T12:01:00.277800+0000","last_peered":"2023-10-08T12:01:00.277800+0000","last_clean":"2023-10-08T12:01:00.277800+0000","last_became_active":"2023-10-08T12:00:59.307972+0000","last_became_peered":"2023-10-08T12:00:59.307972+0000","last_unstale":"2023-10-08T12:01:00.277800+0000","last_undegraded":"2023-10-08T12:01:00.277800+0000","last_fullsized":"2023-10-08T12:01:00.277800+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:57:12.143587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"29'2","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.491887+0000","last_change":"2023-10-08T12:00:58.861971+0000","last_active":"2023-10-08T12:01:00.491887+0000","last_peered":"2023-10-08T12:01:00.491887+0000","last_clean":"2023-10-08T12:01:00.491887+0000","last_became_active":"2023-10-08T12:00:58.861320+0000","last_became_peered":"2023-10-08T12:00:58.861320+0000","last_unstale":"2023-10-08T12:01:00.491887+0000","last_undegraded":"2023-10-08T12:01:00.491887+0000","last_fullsized":"2023-10-08T12:01:00.491887+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_clean_scrub_stamp":"2023-10-08T12:00:57.809995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:13:52.937093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.492140+0000","last_change":"2023-10-08T12:00:59.315073+0000","last_active":"2023-10-08T12:01:00.492140+0000","last_peered":"2023-10-08T12:01:00.492140+0000","last_clean":"2023-10-08T12:01:00.492140+0000","last_became_active":"2023-10-08T12:00:59.314578+0000","last_became_peered":"2023-10-08T12:00:59.314578+0000","last_unstale":"2023-10-08T12:01:00.492140+0000","last_undegraded":"2023-10-08T12:01:00.492140+0000","last_fullsized":"2023-10-08T12:01:00.492140+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:13:53.948012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"29'2","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.494205+0000","last_change":"2023-10-08T12:00:58.859441+0000","last_active":"2023-10-08T12:01:00.494205+0000","last_peered":"2023-10-08T12:01:00.494205+0000","last_clean":"2023-10-08T12:01:00.494205+0000","last_became_active":"2023-10-08T12:00:58.859066+0000","last_became_peered":"2023-10-08T12:00:58.859066+0000","last_unstale":"2023-10-08T12:01:00.494205+0000","last_undegraded":"2023-10-08T12:01:00.494205+0000","last_fullsized":"2023-10-08T12:01:00.494205+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_clean_scrub_stamp":"2023-10-08T12:00:57.809995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:58:18.679914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.492521+0000","last_change":"2023-10-08T12:00:59.332444+0000","last_active":"2023-10-08T12:01:00.492521+0000","last_peered":"2023-10-08T12:01:00.492521+0000","last_clean":"2023-10-08T12:01:00.492521+0000","last_became_active":"2023-10-08T12:00:59.331918+0000","last_became_peered":"2023-10-08T12:00:59.331918+0000","last_unstale":"2023-10-08T12:01:00.492521+0000","last_undegraded":"2023-10-08T12:01:00.492521+0000","last_fullsized":"2023-10-08T12:01:00.492521+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:36:38.358206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"29'1","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.277511+0000","last_change":"2023-10-08T12:00:58.866477+0000","last_active":"2023-10-08T12:01:00.277511+0000","last_peered":"2023-10-08T12:01:00.277511+0000","last_clean":"2023-10-08T12:01:00.277511+0000","last_became_active":"2023-10-08T12:00:58.865753+0000","last_became_peered":"2023-10-08T12:00:58.865753+0000","last_unstale":"2023-10-08T12:01:00.277511+0000","last_undegraded":"2023-10-08T12:01:00.277511+0000","last_fullsized":"2023-10-08T12:01:00.277511+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_clean_scrub_stamp":"2023-10-08T12:00:57.809995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:40:18.668295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.275389+0000","last_change":"2023-10-08T12:00:59.310457+0000","last_active":"2023-10-08T12:01:00.275389+0000","last_peered":"2023-10-08T12:01:00.275389+0000","last_clean":"2023-10-08T12:01:00.275389+0000","last_became_active":"2023-10-08T12:00:59.309665+0000","last_became_peered":"2023-10-08T12:00:59.309665+0000","last_unstale":"2023-10-08T12:01:00.275389+0000","last_undegraded":"2023-10-08T12:01:00.275389+0000","last_fullsized":"2023-10-08T12:01:00.275389+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:35:21.196573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"29'1","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.276765+0000","last_change":"2023-10-08T12:00:58.851368+0000","last_active":"2023-10-08T12:01:00.276765+0000","last_peered":"2023-10-08T12:01:00.276765+0000","last_clean":"2023-10-08T12:01:00.276765+0000","last_became_active":"2023-10-08T12:00:58.850873+0000","last_became_peered":"2023-10-08T12:00:58.850873+0000","last_unstale":"2023-10-08T12:01:00.276765+0000","last_undegraded":"2023-10-08T12:01:00.276765+0000","last_fullsized":"2023-10-08T12:01:00.276765+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_clean_scrub_stamp":"2023-10-08T12:00:57.809995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:32:29.620810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.275488+0000","last_change":"2023-10-08T12:00:59.304349+0000","last_active":"2023-10-08T12:01:00.275488+0000","last_peered":"2023-10-08T12:01:00.275488+0000","last_clean":"2023-10-08T12:01:00.275488+0000","last_became_active":"2023-10-08T12:00:59.303546+0000","last_became_peered":"2023-10-08T12:00:59.303546+0000","last_unstale":"2023-10-08T12:01:00.275488+0000","last_undegraded":"2023-10-08T12:01:00.275488+0000","last_fullsized":"2023-10-08T12:01:00.275488+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:04:21.118922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.490712+0000","last_change":"2023-10-08T12:00:58.850406+0000","last_active":"2023-10-08T12:01:00.490712+0000","last_peered":"2023-10-08T12:01:00.490712+0000","last_clean":"2023-10-08T12:01:00.490712+0000","last_became_active":"2023-10-08T12:00:58.850159+0000","last_became_peered":"2023-10-08T12:00:58.850159+0000","last_unstale":"2023-10-08T12:01:00.490712+0000","last_undegraded":"2023-10-08T12:01:00.490712+0000","last_fullsized":"2023-10-08T12:01:00.490712+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_clean_scrub_stamp":"2023-10-08T12:00:57.809995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:08:18.855031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.490415+0000","last_change":"2023-10-08T12:00:59.327869+0000","last_active":"2023-10-08T12:01:00.490415+0000","last_peered":"2023-10-08T12:01:00.490415+0000","last_clean":"2023-10-08T12:01:00.490415+0000","last_became_active":"2023-10-08T12:00:59.327342+0000","last_became_peered":"2023-10-08T12:00:59.327342+0000","last_unstale":"2023-10-08T12:01:00.490415+0000","last_undegraded":"2023-10-08T12:01:00.490415+0000","last_fullsized":"2023-10-08T12:01:00.490415+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:52:49.534592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.275468+0000","last_change":"2023-10-08T12:00:58.859085+0000","last_active":"2023-10-08T12:01:00.275468+0000","last_peered":"2023-10-08T12:01:00.275468+0000","last_clean":"2023-10-08T12:01:00.275468+0000","last_became_active":"2023-10-08T12:00:58.858393+0000","last_became_peered":"2023-10-08T12:00:58.858393+0000","last_unstale":"2023-10-08T12:01:00.275468+0000","last_undegraded":"2023-10-08T12:01:00.275468+0000","last_fullsized":"2023-10-08T12:01:00.275468+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_clean_scrub_stamp":"2023-10-08T12:00:57.809995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:25:57.129561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.277087+0000","last_change":"2023-10-08T12:00:59.310754+0000","last_active":"2023-10-08T12:01:00.277087+0000","last_peered":"2023-10-08T12:01:00.277087+0000","last_clean":"2023-10-08T12:01:00.277087+0000","last_became_active":"2023-10-08T12:00:59.309890+0000","last_became_peered":"2023-10-08T12:00:59.309890+0000","last_unstale":"2023-10-08T12:01:00.277087+0000","last_undegraded":"2023-10-08T12:01:00.277087+0000","last_fullsized":"2023-10-08T12:01:00.277087+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:50:14.850224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.491997+0000","last_change":"2023-10-08T12:00:58.869186+0000","last_active":"2023-10-08T12:01:00.491997+0000","last_peered":"2023-10-08T12:01:00.491997+0000","last_clean":"2023-10-08T12:01:00.491997+0000","last_became_active":"2023-10-08T12:00:58.868754+0000","last_became_peered":"2023-10-08T12:00:58.868754+0000","last_unstale":"2023-10-08T12:01:00.491997+0000","last_undegraded":"2023-10-08T12:01:00.491997+0000","last_fullsized":"2023-10-08T12:01:00.491997+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_clean_scrub_stamp":"2023-10-08T12:00:57.809995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:46:57.007132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.491896+0000","last_change":"2023-10-08T12:00:59.308760+0000","last_active":"2023-10-08T12:01:00.491896+0000","last_peered":"2023-10-08T12:01:00.491896+0000","last_clean":"2023-10-08T12:01:00.491896+0000","last_became_active":"2023-10-08T12:00:59.308272+0000","last_became_peered":"2023-10-08T12:00:59.308272+0000","last_unstale":"2023-10-08T12:01:00.491896+0000","last_undegraded":"2023-10-08T12:01:00.491896+0000","last_fullsized":"2023-10-08T12:01:00.491896+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:30:04.982386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.270891+0000","last_change":"2023-10-08T12:00:58.856075+0000","last_active":"2023-10-08T12:01:00.270891+0000","last_peered":"2023-10-08T12:01:00.270891+0000","last_clean":"2023-10-08T12:01:00.270891+0000","last_became_active":"2023-10-08T12:00:58.855636+0000","last_became_peered":"2023-10-08T12:00:58.855636+0000","last_unstale":"2023-10-08T12:01:00.270891+0000","last_undegraded":"2023-10-08T12:01:00.270891+0000","last_fullsized":"2023-10-08T12:01:00.270891+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_clean_scrub_stamp":"2023-10-08T12:00:57.809995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:17:05.541315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.490981+0000","last_change":"2023-10-08T12:00:59.304968+0000","last_active":"2023-10-08T12:01:00.490981+0000","last_peered":"2023-10-08T12:01:00.490981+0000","last_clean":"2023-10-08T12:01:00.490981+0000","last_became_active":"2023-10-08T12:00:59.304068+0000","last_became_peered":"2023-10-08T12:00:59.304068+0000","last_unstale":"2023-10-08T12:01:00.490981+0000","last_undegraded":"2023-10-08T12:01:00.490981+0000","last_fullsized":"2023-10-08T12:01:00.490981+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:36:38.358206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"29'3","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.276641+0000","last_change":"2023-10-08T12:00:58.858569+0000","last_active":"2023-10-08T12:01:00.276641+0000","last_peered":"2023-10-08T12:01:00.276641+0000","last_clean":"2023-10-08T12:01:00.276641+0000","last_became_active":"2023-10-08T12:00:58.857850+0000","last_became_peered":"2023-10-08T12:00:58.857850+0000","last_unstale":"2023-10-08T12:01:00.276641+0000","last_undegraded":"2023-10-08T12:01:00.276641+0000","last_fullsized":"2023-10-08T12:01:00.276641+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_clean_scrub_stamp":"2023-10-08T12:00:57.809995+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:08:18.855031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.276256+0000","last_change":"2023-10-08T12:00:59.299988+0000","last_active":"2023-10-08T12:01:00.276256+0000","last_peered":"2023-10-08T12:01:00.276256+0000","last_clean":"2023-10-08T12:01:00.276256+0000","last_became_active":"2023-10-08T12:00:59.299140+0000","last_became_peered":"2023-10-08T12:00:59.299140+0000","last_unstale":"2023-10-08T12:01:00.276256+0000","last_undegraded":"2023-10-08T12:01:00.276256+0000","last_fullsized":"2023-10-08T12:01:00.276256+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:13:53.948012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"29'6","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.492141+0000","last_change":"2023-10-08T12:00:58.860625+0000","last_active":"2023-10-08T12:01:00.492141+0000","last_peered":"2023-10-08T12:01:00.492141+0000","last_clean":"2023-10-08T12:01:00.492141+0000","last_became_active":"2023-10-08T12:00:58.859937+0000","last_became_peered":"2023-10-08T12:00:58.859937+0000","last_unstale":"2023-10-08T12:01:00.492141+0000","last_undegraded":"2023-10-08T12:01:00.492141+0000","last_fullsized":"2023-10-08T12:01:00.492141+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_clean_scrub_stamp":"2023-10-08T12:00:57.809995+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:48:10.684261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.490628+0000","last_change":"2023-10-08T12:00:59.293895+0000","last_active":"2023-10-08T12:01:00.490628+0000","last_peered":"2023-10-08T12:01:00.490628+0000","last_clean":"2023-10-08T12:01:00.490628+0000","last_became_active":"2023-10-08T12:00:59.293162+0000","last_became_peered":"2023-10-08T12:00:59.293162+0000","last_unstale":"2023-10-08T12:01:00.490628+0000","last_undegraded":"2023-10-08T12:01:00.490628+0000","last_fullsized":"2023-10-08T12:01:00.490628+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:04:55.650551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"29'2","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.277748+0000","last_change":"2023-10-08T12:00:58.867959+0000","last_active":"2023-10-08T12:01:00.277748+0000","last_peered":"2023-10-08T12:01:00.277748+0000","last_clean":"2023-10-08T12:01:00.277748+0000","last_became_active":"2023-10-08T12:00:58.867301+0000","last_became_peered":"2023-10-08T12:00:58.867301+0000","last_unstale":"2023-10-08T12:01:00.277748+0000","last_undegraded":"2023-10-08T12:01:00.277748+0000","last_fullsized":"2023-10-08T12:01:00.277748+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_clean_scrub_stamp":"2023-10-08T12:00:57.809995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:23:37.337703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.491643+0000","last_change":"2023-10-08T12:00:59.310574+0000","last_active":"2023-10-08T12:01:00.491643+0000","last_peered":"2023-10-08T12:01:00.491643+0000","last_clean":"2023-10-08T12:01:00.491643+0000","last_became_active":"2023-10-08T12:00:59.309886+0000","last_became_peered":"2023-10-08T12:00:59.309886+0000","last_unstale":"2023-10-08T12:01:00.491643+0000","last_undegraded":"2023-10-08T12:01:00.491643+0000","last_fullsized":"2023-10-08T12:01:00.491643+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:07:29.225043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.490711+0000","last_change":"2023-10-08T12:00:58.869411+0000","last_active":"2023-10-08T12:01:00.490711+0000","last_peered":"2023-10-08T12:01:00.490711+0000","last_clean":"2023-10-08T12:01:00.490711+0000","last_became_active":"2023-10-08T12:00:58.868968+0000","last_became_peered":"2023-10-08T12:00:58.868968+0000","last_unstale":"2023-10-08T12:01:00.490711+0000","last_undegraded":"2023-10-08T12:01:00.490711+0000","last_fullsized":"2023-10-08T12:01:00.490711+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_clean_scrub_stamp":"2023-10-08T12:00:57.809995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:10:57.985113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.492089+0000","last_change":"2023-10-08T12:00:59.332429+0000","last_active":"2023-10-08T12:01:00.492089+0000","last_peered":"2023-10-08T12:01:00.492089+0000","last_clean":"2023-10-08T12:01:00.492089+0000","last_became_active":"2023-10-08T12:00:59.331849+0000","last_became_peered":"2023-10-08T12:00:59.331849+0000","last_unstale":"2023-10-08T12:01:00.492089+0000","last_undegraded":"2023-10-08T12:01:00.492089+0000","last_fullsized":"2023-10-08T12:01:00.492089+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:38:47.575293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.490798+0000","last_change":"2023-10-08T12:00:58.868991+0000","last_active":"2023-10-08T12:01:00.490798+0000","last_peered":"2023-10-08T12:01:00.490798+0000","last_clean":"2023-10-08T12:01:00.490798+0000","last_became_active":"2023-10-08T12:00:58.868656+0000","last_became_peered":"2023-10-08T12:00:58.868656+0000","last_unstale":"2023-10-08T12:01:00.490798+0000","last_undegraded":"2023-10-08T12:01:00.490798+0000","last_fullsized":"2023-10-08T12:01:00.490798+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_clean_scrub_stamp":"2023-10-08T12:00:57.809995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:04:54.639632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.488487+0000","last_change":"2023-10-08T12:00:59.316238+0000","last_active":"2023-10-08T12:01:00.488487+0000","last_peered":"2023-10-08T12:01:00.488487+0000","last_clean":"2023-10-08T12:01:00.488487+0000","last_became_active":"2023-10-08T12:00:59.315298+0000","last_became_peered":"2023-10-08T12:00:59.315298+0000","last_unstale":"2023-10-08T12:01:00.488487+0000","last_undegraded":"2023-10-08T12:01:00.488487+0000","last_fullsized":"2023-10-08T12:01:00.488487+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:10:15.110189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"29'8","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.490574+0000","last_change":"2023-10-08T12:00:58.854023+0000","last_active":"2023-10-08T12:01:00.490574+0000","last_peered":"2023-10-08T12:01:00.490574+0000","last_clean":"2023-10-08T12:01:00.490574+0000","last_became_active":"2023-10-08T12:00:58.853735+0000","last_became_peered":"2023-10-08T12:00:58.853735+0000","last_unstale":"2023-10-08T12:01:00.490574+0000","last_undegraded":"2023-10-08T12:01:00.490574+0000","last_fullsized":"2023-10-08T12:01:00.490574+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_clean_scrub_stamp":"2023-10-08T12:00:57.809995+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:59:20.160682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.277903+0000","last_change":"2023-10-08T12:00:59.316720+0000","last_active":"2023-10-08T12:01:00.277903+0000","last_peered":"2023-10-08T12:01:00.277903+0000","last_clean":"2023-10-08T12:01:00.277903+0000","last_became_active":"2023-10-08T12:00:59.315903+0000","last_became_peered":"2023-10-08T12:00:59.315903+0000","last_unstale":"2023-10-08T12:01:00.277903+0000","last_undegraded":"2023-10-08T12:01:00.277903+0000","last_fullsized":"2023-10-08T12:01:00.277903+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:08:19.865951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"29'1","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.492866+0000","last_change":"2023-10-08T12:00:58.865780+0000","last_active":"2023-10-08T12:01:00.492866+0000","last_peered":"2023-10-08T12:01:00.492866+0000","last_clean":"2023-10-08T12:01:00.492866+0000","last_became_active":"2023-10-08T12:00:58.865392+0000","last_became_peered":"2023-10-08T12:00:58.865392+0000","last_unstale":"2023-10-08T12:01:00.492866+0000","last_undegraded":"2023-10-08T12:01:00.492866+0000","last_fullsized":"2023-10-08T12:01:00.492866+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_clean_scrub_stamp":"2023-10-08T12:00:57.809995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:39:48.332296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.276530+0000","last_change":"2023-10-08T12:00:59.306902+0000","last_active":"2023-10-08T12:01:00.276530+0000","last_peered":"2023-10-08T12:01:00.276530+0000","last_clean":"2023-10-08T12:01:00.276530+0000","last_became_active":"2023-10-08T12:00:59.302406+0000","last_became_peered":"2023-10-08T12:00:59.302406+0000","last_unstale":"2023-10-08T12:01:00.276530+0000","last_undegraded":"2023-10-08T12:01:00.276530+0000","last_fullsized":"2023-10-08T12:01:00.276530+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:10:26.342879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"29'2","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.278128+0000","last_change":"2023-10-08T12:00:58.862915+0000","last_active":"2023-10-08T12:01:00.278128+0000","last_peered":"2023-10-08T12:01:00.278128+0000","last_clean":"2023-10-08T12:01:00.278128+0000","last_became_active":"2023-10-08T12:00:58.862232+0000","last_became_peered":"2023-10-08T12:00:58.862232+0000","last_unstale":"2023-10-08T12:01:00.278128+0000","last_undegraded":"2023-10-08T12:01:00.278128+0000","last_fullsized":"2023-10-08T12:01:00.278128+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_clean_scrub_stamp":"2023-10-08T12:00:57.809995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:10:14.099270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.491246+0000","last_change":"2023-10-08T12:00:59.302251+0000","last_active":"2023-10-08T12:01:00.491246+0000","last_peered":"2023-10-08T12:01:00.491246+0000","last_clean":"2023-10-08T12:01:00.491246+0000","last_became_active":"2023-10-08T12:00:59.301509+0000","last_became_peered":"2023-10-08T12:00:59.301509+0000","last_unstale":"2023-10-08T12:01:00.491246+0000","last_undegraded":"2023-10-08T12:01:00.491246+0000","last_fullsized":"2023-10-08T12:01:00.491246+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:35:21.196573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"29'1","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.277996+0000","last_change":"2023-10-08T12:00:58.859089+0000","last_active":"2023-10-08T12:01:00.277996+0000","last_peered":"2023-10-08T12:01:00.277996+0000","last_clean":"2023-10-08T12:01:00.277996+0000","last_became_active":"2023-10-08T12:00:58.858306+0000","last_became_peered":"2023-10-08T12:00:58.858306+0000","last_unstale":"2023-10-08T12:01:00.277996+0000","last_undegraded":"2023-10-08T12:01:00.277996+0000","last_fullsized":"2023-10-08T12:01:00.277996+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_clean_scrub_stamp":"2023-10-08T12:00:57.809995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:46:00.374725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.493901+0000","last_change":"2023-10-08T12:00:59.320653+0000","last_active":"2023-10-08T12:01:00.493901+0000","last_peered":"2023-10-08T12:01:00.493901+0000","last_clean":"2023-10-08T12:01:00.493901+0000","last_became_active":"2023-10-08T12:00:59.319939+0000","last_became_peered":"2023-10-08T12:00:59.319939+0000","last_unstale":"2023-10-08T12:01:00.493901+0000","last_undegraded":"2023-10-08T12:01:00.493901+0000","last_fullsized":"2023-10-08T12:01:00.493901+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:59:13.091504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.277983+0000","last_change":"2023-10-08T12:00:58.867143+0000","last_active":"2023-10-08T12:01:00.277983+0000","last_peered":"2023-10-08T12:01:00.277983+0000","last_clean":"2023-10-08T12:01:00.277983+0000","last_became_active":"2023-10-08T12:00:58.866464+0000","last_became_peered":"2023-10-08T12:00:58.866464+0000","last_unstale":"2023-10-08T12:01:00.277983+0000","last_undegraded":"2023-10-08T12:01:00.277983+0000","last_fullsized":"2023-10-08T12:01:00.277983+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_clean_scrub_stamp":"2023-10-08T12:00:57.809995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:42:19.640511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.493857+0000","last_change":"2023-10-08T12:00:59.288096+0000","last_active":"2023-10-08T12:01:00.493857+0000","last_peered":"2023-10-08T12:01:00.493857+0000","last_clean":"2023-10-08T12:01:00.493857+0000","last_became_active":"2023-10-08T12:00:59.287318+0000","last_became_peered":"2023-10-08T12:00:59.287318+0000","last_unstale":"2023-10-08T12:01:00.493857+0000","last_undegraded":"2023-10-08T12:01:00.493857+0000","last_fullsized":"2023-10-08T12:01:00.493857+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:40:47.328240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"29'2","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.270549+0000","last_change":"2023-10-08T12:00:58.858613+0000","last_active":"2023-10-08T12:01:00.270549+0000","last_peered":"2023-10-08T12:01:00.270549+0000","last_clean":"2023-10-08T12:01:00.270549+0000","last_became_active":"2023-10-08T12:00:58.857937+0000","last_became_peered":"2023-10-08T12:00:58.857937+0000","last_unstale":"2023-10-08T12:01:00.270549+0000","last_undegraded":"2023-10-08T12:01:00.270549+0000","last_fullsized":"2023-10-08T12:01:00.270549+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_clean_scrub_stamp":"2023-10-08T12:00:57.809995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:42:19.640511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.493816+0000","last_change":"2023-10-08T12:00:59.319507+0000","last_active":"2023-10-08T12:01:00.493816+0000","last_peered":"2023-10-08T12:01:00.493816+0000","last_clean":"2023-10-08T12:01:00.493816+0000","last_became_active":"2023-10-08T12:00:59.305712+0000","last_became_peered":"2023-10-08T12:00:59.305712+0000","last_unstale":"2023-10-08T12:01:00.493816+0000","last_undegraded":"2023-10-08T12:01:00.493816+0000","last_fullsized":"2023-10-08T12:01:00.493816+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:40:47.392326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.488721+0000","last_change":"2023-10-08T12:00:58.868295+0000","last_active":"2023-10-08T12:01:00.488721+0000","last_peered":"2023-10-08T12:01:00.488721+0000","last_clean":"2023-10-08T12:01:00.488721+0000","last_became_active":"2023-10-08T12:00:58.867603+0000","last_became_peered":"2023-10-08T12:00:58.867603+0000","last_unstale":"2023-10-08T12:01:00.488721+0000","last_undegraded":"2023-10-08T12:01:00.488721+0000","last_fullsized":"2023-10-08T12:01:00.488721+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_clean_scrub_stamp":"2023-10-08T12:00:57.809995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:34:11.481822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.494056+0000","last_change":"2023-10-08T12:00:59.304747+0000","last_active":"2023-10-08T12:01:00.494056+0000","last_peered":"2023-10-08T12:01:00.494056+0000","last_clean":"2023-10-08T12:01:00.494056+0000","last_became_active":"2023-10-08T12:00:59.304044+0000","last_became_peered":"2023-10-08T12:00:59.304044+0000","last_unstale":"2023-10-08T12:01:00.494056+0000","last_undegraded":"2023-10-08T12:01:00.494056+0000","last_fullsized":"2023-10-08T12:01:00.494056+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:31:03.542031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.275634+0000","last_change":"2023-10-08T12:00:58.860444+0000","last_active":"2023-10-08T12:01:00.275634+0000","last_peered":"2023-10-08T12:01:00.275634+0000","last_clean":"2023-10-08T12:01:00.275634+0000","last_became_active":"2023-10-08T12:00:58.859788+0000","last_became_peered":"2023-10-08T12:00:58.859788+0000","last_unstale":"2023-10-08T12:01:00.275634+0000","last_undegraded":"2023-10-08T12:01:00.275634+0000","last_fullsized":"2023-10-08T12:01:00.275634+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_clean_scrub_stamp":"2023-10-08T12:00:57.809995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:18:12.184835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.492121+0000","last_change":"2023-10-08T12:00:59.320569+0000","last_active":"2023-10-08T12:01:00.492121+0000","last_peered":"2023-10-08T12:01:00.492121+0000","last_clean":"2023-10-08T12:01:00.492121+0000","last_became_active":"2023-10-08T12:00:59.319788+0000","last_became_peered":"2023-10-08T12:00:59.319788+0000","last_unstale":"2023-10-08T12:01:00.492121+0000","last_undegraded":"2023-10-08T12:01:00.492121+0000","last_fullsized":"2023-10-08T12:01:00.492121+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:48:11.695180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.275162+0000","last_change":"2023-10-08T12:00:58.869489+0000","last_active":"2023-10-08T12:01:00.275162+0000","last_peered":"2023-10-08T12:01:00.275162+0000","last_clean":"2023-10-08T12:01:00.275162+0000","last_became_active":"2023-10-08T12:00:58.868829+0000","last_became_peered":"2023-10-08T12:00:58.868829+0000","last_unstale":"2023-10-08T12:01:00.275162+0000","last_undegraded":"2023-10-08T12:01:00.275162+0000","last_fullsized":"2023-10-08T12:01:00.275162+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_clean_scrub_stamp":"2023-10-08T12:00:57.809995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:39:48.332296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.494413+0000","last_change":"2023-10-08T12:00:59.291154+0000","last_active":"2023-10-08T12:01:00.494413+0000","last_peered":"2023-10-08T12:01:00.494413+0000","last_clean":"2023-10-08T12:01:00.494413+0000","last_became_active":"2023-10-08T12:00:59.290492+0000","last_became_peered":"2023-10-08T12:00:59.290492+0000","last_unstale":"2023-10-08T12:01:00.494413+0000","last_undegraded":"2023-10-08T12:01:00.494413+0000","last_fullsized":"2023-10-08T12:01:00.494413+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:25:58.140480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"29'2","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.492909+0000","last_change":"2023-10-08T12:00:58.870515+0000","last_active":"2023-10-08T12:01:00.492909+0000","last_peered":"2023-10-08T12:01:00.492909+0000","last_clean":"2023-10-08T12:01:00.492909+0000","last_became_active":"2023-10-08T12:00:58.869913+0000","last_became_peered":"2023-10-08T12:00:58.869913+0000","last_unstale":"2023-10-08T12:01:00.492909+0000","last_undegraded":"2023-10-08T12:01:00.492909+0000","last_fullsized":"2023-10-08T12:01:00.492909+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_clean_scrub_stamp":"2023-10-08T12:00:57.809995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:59:20.160682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.276875+0000","last_change":"2023-10-08T12:00:59.299051+0000","last_active":"2023-10-08T12:01:00.276875+0000","last_peered":"2023-10-08T12:01:00.276875+0000","last_clean":"2023-10-08T12:01:00.276875+0000","last_became_active":"2023-10-08T12:00:59.298347+0000","last_became_peered":"2023-10-08T12:00:59.298347+0000","last_unstale":"2023-10-08T12:01:00.276875+0000","last_undegraded":"2023-10-08T12:01:00.276875+0000","last_fullsized":"2023-10-08T12:01:00.276875+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:26:46.589443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.270930+0000","last_change":"2023-10-08T12:00:58.857680+0000","last_active":"2023-10-08T12:01:00.270930+0000","last_peered":"2023-10-08T12:01:00.270930+0000","last_clean":"2023-10-08T12:01:00.270930+0000","last_became_active":"2023-10-08T12:00:58.856452+0000","last_became_peered":"2023-10-08T12:00:58.856452+0000","last_unstale":"2023-10-08T12:01:00.270930+0000","last_undegraded":"2023-10-08T12:01:00.270930+0000","last_fullsized":"2023-10-08T12:01:00.270930+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_clean_scrub_stamp":"2023-10-08T12:00:57.809995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:40:18.668295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.270477+0000","last_change":"2023-10-08T12:00:59.312557+0000","last_active":"2023-10-08T12:01:00.270477+0000","last_peered":"2023-10-08T12:01:00.270477+0000","last_clean":"2023-10-08T12:01:00.270477+0000","last_became_active":"2023-10-08T12:00:59.309536+0000","last_became_peered":"2023-10-08T12:00:59.309536+0000","last_unstale":"2023-10-08T12:01:00.270477+0000","last_undegraded":"2023-10-08T12:01:00.270477+0000","last_fullsized":"2023-10-08T12:01:00.270477+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:24:55.963122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.491446+0000","last_change":"2023-10-08T12:00:58.861080+0000","last_active":"2023-10-08T12:01:00.491446+0000","last_peered":"2023-10-08T12:01:00.491446+0000","last_clean":"2023-10-08T12:01:00.491446+0000","last_became_active":"2023-10-08T12:00:58.860751+0000","last_became_peered":"2023-10-08T12:00:58.860751+0000","last_unstale":"2023-10-08T12:01:00.491446+0000","last_undegraded":"2023-10-08T12:01:00.491446+0000","last_fullsized":"2023-10-08T12:01:00.491446+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_clean_scrub_stamp":"2023-10-08T12:00:57.809995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:08:18.855031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.488702+0000","last_change":"2023-10-08T12:00:59.309067+0000","last_active":"2023-10-08T12:01:00.488702+0000","last_peered":"2023-10-08T12:01:00.488702+0000","last_clean":"2023-10-08T12:01:00.488702+0000","last_became_active":"2023-10-08T12:00:59.308183+0000","last_became_peered":"2023-10-08T12:00:59.308183+0000","last_unstale":"2023-10-08T12:01:00.488702+0000","last_undegraded":"2023-10-08T12:01:00.488702+0000","last_fullsized":"2023-10-08T12:01:00.488702+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:42:20.651431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.270629+0000","last_change":"2023-10-08T12:00:58.853253+0000","last_active":"2023-10-08T12:01:00.270629+0000","last_peered":"2023-10-08T12:01:00.270629+0000","last_clean":"2023-10-08T12:01:00.270629+0000","last_became_active":"2023-10-08T12:00:58.852882+0000","last_became_peered":"2023-10-08T12:00:58.852882+0000","last_unstale":"2023-10-08T12:01:00.270629+0000","last_undegraded":"2023-10-08T12:01:00.270629+0000","last_fullsized":"2023-10-08T12:01:00.270629+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_clean_scrub_stamp":"2023-10-08T12:00:57.809995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:10:14.099270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.270500+0000","last_change":"2023-10-08T12:00:59.314273+0000","last_active":"2023-10-08T12:01:00.270500+0000","last_peered":"2023-10-08T12:01:00.270500+0000","last_clean":"2023-10-08T12:01:00.270500+0000","last_became_active":"2023-10-08T12:00:59.313478+0000","last_became_peered":"2023-10-08T12:00:59.313478+0000","last_unstale":"2023-10-08T12:01:00.270500+0000","last_undegraded":"2023-10-08T12:01:00.270500+0000","last_fullsized":"2023-10-08T12:01:00.270500+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:04:21.118922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.490793+0000","last_change":"2023-10-08T12:00:58.871202+0000","last_active":"2023-10-08T12:01:00.490793+0000","last_peered":"2023-10-08T12:01:00.490793+0000","last_clean":"2023-10-08T12:01:00.490793+0000","last_became_active":"2023-10-08T12:00:58.870868+0000","last_became_peered":"2023-10-08T12:00:58.870868+0000","last_unstale":"2023-10-08T12:01:00.490793+0000","last_undegraded":"2023-10-08T12:01:00.490793+0000","last_fullsized":"2023-10-08T12:01:00.490793+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_clean_scrub_stamp":"2023-10-08T12:00:57.809995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:57:11.132667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.490416+0000","last_change":"2023-10-08T12:00:59.307386+0000","last_active":"2023-10-08T12:01:00.490416+0000","last_peered":"2023-10-08T12:01:00.490416+0000","last_clean":"2023-10-08T12:01:00.490416+0000","last_became_active":"2023-10-08T12:00:59.306883+0000","last_became_peered":"2023-10-08T12:00:59.306883+0000","last_unstale":"2023-10-08T12:01:00.490416+0000","last_undegraded":"2023-10-08T12:01:00.490416+0000","last_fullsized":"2023-10-08T12:01:00.490416+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:10:26.342879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.275751+0000","last_change":"2023-10-08T12:00:58.857194+0000","last_active":"2023-10-08T12:01:00.275751+0000","last_peered":"2023-10-08T12:01:00.275751+0000","last_clean":"2023-10-08T12:01:00.275751+0000","last_became_active":"2023-10-08T12:00:58.856516+0000","last_became_peered":"2023-10-08T12:00:58.856516+0000","last_unstale":"2023-10-08T12:01:00.275751+0000","last_undegraded":"2023-10-08T12:01:00.275751+0000","last_fullsized":"2023-10-08T12:01:00.275751+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_clean_scrub_stamp":"2023-10-08T12:00:57.809995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:17:05.541315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.275417+0000","last_change":"2023-10-08T12:00:59.307046+0000","last_active":"2023-10-08T12:01:00.275417+0000","last_peered":"2023-10-08T12:01:00.275417+0000","last_clean":"2023-10-08T12:01:00.275417+0000","last_became_active":"2023-10-08T12:00:59.306355+0000","last_became_peered":"2023-10-08T12:00:59.306355+0000","last_unstale":"2023-10-08T12:01:00.275417+0000","last_undegraded":"2023-10-08T12:01:00.275417+0000","last_fullsized":"2023-10-08T12:01:00.275417+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:24:55.963122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.490518+0000","last_change":"2023-10-08T12:00:58.869188+0000","last_active":"2023-10-08T12:01:00.490518+0000","last_peered":"2023-10-08T12:01:00.490518+0000","last_clean":"2023-10-08T12:01:00.490518+0000","last_became_active":"2023-10-08T12:00:58.868786+0000","last_became_peered":"2023-10-08T12:00:58.868786+0000","last_unstale":"2023-10-08T12:01:00.490518+0000","last_undegraded":"2023-10-08T12:01:00.490518+0000","last_fullsized":"2023-10-08T12:01:00.490518+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_clean_scrub_stamp":"2023-10-08T12:00:57.809995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:57:11.132667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.492438+0000","last_change":"2023-10-08T12:00:59.313441+0000","last_active":"2023-10-08T12:01:00.492438+0000","last_peered":"2023-10-08T12:01:00.492438+0000","last_clean":"2023-10-08T12:01:00.492438+0000","last_became_active":"2023-10-08T12:00:59.312551+0000","last_became_peered":"2023-10-08T12:00:59.312551+0000","last_unstale":"2023-10-08T12:01:00.492438+0000","last_undegraded":"2023-10-08T12:01:00.492438+0000","last_fullsized":"2023-10-08T12:01:00.492438+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:46:58.018052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.488179+0000","last_change":"2023-10-08T12:00:58.859077+0000","last_active":"2023-10-08T12:01:00.488179+0000","last_peered":"2023-10-08T12:01:00.488179+0000","last_clean":"2023-10-08T12:01:00.488179+0000","last_became_active":"2023-10-08T12:00:58.858432+0000","last_became_peered":"2023-10-08T12:00:58.858432+0000","last_unstale":"2023-10-08T12:01:00.488179+0000","last_undegraded":"2023-10-08T12:01:00.488179+0000","last_fullsized":"2023-10-08T12:01:00.488179+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_clean_scrub_stamp":"2023-10-08T12:00:57.809995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:55:21.623674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":173,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-08T12:00:59.299547+0000","last_change":"2023-10-08T12:00:08.887559+0000","last_active":"2023-10-08T12:00:59.299547+0000","last_peered":"2023-10-08T12:00:59.299547+0000","last_clean":"2023-10-08T12:00:59.299547+0000","last_became_active":"2023-10-08T12:00:08.884794+0000","last_became_peered":"2023-10-08T12:00:08.884794+0000","last_unstale":"2023-10-08T12:00:59.299547+0000","last_undegraded":"2023-10-08T12:00:59.299547+0000","last_fullsized":"2023-10-08T12:00:59.299547+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:07.812869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:07.812869+0000","last_clean_scrub_stamp":"2023-10-08T12:00:07.812869+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:58:36.123159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":933888,"data_stored":719491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0229999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.163}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0509999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94599999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":344064,"data_stored":129649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.256}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93799999999999994}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.363}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2230000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3400000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":344064,"data_stored":129705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.105}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94199999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":344064,"data_stored":129137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0189999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.274}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1020000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1990000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":352256,"data_stored":130667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0429999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.091}]}]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":339968,"data_stored":129103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2230000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1850000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.274}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":352256,"data_stored":130667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.8600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.4860000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.0910000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":10.920999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574861,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":929792,"data_stored":719401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.044}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.391}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.351}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T12:01:03.886 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T12:01:04.058 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.058+0000 7f4c8e140640 1 -- 172.21.15.62:0/3925742226 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4c880711f0 msgr2=0x7f4c88071660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:01:04.059 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.058+0000 7f4c8e140640 1 --2- 172.21.15.62:0/3925742226 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4c880711f0 0x7f4c88071660 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f4c8806fe90 tx=0x7f4c8001cc90 comp rx=0 tx=0).stop 2023-10-08T12:01:04.059 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.058+0000 7f4c8e140640 1 -- 172.21.15.62:0/3925742226 shutdown_connections 2023-10-08T12:01:04.059 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.058+0000 7f4c8e140640 1 --2- 172.21.15.62:0/3925742226 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4c880711f0 0x7f4c88071660 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:04.059 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.058+0000 7f4c8e140640 1 --2- 172.21.15.62:0/3925742226 >> v2:172.21.15.130:3300/0 conn(0x7f4c8806e920 0x7f4c8814b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:04.059 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.058+0000 7f4c8e140640 1 -- 172.21.15.62:0/3925742226 >> 172.21.15.62:0/3925742226 conn(0x7f4c8809e700 msgr2=0x7f4c8809eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:01:04.059 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.058+0000 7f4c8e140640 1 -- 172.21.15.62:0/3925742226 shutdown_connections 2023-10-08T12:01:04.060 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.058+0000 7f4c8e140640 1 -- 172.21.15.62:0/3925742226 wait complete. 2023-10-08T12:01:04.062 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.058+0000 7f4c8e140640 1 Processor -- start 2023-10-08T12:01:04.062 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.058+0000 7f4c8e140640 1 -- start start 2023-10-08T12:01:04.062 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.058+0000 7f4c8e140640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4c8806e920 0x7f4c881e5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:01:04.062 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.058+0000 7f4c8e140640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4c880711f0 0x7f4c8806bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:01:04.062 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.058+0000 7f4c8e140640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4c8814ae40 0x7f4c880b5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:01:04.062 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.058+0000 7f4c8e140640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8806c970 con 0x7f4c880711f0 2023-10-08T12:01:04.062 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.058+0000 7f4c8e140640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8806bae0 con 0x7f4c8814ae40 2023-10-08T12:01:04.062 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.058+0000 7f4c8e140640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c880b6520 con 0x7f4c8806e920 2023-10-08T12:01:04.063 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.058+0000 7f4c86ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4c880711f0 0x7f4c8806bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:01:04.063 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.058+0000 7f4c86ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4c880711f0 0x7f4c8806bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46454/0 (socket says 172.21.15.62:46454) 2023-10-08T12:01:04.063 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.058+0000 7f4c86ffd640 1 -- 172.21.15.62:0/4290124753 learned_addr learned my addr 172.21.15.62:0/4290124753 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:01:04.063 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.058+0000 7f4c86ffd640 1 -- 172.21.15.62:0/4290124753 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4c8806e920 msgr2=0x7f4c881e5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:01:04.063 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.058+0000 7f4c877fe640 1 --2- 172.21.15.62:0/4290124753 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4c8806e920 0x7f4c881e5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:01:04.063 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.058+0000 7f4c87fff640 1 --2- 172.21.15.62:0/4290124753 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4c8814ae40 0x7f4c880b5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:01:04.063 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.058+0000 7f4c86ffd640 1 --2- 172.21.15.62:0/4290124753 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4c8806e920 0x7f4c881e5aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:04.063 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.058+0000 7f4c86ffd640 1 -- 172.21.15.62:0/4290124753 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4c8814ae40 msgr2=0x7f4c880b5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:01:04.063 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.058+0000 7f4c86ffd640 1 --2- 172.21.15.62:0/4290124753 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4c8814ae40 0x7f4c880b5fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:04.063 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.058+0000 7f4c86ffd640 1 -- 172.21.15.62:0/4290124753 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c800098e0 con 0x7f4c880711f0 2023-10-08T12:01:04.063 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.058+0000 7f4c86ffd640 1 --2- 172.21.15.62:0/4290124753 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4c880711f0 0x7f4c8806bf00 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c00b550 tx=0x7f4c7c00ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:01:04.064 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.058+0000 7f4c6ffff640 1 -- 172.21.15.62:0/4290124753 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c7c010870 con 0x7f4c880711f0 2023-10-08T12:01:04.064 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.058+0000 7f4c6ffff640 1 -- 172.21.15.62:0/4290124753 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4c7c010ae0 con 0x7f4c880711f0 2023-10-08T12:01:04.064 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.058+0000 7f4c8e140640 1 -- 172.21.15.62:0/4290124753 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c8806b740 con 0x7f4c880711f0 2023-10-08T12:01:04.064 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.058+0000 7f4c6ffff640 1 -- 172.21.15.62:0/4290124753 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c7c00f3c0 con 0x7f4c880711f0 2023-10-08T12:01:04.064 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.058+0000 7f4c8e140640 1 -- 172.21.15.62:0/4290124753 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c880b68a0 con 0x7f4c880711f0 2023-10-08T12:01:04.064 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.062+0000 7f4c8e140640 1 -- 172.21.15.62:0/4290124753 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c880739e0 con 0x7f4c880711f0 2023-10-08T12:01:04.064 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.062+0000 7f4c6ffff640 1 -- 172.21.15.62:0/4290124753 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4c7c00f520 con 0x7f4c880711f0 2023-10-08T12:01:04.065 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.062+0000 7f4c6ffff640 1 --2- 172.21.15.62:0/4290124753 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f4c74066470 0x7f4c74068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:01:04.065 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.062+0000 7f4c6ffff640 1 -- 172.21.15.62:0/4290124753 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4c7c084070 con 0x7f4c880711f0 2023-10-08T12:01:04.065 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.062+0000 7f4c877fe640 1 --2- 172.21.15.62:0/4290124753 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f4c74066470 0x7f4c74068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:01:04.065 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.062+0000 7f4c877fe640 1 --2- 172.21.15.62:0/4290124753 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f4c74066470 0x7f4c74068930 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4c7800a790 tx=0x7f4c78008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:01:04.067 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.066+0000 7f4c6ffff640 1 -- 172.21.15.62:0/4290124753 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4c7c0514f0 con 0x7f4c880711f0 2023-10-08T12:01:04.214 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.214+0000 7f4c8e140640 1 -- 172.21.15.62:0/4290124753 --> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4c8806d3c0 con 0x7f4c74066470 2023-10-08T12:01:04.234 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.234+0000 7f4c6ffff640 1 -- 172.21.15.62:0/4290124753 <== mgr.4111 v2:172.21.15.130:6832/826384843 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264571 (secure 0 0 0) 0x7f4c7800a430 con 0x7f4c74066470 2023-10-08T12:01:04.237 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T12:01:04.238 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2023-10-08T12:01:04.239 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.238+0000 7f4c8e140640 1 -- 172.21.15.62:0/4290124753 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f4c74066470 msgr2=0x7f4c74068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:01:04.239 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.238+0000 7f4c8e140640 1 --2- 172.21.15.62:0/4290124753 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f4c74066470 0x7f4c74068930 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4c7800a790 tx=0x7f4c78008040 comp rx=0 tx=0).stop 2023-10-08T12:01:04.239 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.238+0000 7f4c8e140640 1 -- 172.21.15.62:0/4290124753 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4c880711f0 msgr2=0x7f4c8806bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:01:04.240 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.238+0000 7f4c8e140640 1 --2- 172.21.15.62:0/4290124753 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4c880711f0 0x7f4c8806bf00 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c00b550 tx=0x7f4c7c00ba10 comp rx=0 tx=0).stop 2023-10-08T12:01:04.240 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.238+0000 7f4c8e140640 1 -- 172.21.15.62:0/4290124753 shutdown_connections 2023-10-08T12:01:04.240 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.238+0000 7f4c8e140640 1 --2- 172.21.15.62:0/4290124753 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f4c74066470 0x7f4c74068930 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:04.240 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.238+0000 7f4c8e140640 1 --2- 172.21.15.62:0/4290124753 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4c8814ae40 0x7f4c880b5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:04.240 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.238+0000 7f4c8e140640 1 --2- 172.21.15.62:0/4290124753 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4c880711f0 0x7f4c8806bf00 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:04.240 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.238+0000 7f4c8e140640 1 --2- 172.21.15.62:0/4290124753 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4c8806e920 0x7f4c881e5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:04.240 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.238+0000 7f4c8e140640 1 -- 172.21.15.62:0/4290124753 >> 172.21.15.62:0/4290124753 conn(0x7f4c8809e700 msgr2=0x7f4c880b93e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:01:04.240 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.238+0000 7f4c8e140640 1 -- 172.21.15.62:0/4290124753 shutdown_connections 2023-10-08T12:01:04.241 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.238+0000 7f4c8e140640 1 -- 172.21.15.62:0/4290124753 wait complete. 2023-10-08T12:01:04.253 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":51,"stamp":"2023-10-08T12:01:03.125807+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":139,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220056,"kb_used_data":3848,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754664,"statfs":{"total":773094113280,"available":772868775936,"internally_reserved":0,"allocated":3940352,"data_stored":2217820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":72,"apply_latency_ms":72,"commit_latency_ns":72000000,"apply_latency_ns":72000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.302776"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.488786+0000","last_change":"2023-10-08T12:00:59.328912+0000","last_active":"2023-10-08T12:01:00.488786+0000","last_peered":"2023-10-08T12:01:00.488786+0000","last_clean":"2023-10-08T12:01:00.488786+0000","last_became_active":"2023-10-08T12:00:59.327949+0000","last_became_peered":"2023-10-08T12:00:59.327949+0000","last_unstale":"2023-10-08T12:01:00.488786+0000","last_undegraded":"2023-10-08T12:01:00.488786+0000","last_fullsized":"2023-10-08T12:01:00.488786+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:24:55.963122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.491370+0000","last_change":"2023-10-08T12:00:59.306546+0000","last_active":"2023-10-08T12:01:00.491370+0000","last_peered":"2023-10-08T12:01:00.491370+0000","last_clean":"2023-10-08T12:01:00.491370+0000","last_became_active":"2023-10-08T12:00:59.305842+0000","last_became_peered":"2023-10-08T12:00:59.305842+0000","last_unstale":"2023-10-08T12:01:00.491370+0000","last_undegraded":"2023-10-08T12:01:00.491370+0000","last_fullsized":"2023-10-08T12:01:00.491370+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:34:52.628775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.276570+0000","last_change":"2023-10-08T12:00:59.299204+0000","last_active":"2023-10-08T12:01:00.276570+0000","last_peered":"2023-10-08T12:01:00.276570+0000","last_clean":"2023-10-08T12:01:00.276570+0000","last_became_active":"2023-10-08T12:00:59.298508+0000","last_became_peered":"2023-10-08T12:00:59.298508+0000","last_unstale":"2023-10-08T12:01:00.276570+0000","last_undegraded":"2023-10-08T12:01:00.276570+0000","last_fullsized":"2023-10-08T12:01:00.276570+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:36:38.358206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.491117+0000","last_change":"2023-10-08T12:00:59.315841+0000","last_active":"2023-10-08T12:01:00.491117+0000","last_peered":"2023-10-08T12:01:00.491117+0000","last_clean":"2023-10-08T12:01:00.491117+0000","last_became_active":"2023-10-08T12:00:59.315067+0000","last_became_peered":"2023-10-08T12:00:59.315067+0000","last_unstale":"2023-10-08T12:01:00.491117+0000","last_undegraded":"2023-10-08T12:01:00.491117+0000","last_fullsized":"2023-10-08T12:01:00.491117+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:38:47.575293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.493536+0000","last_change":"2023-10-08T12:00:59.295891+0000","last_active":"2023-10-08T12:01:00.493536+0000","last_peered":"2023-10-08T12:01:00.493536+0000","last_clean":"2023-10-08T12:01:00.493536+0000","last_became_active":"2023-10-08T12:00:59.295385+0000","last_became_peered":"2023-10-08T12:00:59.295385+0000","last_unstale":"2023-10-08T12:01:00.493536+0000","last_undegraded":"2023-10-08T12:01:00.493536+0000","last_fullsized":"2023-10-08T12:01:00.493536+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:23:13.468633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.491036+0000","last_change":"2023-10-08T12:00:59.316182+0000","last_active":"2023-10-08T12:01:00.491036+0000","last_peered":"2023-10-08T12:01:00.491036+0000","last_clean":"2023-10-08T12:01:00.491036+0000","last_became_active":"2023-10-08T12:00:59.315456+0000","last_became_peered":"2023-10-08T12:00:59.315456+0000","last_unstale":"2023-10-08T12:01:00.491036+0000","last_undegraded":"2023-10-08T12:01:00.491036+0000","last_fullsized":"2023-10-08T12:01:00.491036+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:26:46.589443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.492273+0000","last_change":"2023-10-08T12:00:59.319487+0000","last_active":"2023-10-08T12:01:00.492273+0000","last_peered":"2023-10-08T12:01:00.492273+0000","last_clean":"2023-10-08T12:01:00.492273+0000","last_became_active":"2023-10-08T12:00:59.318719+0000","last_became_peered":"2023-10-08T12:00:59.318719+0000","last_unstale":"2023-10-08T12:01:00.492273+0000","last_undegraded":"2023-10-08T12:01:00.492273+0000","last_fullsized":"2023-10-08T12:01:00.492273+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:13:53.948012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.491685+0000","last_change":"2023-10-08T12:00:59.317272+0000","last_active":"2023-10-08T12:01:00.491685+0000","last_peered":"2023-10-08T12:01:00.491685+0000","last_clean":"2023-10-08T12:01:00.491685+0000","last_became_active":"2023-10-08T12:00:59.312616+0000","last_became_peered":"2023-10-08T12:00:59.312616+0000","last_unstale":"2023-10-08T12:01:00.491685+0000","last_undegraded":"2023-10-08T12:01:00.491685+0000","last_fullsized":"2023-10-08T12:01:00.491685+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:52:49.534592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.278507+0000","last_change":"2023-10-08T12:00:59.310072+0000","last_active":"2023-10-08T12:01:00.278507+0000","last_peered":"2023-10-08T12:01:00.278507+0000","last_clean":"2023-10-08T12:01:00.278507+0000","last_became_active":"2023-10-08T12:00:59.309213+0000","last_became_peered":"2023-10-08T12:00:59.309213+0000","last_unstale":"2023-10-08T12:01:00.278507+0000","last_undegraded":"2023-10-08T12:01:00.278507+0000","last_fullsized":"2023-10-08T12:01:00.278507+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:52:49.534592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.492617+0000","last_change":"2023-10-08T12:00:59.308146+0000","last_active":"2023-10-08T12:01:00.492617+0000","last_peered":"2023-10-08T12:01:00.492617+0000","last_clean":"2023-10-08T12:01:00.492617+0000","last_became_active":"2023-10-08T12:00:59.306815+0000","last_became_peered":"2023-10-08T12:00:59.306815+0000","last_unstale":"2023-10-08T12:01:00.492617+0000","last_undegraded":"2023-10-08T12:01:00.492617+0000","last_fullsized":"2023-10-08T12:01:00.492617+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:46:58.018052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.492423+0000","last_change":"2023-10-08T12:00:59.320469+0000","last_active":"2023-10-08T12:01:00.492423+0000","last_peered":"2023-10-08T12:01:00.492423+0000","last_clean":"2023-10-08T12:01:00.492423+0000","last_became_active":"2023-10-08T12:00:59.319570+0000","last_became_peered":"2023-10-08T12:00:59.319570+0000","last_unstale":"2023-10-08T12:01:00.492423+0000","last_undegraded":"2023-10-08T12:01:00.492423+0000","last_fullsized":"2023-10-08T12:01:00.492423+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:10:26.342879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.276055+0000","last_change":"2023-10-08T12:00:59.297464+0000","last_active":"2023-10-08T12:01:00.276055+0000","last_peered":"2023-10-08T12:01:00.276055+0000","last_clean":"2023-10-08T12:01:00.276055+0000","last_became_active":"2023-10-08T12:00:59.296704+0000","last_became_peered":"2023-10-08T12:00:59.296704+0000","last_unstale":"2023-10-08T12:01:00.276055+0000","last_undegraded":"2023-10-08T12:01:00.276055+0000","last_fullsized":"2023-10-08T12:01:00.276055+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:48:11.695180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.493676+0000","last_change":"2023-10-08T12:00:59.296170+0000","last_active":"2023-10-08T12:01:00.493676+0000","last_peered":"2023-10-08T12:01:00.493676+0000","last_clean":"2023-10-08T12:01:00.493676+0000","last_became_active":"2023-10-08T12:00:59.295664+0000","last_became_peered":"2023-10-08T12:00:59.295664+0000","last_unstale":"2023-10-08T12:01:00.493676+0000","last_undegraded":"2023-10-08T12:01:00.493676+0000","last_fullsized":"2023-10-08T12:01:00.493676+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:23:43.231108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.491179+0000","last_change":"2023-10-08T12:00:59.300150+0000","last_active":"2023-10-08T12:01:00.491179+0000","last_peered":"2023-10-08T12:01:00.491179+0000","last_clean":"2023-10-08T12:01:00.491179+0000","last_became_active":"2023-10-08T12:00:59.299633+0000","last_became_peered":"2023-10-08T12:00:59.299633+0000","last_unstale":"2023-10-08T12:01:00.491179+0000","last_undegraded":"2023-10-08T12:01:00.491179+0000","last_fullsized":"2023-10-08T12:01:00.491179+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:50:14.850224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.277358+0000","last_change":"2023-10-08T12:00:59.312944+0000","last_active":"2023-10-08T12:01:00.277358+0000","last_peered":"2023-10-08T12:01:00.277358+0000","last_clean":"2023-10-08T12:01:00.277358+0000","last_became_active":"2023-10-08T12:00:59.312211+0000","last_became_peered":"2023-10-08T12:00:59.312211+0000","last_unstale":"2023-10-08T12:01:00.277358+0000","last_undegraded":"2023-10-08T12:01:00.277358+0000","last_fullsized":"2023-10-08T12:01:00.277358+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:34:52.628775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.492892+0000","last_change":"2023-10-08T12:00:59.316166+0000","last_active":"2023-10-08T12:01:00.492892+0000","last_peered":"2023-10-08T12:01:00.492892+0000","last_clean":"2023-10-08T12:01:00.492892+0000","last_became_active":"2023-10-08T12:00:59.314446+0000","last_became_peered":"2023-10-08T12:00:59.314446+0000","last_unstale":"2023-10-08T12:01:00.492892+0000","last_undegraded":"2023-10-08T12:01:00.492892+0000","last_fullsized":"2023-10-08T12:01:00.492892+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:50:14.850224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.492806+0000","last_change":"2023-10-08T12:00:59.313914+0000","last_active":"2023-10-08T12:01:00.492806+0000","last_peered":"2023-10-08T12:01:00.492806+0000","last_clean":"2023-10-08T12:01:00.492806+0000","last_became_active":"2023-10-08T12:00:59.313104+0000","last_became_peered":"2023-10-08T12:00:59.313104+0000","last_unstale":"2023-10-08T12:01:00.492806+0000","last_undegraded":"2023-10-08T12:01:00.492806+0000","last_fullsized":"2023-10-08T12:01:00.492806+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:26:46.589443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.491692+0000","last_change":"2023-10-08T12:00:59.310991+0000","last_active":"2023-10-08T12:01:00.491692+0000","last_peered":"2023-10-08T12:01:00.491692+0000","last_clean":"2023-10-08T12:01:00.491692+0000","last_became_active":"2023-10-08T12:00:59.308914+0000","last_became_peered":"2023-10-08T12:00:59.308914+0000","last_unstale":"2023-10-08T12:01:00.491692+0000","last_undegraded":"2023-10-08T12:01:00.491692+0000","last_fullsized":"2023-10-08T12:01:00.491692+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:59:51.948361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.491619+0000","last_change":"2023-10-08T12:00:59.299080+0000","last_active":"2023-10-08T12:01:00.491619+0000","last_peered":"2023-10-08T12:01:00.491619+0000","last_clean":"2023-10-08T12:01:00.491619+0000","last_became_active":"2023-10-08T12:00:59.298311+0000","last_became_peered":"2023-10-08T12:00:59.298311+0000","last_unstale":"2023-10-08T12:01:00.491619+0000","last_undegraded":"2023-10-08T12:01:00.491619+0000","last_fullsized":"2023-10-08T12:01:00.491619+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:56:51.310559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.494111+0000","last_change":"2023-10-08T12:00:59.291240+0000","last_active":"2023-10-08T12:01:00.494111+0000","last_peered":"2023-10-08T12:01:00.494111+0000","last_clean":"2023-10-08T12:01:00.494111+0000","last_became_active":"2023-10-08T12:00:59.290470+0000","last_became_peered":"2023-10-08T12:00:59.290470+0000","last_unstale":"2023-10-08T12:01:00.494111+0000","last_undegraded":"2023-10-08T12:01:00.494111+0000","last_fullsized":"2023-10-08T12:01:00.494111+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:18:13.195755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.276320+0000","last_change":"2023-10-08T12:00:59.309527+0000","last_active":"2023-10-08T12:01:00.276320+0000","last_peered":"2023-10-08T12:01:00.276320+0000","last_clean":"2023-10-08T12:01:00.276320+0000","last_became_active":"2023-10-08T12:00:59.308805+0000","last_became_peered":"2023-10-08T12:00:59.308805+0000","last_unstale":"2023-10-08T12:01:00.276320+0000","last_undegraded":"2023-10-08T12:01:00.276320+0000","last_fullsized":"2023-10-08T12:01:00.276320+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:39:49.343216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.276530+0000","last_change":"2023-10-08T12:00:59.308602+0000","last_active":"2023-10-08T12:01:00.276530+0000","last_peered":"2023-10-08T12:01:00.276530+0000","last_clean":"2023-10-08T12:01:00.276530+0000","last_became_active":"2023-10-08T12:00:59.307874+0000","last_became_peered":"2023-10-08T12:00:59.307874+0000","last_unstale":"2023-10-08T12:01:00.276530+0000","last_undegraded":"2023-10-08T12:01:00.276530+0000","last_fullsized":"2023-10-08T12:01:00.276530+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:10:58.996032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.270325+0000","last_change":"2023-10-08T12:00:59.314810+0000","last_active":"2023-10-08T12:01:00.270325+0000","last_peered":"2023-10-08T12:01:00.270325+0000","last_clean":"2023-10-08T12:01:00.270325+0000","last_became_active":"2023-10-08T12:00:59.314330+0000","last_became_peered":"2023-10-08T12:00:59.314330+0000","last_unstale":"2023-10-08T12:01:00.270325+0000","last_undegraded":"2023-10-08T12:01:00.270325+0000","last_fullsized":"2023-10-08T12:01:00.270325+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:46:01.385644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.274926+0000","last_change":"2023-10-08T12:00:59.297318+0000","last_active":"2023-10-08T12:01:00.274926+0000","last_peered":"2023-10-08T12:01:00.274926+0000","last_clean":"2023-10-08T12:01:00.274926+0000","last_became_active":"2023-10-08T12:00:59.296222+0000","last_became_peered":"2023-10-08T12:00:59.296222+0000","last_unstale":"2023-10-08T12:01:00.274926+0000","last_undegraded":"2023-10-08T12:01:00.274926+0000","last_fullsized":"2023-10-08T12:01:00.274926+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:38:47.575293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.492700+0000","last_change":"2023-10-08T12:00:59.315135+0000","last_active":"2023-10-08T12:01:00.492700+0000","last_peered":"2023-10-08T12:01:00.492700+0000","last_clean":"2023-10-08T12:01:00.492700+0000","last_became_active":"2023-10-08T12:00:59.313654+0000","last_became_peered":"2023-10-08T12:00:59.313654+0000","last_unstale":"2023-10-08T12:01:00.492700+0000","last_undegraded":"2023-10-08T12:01:00.492700+0000","last_fullsized":"2023-10-08T12:01:00.492700+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:10:26.342879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.492032+0000","last_change":"2023-10-08T12:00:59.307172+0000","last_active":"2023-10-08T12:01:00.492032+0000","last_peered":"2023-10-08T12:01:00.492032+0000","last_clean":"2023-10-08T12:01:00.492032+0000","last_became_active":"2023-10-08T12:00:59.306320+0000","last_became_peered":"2023-10-08T12:00:59.306320+0000","last_unstale":"2023-10-08T12:01:00.492032+0000","last_undegraded":"2023-10-08T12:01:00.492032+0000","last_fullsized":"2023-10-08T12:01:00.492032+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:01:53.038702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.492008+0000","last_change":"2023-10-08T12:00:59.315493+0000","last_active":"2023-10-08T12:01:00.492008+0000","last_peered":"2023-10-08T12:01:00.492008+0000","last_clean":"2023-10-08T12:01:00.492008+0000","last_became_active":"2023-10-08T12:00:59.314765+0000","last_became_peered":"2023-10-08T12:00:59.314765+0000","last_unstale":"2023-10-08T12:01:00.492008+0000","last_undegraded":"2023-10-08T12:01:00.492008+0000","last_fullsized":"2023-10-08T12:01:00.492008+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:48:11.695180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.276373+0000","last_change":"2023-10-08T12:00:59.301740+0000","last_active":"2023-10-08T12:01:00.276373+0000","last_peered":"2023-10-08T12:01:00.276373+0000","last_clean":"2023-10-08T12:01:00.276373+0000","last_became_active":"2023-10-08T12:00:59.301009+0000","last_became_peered":"2023-10-08T12:00:59.301009+0000","last_unstale":"2023-10-08T12:01:00.276373+0000","last_undegraded":"2023-10-08T12:01:00.276373+0000","last_fullsized":"2023-10-08T12:01:00.276373+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:46:58.018052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.277282+0000","last_change":"2023-10-08T12:00:59.306972+0000","last_active":"2023-10-08T12:01:00.277282+0000","last_peered":"2023-10-08T12:01:00.277282+0000","last_clean":"2023-10-08T12:01:00.277282+0000","last_became_active":"2023-10-08T12:00:59.306239+0000","last_became_peered":"2023-10-08T12:00:59.306239+0000","last_unstale":"2023-10-08T12:01:00.277282+0000","last_undegraded":"2023-10-08T12:01:00.277282+0000","last_fullsized":"2023-10-08T12:01:00.277282+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:59:21.171602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.492112+0000","last_change":"2023-10-08T12:00:59.319944+0000","last_active":"2023-10-08T12:01:00.492112+0000","last_peered":"2023-10-08T12:01:00.492112+0000","last_clean":"2023-10-08T12:01:00.492112+0000","last_became_active":"2023-10-08T12:00:59.319135+0000","last_became_peered":"2023-10-08T12:00:59.319135+0000","last_unstale":"2023-10-08T12:01:00.492112+0000","last_undegraded":"2023-10-08T12:01:00.492112+0000","last_fullsized":"2023-10-08T12:01:00.492112+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:35:21.196573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.488524+0000","last_change":"2023-10-08T12:00:59.302015+0000","last_active":"2023-10-08T12:01:00.488524+0000","last_peered":"2023-10-08T12:01:00.488524+0000","last_clean":"2023-10-08T12:01:00.488524+0000","last_became_active":"2023-10-08T12:00:59.301258+0000","last_became_peered":"2023-10-08T12:00:59.301258+0000","last_unstale":"2023-10-08T12:01:00.488524+0000","last_undegraded":"2023-10-08T12:01:00.488524+0000","last_fullsized":"2023-10-08T12:01:00.488524+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:46:01.385644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.491847+0000","last_change":"2023-10-08T12:00:59.316672+0000","last_active":"2023-10-08T12:01:00.491847+0000","last_peered":"2023-10-08T12:01:00.491847+0000","last_clean":"2023-10-08T12:01:00.491847+0000","last_became_active":"2023-10-08T12:00:59.315393+0000","last_became_peered":"2023-10-08T12:00:59.315393+0000","last_unstale":"2023-10-08T12:01:00.491847+0000","last_undegraded":"2023-10-08T12:01:00.491847+0000","last_fullsized":"2023-10-08T12:01:00.491847+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:04:55.650551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.270805+0000","last_change":"2023-10-08T12:00:59.314538+0000","last_active":"2023-10-08T12:01:00.270805+0000","last_peered":"2023-10-08T12:01:00.270805+0000","last_clean":"2023-10-08T12:01:00.270805+0000","last_became_active":"2023-10-08T12:00:59.313914+0000","last_became_peered":"2023-10-08T12:00:59.313914+0000","last_unstale":"2023-10-08T12:01:00.270805+0000","last_undegraded":"2023-10-08T12:01:00.270805+0000","last_fullsized":"2023-10-08T12:01:00.270805+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:39:49.343216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"29'4","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.488950+0000","last_change":"2023-10-08T12:00:58.867252+0000","last_active":"2023-10-08T12:01:00.488950+0000","last_peered":"2023-10-08T12:01:00.488950+0000","last_clean":"2023-10-08T12:01:00.488950+0000","last_became_active":"2023-10-08T12:00:58.866544+0000","last_became_peered":"2023-10-08T12:00:58.866544+0000","last_unstale":"2023-10-08T12:01:00.488950+0000","last_undegraded":"2023-10-08T12:01:00.488950+0000","last_fullsized":"2023-10-08T12:01:00.488950+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_clean_scrub_stamp":"2023-10-08T12:00:57.809995+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:40:18.668295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.488978+0000","last_change":"2023-10-08T12:00:59.316154+0000","last_active":"2023-10-08T12:01:00.488978+0000","last_peered":"2023-10-08T12:01:00.488978+0000","last_clean":"2023-10-08T12:01:00.488978+0000","last_became_active":"2023-10-08T12:00:59.315415+0000","last_became_peered":"2023-10-08T12:00:59.315415+0000","last_unstale":"2023-10-08T12:01:00.488978+0000","last_undegraded":"2023-10-08T12:01:00.488978+0000","last_fullsized":"2023-10-08T12:01:00.488978+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:04:21.118922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"29'1","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.270850+0000","last_change":"2023-10-08T12:00:58.865199+0000","last_active":"2023-10-08T12:01:00.270850+0000","last_peered":"2023-10-08T12:01:00.270850+0000","last_clean":"2023-10-08T12:01:00.270850+0000","last_became_active":"2023-10-08T12:00:58.864908+0000","last_became_peered":"2023-10-08T12:00:58.864908+0000","last_unstale":"2023-10-08T12:01:00.270850+0000","last_undegraded":"2023-10-08T12:01:00.270850+0000","last_fullsized":"2023-10-08T12:01:00.270850+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_clean_scrub_stamp":"2023-10-08T12:00:57.809995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:34:11.481822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.277800+0000","last_change":"2023-10-08T12:00:59.308985+0000","last_active":"2023-10-08T12:01:00.277800+0000","last_peered":"2023-10-08T12:01:00.277800+0000","last_clean":"2023-10-08T12:01:00.277800+0000","last_became_active":"2023-10-08T12:00:59.307972+0000","last_became_peered":"2023-10-08T12:00:59.307972+0000","last_unstale":"2023-10-08T12:01:00.277800+0000","last_undegraded":"2023-10-08T12:01:00.277800+0000","last_fullsized":"2023-10-08T12:01:00.277800+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:57:12.143587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"29'2","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.491887+0000","last_change":"2023-10-08T12:00:58.861971+0000","last_active":"2023-10-08T12:01:00.491887+0000","last_peered":"2023-10-08T12:01:00.491887+0000","last_clean":"2023-10-08T12:01:00.491887+0000","last_became_active":"2023-10-08T12:00:58.861320+0000","last_became_peered":"2023-10-08T12:00:58.861320+0000","last_unstale":"2023-10-08T12:01:00.491887+0000","last_undegraded":"2023-10-08T12:01:00.491887+0000","last_fullsized":"2023-10-08T12:01:00.491887+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_clean_scrub_stamp":"2023-10-08T12:00:57.809995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:13:52.937093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.492140+0000","last_change":"2023-10-08T12:00:59.315073+0000","last_active":"2023-10-08T12:01:00.492140+0000","last_peered":"2023-10-08T12:01:00.492140+0000","last_clean":"2023-10-08T12:01:00.492140+0000","last_became_active":"2023-10-08T12:00:59.314578+0000","last_became_peered":"2023-10-08T12:00:59.314578+0000","last_unstale":"2023-10-08T12:01:00.492140+0000","last_undegraded":"2023-10-08T12:01:00.492140+0000","last_fullsized":"2023-10-08T12:01:00.492140+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:13:53.948012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"29'2","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.494205+0000","last_change":"2023-10-08T12:00:58.859441+0000","last_active":"2023-10-08T12:01:00.494205+0000","last_peered":"2023-10-08T12:01:00.494205+0000","last_clean":"2023-10-08T12:01:00.494205+0000","last_became_active":"2023-10-08T12:00:58.859066+0000","last_became_peered":"2023-10-08T12:00:58.859066+0000","last_unstale":"2023-10-08T12:01:00.494205+0000","last_undegraded":"2023-10-08T12:01:00.494205+0000","last_fullsized":"2023-10-08T12:01:00.494205+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_clean_scrub_stamp":"2023-10-08T12:00:57.809995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:58:18.679914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.492521+0000","last_change":"2023-10-08T12:00:59.332444+0000","last_active":"2023-10-08T12:01:00.492521+0000","last_peered":"2023-10-08T12:01:00.492521+0000","last_clean":"2023-10-08T12:01:00.492521+0000","last_became_active":"2023-10-08T12:00:59.331918+0000","last_became_peered":"2023-10-08T12:00:59.331918+0000","last_unstale":"2023-10-08T12:01:00.492521+0000","last_undegraded":"2023-10-08T12:01:00.492521+0000","last_fullsized":"2023-10-08T12:01:00.492521+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:36:38.358206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"29'1","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.277511+0000","last_change":"2023-10-08T12:00:58.866477+0000","last_active":"2023-10-08T12:01:00.277511+0000","last_peered":"2023-10-08T12:01:00.277511+0000","last_clean":"2023-10-08T12:01:00.277511+0000","last_became_active":"2023-10-08T12:00:58.865753+0000","last_became_peered":"2023-10-08T12:00:58.865753+0000","last_unstale":"2023-10-08T12:01:00.277511+0000","last_undegraded":"2023-10-08T12:01:00.277511+0000","last_fullsized":"2023-10-08T12:01:00.277511+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_clean_scrub_stamp":"2023-10-08T12:00:57.809995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:40:18.668295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.275389+0000","last_change":"2023-10-08T12:00:59.310457+0000","last_active":"2023-10-08T12:01:00.275389+0000","last_peered":"2023-10-08T12:01:00.275389+0000","last_clean":"2023-10-08T12:01:00.275389+0000","last_became_active":"2023-10-08T12:00:59.309665+0000","last_became_peered":"2023-10-08T12:00:59.309665+0000","last_unstale":"2023-10-08T12:01:00.275389+0000","last_undegraded":"2023-10-08T12:01:00.275389+0000","last_fullsized":"2023-10-08T12:01:00.275389+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:35:21.196573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"29'1","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.276765+0000","last_change":"2023-10-08T12:00:58.851368+0000","last_active":"2023-10-08T12:01:00.276765+0000","last_peered":"2023-10-08T12:01:00.276765+0000","last_clean":"2023-10-08T12:01:00.276765+0000","last_became_active":"2023-10-08T12:00:58.850873+0000","last_became_peered":"2023-10-08T12:00:58.850873+0000","last_unstale":"2023-10-08T12:01:00.276765+0000","last_undegraded":"2023-10-08T12:01:00.276765+0000","last_fullsized":"2023-10-08T12:01:00.276765+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_clean_scrub_stamp":"2023-10-08T12:00:57.809995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:32:29.620810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.275488+0000","last_change":"2023-10-08T12:00:59.304349+0000","last_active":"2023-10-08T12:01:00.275488+0000","last_peered":"2023-10-08T12:01:00.275488+0000","last_clean":"2023-10-08T12:01:00.275488+0000","last_became_active":"2023-10-08T12:00:59.303546+0000","last_became_peered":"2023-10-08T12:00:59.303546+0000","last_unstale":"2023-10-08T12:01:00.275488+0000","last_undegraded":"2023-10-08T12:01:00.275488+0000","last_fullsized":"2023-10-08T12:01:00.275488+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:04:21.118922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.490712+0000","last_change":"2023-10-08T12:00:58.850406+0000","last_active":"2023-10-08T12:01:00.490712+0000","last_peered":"2023-10-08T12:01:00.490712+0000","last_clean":"2023-10-08T12:01:00.490712+0000","last_became_active":"2023-10-08T12:00:58.850159+0000","last_became_peered":"2023-10-08T12:00:58.850159+0000","last_unstale":"2023-10-08T12:01:00.490712+0000","last_undegraded":"2023-10-08T12:01:00.490712+0000","last_fullsized":"2023-10-08T12:01:00.490712+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_clean_scrub_stamp":"2023-10-08T12:00:57.809995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:08:18.855031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.490415+0000","last_change":"2023-10-08T12:00:59.327869+0000","last_active":"2023-10-08T12:01:00.490415+0000","last_peered":"2023-10-08T12:01:00.490415+0000","last_clean":"2023-10-08T12:01:00.490415+0000","last_became_active":"2023-10-08T12:00:59.327342+0000","last_became_peered":"2023-10-08T12:00:59.327342+0000","last_unstale":"2023-10-08T12:01:00.490415+0000","last_undegraded":"2023-10-08T12:01:00.490415+0000","last_fullsized":"2023-10-08T12:01:00.490415+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:52:49.534592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.275468+0000","last_change":"2023-10-08T12:00:58.859085+0000","last_active":"2023-10-08T12:01:00.275468+0000","last_peered":"2023-10-08T12:01:00.275468+0000","last_clean":"2023-10-08T12:01:00.275468+0000","last_became_active":"2023-10-08T12:00:58.858393+0000","last_became_peered":"2023-10-08T12:00:58.858393+0000","last_unstale":"2023-10-08T12:01:00.275468+0000","last_undegraded":"2023-10-08T12:01:00.275468+0000","last_fullsized":"2023-10-08T12:01:00.275468+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_clean_scrub_stamp":"2023-10-08T12:00:57.809995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:25:57.129561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.277087+0000","last_change":"2023-10-08T12:00:59.310754+0000","last_active":"2023-10-08T12:01:00.277087+0000","last_peered":"2023-10-08T12:01:00.277087+0000","last_clean":"2023-10-08T12:01:00.277087+0000","last_became_active":"2023-10-08T12:00:59.309890+0000","last_became_peered":"2023-10-08T12:00:59.309890+0000","last_unstale":"2023-10-08T12:01:00.277087+0000","last_undegraded":"2023-10-08T12:01:00.277087+0000","last_fullsized":"2023-10-08T12:01:00.277087+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:50:14.850224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.491997+0000","last_change":"2023-10-08T12:00:58.869186+0000","last_active":"2023-10-08T12:01:00.491997+0000","last_peered":"2023-10-08T12:01:00.491997+0000","last_clean":"2023-10-08T12:01:00.491997+0000","last_became_active":"2023-10-08T12:00:58.868754+0000","last_became_peered":"2023-10-08T12:00:58.868754+0000","last_unstale":"2023-10-08T12:01:00.491997+0000","last_undegraded":"2023-10-08T12:01:00.491997+0000","last_fullsized":"2023-10-08T12:01:00.491997+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_clean_scrub_stamp":"2023-10-08T12:00:57.809995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:46:57.007132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.491896+0000","last_change":"2023-10-08T12:00:59.308760+0000","last_active":"2023-10-08T12:01:00.491896+0000","last_peered":"2023-10-08T12:01:00.491896+0000","last_clean":"2023-10-08T12:01:00.491896+0000","last_became_active":"2023-10-08T12:00:59.308272+0000","last_became_peered":"2023-10-08T12:00:59.308272+0000","last_unstale":"2023-10-08T12:01:00.491896+0000","last_undegraded":"2023-10-08T12:01:00.491896+0000","last_fullsized":"2023-10-08T12:01:00.491896+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:30:04.982386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.270891+0000","last_change":"2023-10-08T12:00:58.856075+0000","last_active":"2023-10-08T12:01:00.270891+0000","last_peered":"2023-10-08T12:01:00.270891+0000","last_clean":"2023-10-08T12:01:00.270891+0000","last_became_active":"2023-10-08T12:00:58.855636+0000","last_became_peered":"2023-10-08T12:00:58.855636+0000","last_unstale":"2023-10-08T12:01:00.270891+0000","last_undegraded":"2023-10-08T12:01:00.270891+0000","last_fullsized":"2023-10-08T12:01:00.270891+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_clean_scrub_stamp":"2023-10-08T12:00:57.809995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:17:05.541315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.490981+0000","last_change":"2023-10-08T12:00:59.304968+0000","last_active":"2023-10-08T12:01:00.490981+0000","last_peered":"2023-10-08T12:01:00.490981+0000","last_clean":"2023-10-08T12:01:00.490981+0000","last_became_active":"2023-10-08T12:00:59.304068+0000","last_became_peered":"2023-10-08T12:00:59.304068+0000","last_unstale":"2023-10-08T12:01:00.490981+0000","last_undegraded":"2023-10-08T12:01:00.490981+0000","last_fullsized":"2023-10-08T12:01:00.490981+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:36:38.358206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"29'3","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.276641+0000","last_change":"2023-10-08T12:00:58.858569+0000","last_active":"2023-10-08T12:01:00.276641+0000","last_peered":"2023-10-08T12:01:00.276641+0000","last_clean":"2023-10-08T12:01:00.276641+0000","last_became_active":"2023-10-08T12:00:58.857850+0000","last_became_peered":"2023-10-08T12:00:58.857850+0000","last_unstale":"2023-10-08T12:01:00.276641+0000","last_undegraded":"2023-10-08T12:01:00.276641+0000","last_fullsized":"2023-10-08T12:01:00.276641+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_clean_scrub_stamp":"2023-10-08T12:00:57.809995+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:08:18.855031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.276256+0000","last_change":"2023-10-08T12:00:59.299988+0000","last_active":"2023-10-08T12:01:00.276256+0000","last_peered":"2023-10-08T12:01:00.276256+0000","last_clean":"2023-10-08T12:01:00.276256+0000","last_became_active":"2023-10-08T12:00:59.299140+0000","last_became_peered":"2023-10-08T12:00:59.299140+0000","last_unstale":"2023-10-08T12:01:00.276256+0000","last_undegraded":"2023-10-08T12:01:00.276256+0000","last_fullsized":"2023-10-08T12:01:00.276256+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:13:53.948012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"29'6","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.492141+0000","last_change":"2023-10-08T12:00:58.860625+0000","last_active":"2023-10-08T12:01:00.492141+0000","last_peered":"2023-10-08T12:01:00.492141+0000","last_clean":"2023-10-08T12:01:00.492141+0000","last_became_active":"2023-10-08T12:00:58.859937+0000","last_became_peered":"2023-10-08T12:00:58.859937+0000","last_unstale":"2023-10-08T12:01:00.492141+0000","last_undegraded":"2023-10-08T12:01:00.492141+0000","last_fullsized":"2023-10-08T12:01:00.492141+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_clean_scrub_stamp":"2023-10-08T12:00:57.809995+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:48:10.684261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.490628+0000","last_change":"2023-10-08T12:00:59.293895+0000","last_active":"2023-10-08T12:01:00.490628+0000","last_peered":"2023-10-08T12:01:00.490628+0000","last_clean":"2023-10-08T12:01:00.490628+0000","last_became_active":"2023-10-08T12:00:59.293162+0000","last_became_peered":"2023-10-08T12:00:59.293162+0000","last_unstale":"2023-10-08T12:01:00.490628+0000","last_undegraded":"2023-10-08T12:01:00.490628+0000","last_fullsized":"2023-10-08T12:01:00.490628+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:04:55.650551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"29'2","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.277748+0000","last_change":"2023-10-08T12:00:58.867959+0000","last_active":"2023-10-08T12:01:00.277748+0000","last_peered":"2023-10-08T12:01:00.277748+0000","last_clean":"2023-10-08T12:01:00.277748+0000","last_became_active":"2023-10-08T12:00:58.867301+0000","last_became_peered":"2023-10-08T12:00:58.867301+0000","last_unstale":"2023-10-08T12:01:00.277748+0000","last_undegraded":"2023-10-08T12:01:00.277748+0000","last_fullsized":"2023-10-08T12:01:00.277748+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_clean_scrub_stamp":"2023-10-08T12:00:57.809995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:23:37.337703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.491643+0000","last_change":"2023-10-08T12:00:59.310574+0000","last_active":"2023-10-08T12:01:00.491643+0000","last_peered":"2023-10-08T12:01:00.491643+0000","last_clean":"2023-10-08T12:01:00.491643+0000","last_became_active":"2023-10-08T12:00:59.309886+0000","last_became_peered":"2023-10-08T12:00:59.309886+0000","last_unstale":"2023-10-08T12:01:00.491643+0000","last_undegraded":"2023-10-08T12:01:00.491643+0000","last_fullsized":"2023-10-08T12:01:00.491643+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:07:29.225043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.490711+0000","last_change":"2023-10-08T12:00:58.869411+0000","last_active":"2023-10-08T12:01:00.490711+0000","last_peered":"2023-10-08T12:01:00.490711+0000","last_clean":"2023-10-08T12:01:00.490711+0000","last_became_active":"2023-10-08T12:00:58.868968+0000","last_became_peered":"2023-10-08T12:00:58.868968+0000","last_unstale":"2023-10-08T12:01:00.490711+0000","last_undegraded":"2023-10-08T12:01:00.490711+0000","last_fullsized":"2023-10-08T12:01:00.490711+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_clean_scrub_stamp":"2023-10-08T12:00:57.809995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:10:57.985113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.492089+0000","last_change":"2023-10-08T12:00:59.332429+0000","last_active":"2023-10-08T12:01:00.492089+0000","last_peered":"2023-10-08T12:01:00.492089+0000","last_clean":"2023-10-08T12:01:00.492089+0000","last_became_active":"2023-10-08T12:00:59.331849+0000","last_became_peered":"2023-10-08T12:00:59.331849+0000","last_unstale":"2023-10-08T12:01:00.492089+0000","last_undegraded":"2023-10-08T12:01:00.492089+0000","last_fullsized":"2023-10-08T12:01:00.492089+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:38:47.575293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.490798+0000","last_change":"2023-10-08T12:00:58.868991+0000","last_active":"2023-10-08T12:01:00.490798+0000","last_peered":"2023-10-08T12:01:00.490798+0000","last_clean":"2023-10-08T12:01:00.490798+0000","last_became_active":"2023-10-08T12:00:58.868656+0000","last_became_peered":"2023-10-08T12:00:58.868656+0000","last_unstale":"2023-10-08T12:01:00.490798+0000","last_undegraded":"2023-10-08T12:01:00.490798+0000","last_fullsized":"2023-10-08T12:01:00.490798+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_clean_scrub_stamp":"2023-10-08T12:00:57.809995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:04:54.639632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.488487+0000","last_change":"2023-10-08T12:00:59.316238+0000","last_active":"2023-10-08T12:01:00.488487+0000","last_peered":"2023-10-08T12:01:00.488487+0000","last_clean":"2023-10-08T12:01:00.488487+0000","last_became_active":"2023-10-08T12:00:59.315298+0000","last_became_peered":"2023-10-08T12:00:59.315298+0000","last_unstale":"2023-10-08T12:01:00.488487+0000","last_undegraded":"2023-10-08T12:01:00.488487+0000","last_fullsized":"2023-10-08T12:01:00.488487+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:10:15.110189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"29'8","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.490574+0000","last_change":"2023-10-08T12:00:58.854023+0000","last_active":"2023-10-08T12:01:00.490574+0000","last_peered":"2023-10-08T12:01:00.490574+0000","last_clean":"2023-10-08T12:01:00.490574+0000","last_became_active":"2023-10-08T12:00:58.853735+0000","last_became_peered":"2023-10-08T12:00:58.853735+0000","last_unstale":"2023-10-08T12:01:00.490574+0000","last_undegraded":"2023-10-08T12:01:00.490574+0000","last_fullsized":"2023-10-08T12:01:00.490574+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_clean_scrub_stamp":"2023-10-08T12:00:57.809995+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:59:20.160682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.277903+0000","last_change":"2023-10-08T12:00:59.316720+0000","last_active":"2023-10-08T12:01:00.277903+0000","last_peered":"2023-10-08T12:01:00.277903+0000","last_clean":"2023-10-08T12:01:00.277903+0000","last_became_active":"2023-10-08T12:00:59.315903+0000","last_became_peered":"2023-10-08T12:00:59.315903+0000","last_unstale":"2023-10-08T12:01:00.277903+0000","last_undegraded":"2023-10-08T12:01:00.277903+0000","last_fullsized":"2023-10-08T12:01:00.277903+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:08:19.865951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"29'1","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.492866+0000","last_change":"2023-10-08T12:00:58.865780+0000","last_active":"2023-10-08T12:01:00.492866+0000","last_peered":"2023-10-08T12:01:00.492866+0000","last_clean":"2023-10-08T12:01:00.492866+0000","last_became_active":"2023-10-08T12:00:58.865392+0000","last_became_peered":"2023-10-08T12:00:58.865392+0000","last_unstale":"2023-10-08T12:01:00.492866+0000","last_undegraded":"2023-10-08T12:01:00.492866+0000","last_fullsized":"2023-10-08T12:01:00.492866+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_clean_scrub_stamp":"2023-10-08T12:00:57.809995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:39:48.332296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.276530+0000","last_change":"2023-10-08T12:00:59.306902+0000","last_active":"2023-10-08T12:01:00.276530+0000","last_peered":"2023-10-08T12:01:00.276530+0000","last_clean":"2023-10-08T12:01:00.276530+0000","last_became_active":"2023-10-08T12:00:59.302406+0000","last_became_peered":"2023-10-08T12:00:59.302406+0000","last_unstale":"2023-10-08T12:01:00.276530+0000","last_undegraded":"2023-10-08T12:01:00.276530+0000","last_fullsized":"2023-10-08T12:01:00.276530+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:10:26.342879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"29'2","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.278128+0000","last_change":"2023-10-08T12:00:58.862915+0000","last_active":"2023-10-08T12:01:00.278128+0000","last_peered":"2023-10-08T12:01:00.278128+0000","last_clean":"2023-10-08T12:01:00.278128+0000","last_became_active":"2023-10-08T12:00:58.862232+0000","last_became_peered":"2023-10-08T12:00:58.862232+0000","last_unstale":"2023-10-08T12:01:00.278128+0000","last_undegraded":"2023-10-08T12:01:00.278128+0000","last_fullsized":"2023-10-08T12:01:00.278128+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_clean_scrub_stamp":"2023-10-08T12:00:57.809995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:10:14.099270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.491246+0000","last_change":"2023-10-08T12:00:59.302251+0000","last_active":"2023-10-08T12:01:00.491246+0000","last_peered":"2023-10-08T12:01:00.491246+0000","last_clean":"2023-10-08T12:01:00.491246+0000","last_became_active":"2023-10-08T12:00:59.301509+0000","last_became_peered":"2023-10-08T12:00:59.301509+0000","last_unstale":"2023-10-08T12:01:00.491246+0000","last_undegraded":"2023-10-08T12:01:00.491246+0000","last_fullsized":"2023-10-08T12:01:00.491246+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:35:21.196573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"29'1","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.277996+0000","last_change":"2023-10-08T12:00:58.859089+0000","last_active":"2023-10-08T12:01:00.277996+0000","last_peered":"2023-10-08T12:01:00.277996+0000","last_clean":"2023-10-08T12:01:00.277996+0000","last_became_active":"2023-10-08T12:00:58.858306+0000","last_became_peered":"2023-10-08T12:00:58.858306+0000","last_unstale":"2023-10-08T12:01:00.277996+0000","last_undegraded":"2023-10-08T12:01:00.277996+0000","last_fullsized":"2023-10-08T12:01:00.277996+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_clean_scrub_stamp":"2023-10-08T12:00:57.809995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:46:00.374725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.493901+0000","last_change":"2023-10-08T12:00:59.320653+0000","last_active":"2023-10-08T12:01:00.493901+0000","last_peered":"2023-10-08T12:01:00.493901+0000","last_clean":"2023-10-08T12:01:00.493901+0000","last_became_active":"2023-10-08T12:00:59.319939+0000","last_became_peered":"2023-10-08T12:00:59.319939+0000","last_unstale":"2023-10-08T12:01:00.493901+0000","last_undegraded":"2023-10-08T12:01:00.493901+0000","last_fullsized":"2023-10-08T12:01:00.493901+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:59:13.091504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.277983+0000","last_change":"2023-10-08T12:00:58.867143+0000","last_active":"2023-10-08T12:01:00.277983+0000","last_peered":"2023-10-08T12:01:00.277983+0000","last_clean":"2023-10-08T12:01:00.277983+0000","last_became_active":"2023-10-08T12:00:58.866464+0000","last_became_peered":"2023-10-08T12:00:58.866464+0000","last_unstale":"2023-10-08T12:01:00.277983+0000","last_undegraded":"2023-10-08T12:01:00.277983+0000","last_fullsized":"2023-10-08T12:01:00.277983+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_clean_scrub_stamp":"2023-10-08T12:00:57.809995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:42:19.640511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.493857+0000","last_change":"2023-10-08T12:00:59.288096+0000","last_active":"2023-10-08T12:01:00.493857+0000","last_peered":"2023-10-08T12:01:00.493857+0000","last_clean":"2023-10-08T12:01:00.493857+0000","last_became_active":"2023-10-08T12:00:59.287318+0000","last_became_peered":"2023-10-08T12:00:59.287318+0000","last_unstale":"2023-10-08T12:01:00.493857+0000","last_undegraded":"2023-10-08T12:01:00.493857+0000","last_fullsized":"2023-10-08T12:01:00.493857+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:40:47.328240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"29'2","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.270549+0000","last_change":"2023-10-08T12:00:58.858613+0000","last_active":"2023-10-08T12:01:00.270549+0000","last_peered":"2023-10-08T12:01:00.270549+0000","last_clean":"2023-10-08T12:01:00.270549+0000","last_became_active":"2023-10-08T12:00:58.857937+0000","last_became_peered":"2023-10-08T12:00:58.857937+0000","last_unstale":"2023-10-08T12:01:00.270549+0000","last_undegraded":"2023-10-08T12:01:00.270549+0000","last_fullsized":"2023-10-08T12:01:00.270549+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_clean_scrub_stamp":"2023-10-08T12:00:57.809995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:42:19.640511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.493816+0000","last_change":"2023-10-08T12:00:59.319507+0000","last_active":"2023-10-08T12:01:00.493816+0000","last_peered":"2023-10-08T12:01:00.493816+0000","last_clean":"2023-10-08T12:01:00.493816+0000","last_became_active":"2023-10-08T12:00:59.305712+0000","last_became_peered":"2023-10-08T12:00:59.305712+0000","last_unstale":"2023-10-08T12:01:00.493816+0000","last_undegraded":"2023-10-08T12:01:00.493816+0000","last_fullsized":"2023-10-08T12:01:00.493816+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:40:47.392326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.488721+0000","last_change":"2023-10-08T12:00:58.868295+0000","last_active":"2023-10-08T12:01:00.488721+0000","last_peered":"2023-10-08T12:01:00.488721+0000","last_clean":"2023-10-08T12:01:00.488721+0000","last_became_active":"2023-10-08T12:00:58.867603+0000","last_became_peered":"2023-10-08T12:00:58.867603+0000","last_unstale":"2023-10-08T12:01:00.488721+0000","last_undegraded":"2023-10-08T12:01:00.488721+0000","last_fullsized":"2023-10-08T12:01:00.488721+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_clean_scrub_stamp":"2023-10-08T12:00:57.809995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:34:11.481822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.494056+0000","last_change":"2023-10-08T12:00:59.304747+0000","last_active":"2023-10-08T12:01:00.494056+0000","last_peered":"2023-10-08T12:01:00.494056+0000","last_clean":"2023-10-08T12:01:00.494056+0000","last_became_active":"2023-10-08T12:00:59.304044+0000","last_became_peered":"2023-10-08T12:00:59.304044+0000","last_unstale":"2023-10-08T12:01:00.494056+0000","last_undegraded":"2023-10-08T12:01:00.494056+0000","last_fullsized":"2023-10-08T12:01:00.494056+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:31:03.542031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.275634+0000","last_change":"2023-10-08T12:00:58.860444+0000","last_active":"2023-10-08T12:01:00.275634+0000","last_peered":"2023-10-08T12:01:00.275634+0000","last_clean":"2023-10-08T12:01:00.275634+0000","last_became_active":"2023-10-08T12:00:58.859788+0000","last_became_peered":"2023-10-08T12:00:58.859788+0000","last_unstale":"2023-10-08T12:01:00.275634+0000","last_undegraded":"2023-10-08T12:01:00.275634+0000","last_fullsized":"2023-10-08T12:01:00.275634+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_clean_scrub_stamp":"2023-10-08T12:00:57.809995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:18:12.184835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.492121+0000","last_change":"2023-10-08T12:00:59.320569+0000","last_active":"2023-10-08T12:01:00.492121+0000","last_peered":"2023-10-08T12:01:00.492121+0000","last_clean":"2023-10-08T12:01:00.492121+0000","last_became_active":"2023-10-08T12:00:59.319788+0000","last_became_peered":"2023-10-08T12:00:59.319788+0000","last_unstale":"2023-10-08T12:01:00.492121+0000","last_undegraded":"2023-10-08T12:01:00.492121+0000","last_fullsized":"2023-10-08T12:01:00.492121+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:48:11.695180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.275162+0000","last_change":"2023-10-08T12:00:58.869489+0000","last_active":"2023-10-08T12:01:00.275162+0000","last_peered":"2023-10-08T12:01:00.275162+0000","last_clean":"2023-10-08T12:01:00.275162+0000","last_became_active":"2023-10-08T12:00:58.868829+0000","last_became_peered":"2023-10-08T12:00:58.868829+0000","last_unstale":"2023-10-08T12:01:00.275162+0000","last_undegraded":"2023-10-08T12:01:00.275162+0000","last_fullsized":"2023-10-08T12:01:00.275162+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_clean_scrub_stamp":"2023-10-08T12:00:57.809995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:39:48.332296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.494413+0000","last_change":"2023-10-08T12:00:59.291154+0000","last_active":"2023-10-08T12:01:00.494413+0000","last_peered":"2023-10-08T12:01:00.494413+0000","last_clean":"2023-10-08T12:01:00.494413+0000","last_became_active":"2023-10-08T12:00:59.290492+0000","last_became_peered":"2023-10-08T12:00:59.290492+0000","last_unstale":"2023-10-08T12:01:00.494413+0000","last_undegraded":"2023-10-08T12:01:00.494413+0000","last_fullsized":"2023-10-08T12:01:00.494413+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:25:58.140480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"29'2","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.492909+0000","last_change":"2023-10-08T12:00:58.870515+0000","last_active":"2023-10-08T12:01:00.492909+0000","last_peered":"2023-10-08T12:01:00.492909+0000","last_clean":"2023-10-08T12:01:00.492909+0000","last_became_active":"2023-10-08T12:00:58.869913+0000","last_became_peered":"2023-10-08T12:00:58.869913+0000","last_unstale":"2023-10-08T12:01:00.492909+0000","last_undegraded":"2023-10-08T12:01:00.492909+0000","last_fullsized":"2023-10-08T12:01:00.492909+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_clean_scrub_stamp":"2023-10-08T12:00:57.809995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:59:20.160682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.276875+0000","last_change":"2023-10-08T12:00:59.299051+0000","last_active":"2023-10-08T12:01:00.276875+0000","last_peered":"2023-10-08T12:01:00.276875+0000","last_clean":"2023-10-08T12:01:00.276875+0000","last_became_active":"2023-10-08T12:00:59.298347+0000","last_became_peered":"2023-10-08T12:00:59.298347+0000","last_unstale":"2023-10-08T12:01:00.276875+0000","last_undegraded":"2023-10-08T12:01:00.276875+0000","last_fullsized":"2023-10-08T12:01:00.276875+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:26:46.589443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.270930+0000","last_change":"2023-10-08T12:00:58.857680+0000","last_active":"2023-10-08T12:01:00.270930+0000","last_peered":"2023-10-08T12:01:00.270930+0000","last_clean":"2023-10-08T12:01:00.270930+0000","last_became_active":"2023-10-08T12:00:58.856452+0000","last_became_peered":"2023-10-08T12:00:58.856452+0000","last_unstale":"2023-10-08T12:01:00.270930+0000","last_undegraded":"2023-10-08T12:01:00.270930+0000","last_fullsized":"2023-10-08T12:01:00.270930+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_clean_scrub_stamp":"2023-10-08T12:00:57.809995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:40:18.668295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.270477+0000","last_change":"2023-10-08T12:00:59.312557+0000","last_active":"2023-10-08T12:01:00.270477+0000","last_peered":"2023-10-08T12:01:00.270477+0000","last_clean":"2023-10-08T12:01:00.270477+0000","last_became_active":"2023-10-08T12:00:59.309536+0000","last_became_peered":"2023-10-08T12:00:59.309536+0000","last_unstale":"2023-10-08T12:01:00.270477+0000","last_undegraded":"2023-10-08T12:01:00.270477+0000","last_fullsized":"2023-10-08T12:01:00.270477+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:24:55.963122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.491446+0000","last_change":"2023-10-08T12:00:58.861080+0000","last_active":"2023-10-08T12:01:00.491446+0000","last_peered":"2023-10-08T12:01:00.491446+0000","last_clean":"2023-10-08T12:01:00.491446+0000","last_became_active":"2023-10-08T12:00:58.860751+0000","last_became_peered":"2023-10-08T12:00:58.860751+0000","last_unstale":"2023-10-08T12:01:00.491446+0000","last_undegraded":"2023-10-08T12:01:00.491446+0000","last_fullsized":"2023-10-08T12:01:00.491446+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_clean_scrub_stamp":"2023-10-08T12:00:57.809995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:08:18.855031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.488702+0000","last_change":"2023-10-08T12:00:59.309067+0000","last_active":"2023-10-08T12:01:00.488702+0000","last_peered":"2023-10-08T12:01:00.488702+0000","last_clean":"2023-10-08T12:01:00.488702+0000","last_became_active":"2023-10-08T12:00:59.308183+0000","last_became_peered":"2023-10-08T12:00:59.308183+0000","last_unstale":"2023-10-08T12:01:00.488702+0000","last_undegraded":"2023-10-08T12:01:00.488702+0000","last_fullsized":"2023-10-08T12:01:00.488702+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:42:20.651431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.270629+0000","last_change":"2023-10-08T12:00:58.853253+0000","last_active":"2023-10-08T12:01:00.270629+0000","last_peered":"2023-10-08T12:01:00.270629+0000","last_clean":"2023-10-08T12:01:00.270629+0000","last_became_active":"2023-10-08T12:00:58.852882+0000","last_became_peered":"2023-10-08T12:00:58.852882+0000","last_unstale":"2023-10-08T12:01:00.270629+0000","last_undegraded":"2023-10-08T12:01:00.270629+0000","last_fullsized":"2023-10-08T12:01:00.270629+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_clean_scrub_stamp":"2023-10-08T12:00:57.809995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:10:14.099270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.270500+0000","last_change":"2023-10-08T12:00:59.314273+0000","last_active":"2023-10-08T12:01:00.270500+0000","last_peered":"2023-10-08T12:01:00.270500+0000","last_clean":"2023-10-08T12:01:00.270500+0000","last_became_active":"2023-10-08T12:00:59.313478+0000","last_became_peered":"2023-10-08T12:00:59.313478+0000","last_unstale":"2023-10-08T12:01:00.270500+0000","last_undegraded":"2023-10-08T12:01:00.270500+0000","last_fullsized":"2023-10-08T12:01:00.270500+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:04:21.118922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.490793+0000","last_change":"2023-10-08T12:00:58.871202+0000","last_active":"2023-10-08T12:01:00.490793+0000","last_peered":"2023-10-08T12:01:00.490793+0000","last_clean":"2023-10-08T12:01:00.490793+0000","last_became_active":"2023-10-08T12:00:58.870868+0000","last_became_peered":"2023-10-08T12:00:58.870868+0000","last_unstale":"2023-10-08T12:01:00.490793+0000","last_undegraded":"2023-10-08T12:01:00.490793+0000","last_fullsized":"2023-10-08T12:01:00.490793+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_clean_scrub_stamp":"2023-10-08T12:00:57.809995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:57:11.132667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.490416+0000","last_change":"2023-10-08T12:00:59.307386+0000","last_active":"2023-10-08T12:01:00.490416+0000","last_peered":"2023-10-08T12:01:00.490416+0000","last_clean":"2023-10-08T12:01:00.490416+0000","last_became_active":"2023-10-08T12:00:59.306883+0000","last_became_peered":"2023-10-08T12:00:59.306883+0000","last_unstale":"2023-10-08T12:01:00.490416+0000","last_undegraded":"2023-10-08T12:01:00.490416+0000","last_fullsized":"2023-10-08T12:01:00.490416+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:10:26.342879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.275751+0000","last_change":"2023-10-08T12:00:58.857194+0000","last_active":"2023-10-08T12:01:00.275751+0000","last_peered":"2023-10-08T12:01:00.275751+0000","last_clean":"2023-10-08T12:01:00.275751+0000","last_became_active":"2023-10-08T12:00:58.856516+0000","last_became_peered":"2023-10-08T12:00:58.856516+0000","last_unstale":"2023-10-08T12:01:00.275751+0000","last_undegraded":"2023-10-08T12:01:00.275751+0000","last_fullsized":"2023-10-08T12:01:00.275751+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_clean_scrub_stamp":"2023-10-08T12:00:57.809995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:17:05.541315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.275417+0000","last_change":"2023-10-08T12:00:59.307046+0000","last_active":"2023-10-08T12:01:00.275417+0000","last_peered":"2023-10-08T12:01:00.275417+0000","last_clean":"2023-10-08T12:01:00.275417+0000","last_became_active":"2023-10-08T12:00:59.306355+0000","last_became_peered":"2023-10-08T12:00:59.306355+0000","last_unstale":"2023-10-08T12:01:00.275417+0000","last_undegraded":"2023-10-08T12:01:00.275417+0000","last_fullsized":"2023-10-08T12:01:00.275417+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:24:55.963122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.490518+0000","last_change":"2023-10-08T12:00:58.869188+0000","last_active":"2023-10-08T12:01:00.490518+0000","last_peered":"2023-10-08T12:01:00.490518+0000","last_clean":"2023-10-08T12:01:00.490518+0000","last_became_active":"2023-10-08T12:00:58.868786+0000","last_became_peered":"2023-10-08T12:00:58.868786+0000","last_unstale":"2023-10-08T12:01:00.490518+0000","last_undegraded":"2023-10-08T12:01:00.490518+0000","last_fullsized":"2023-10-08T12:01:00.490518+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_clean_scrub_stamp":"2023-10-08T12:00:57.809995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:57:11.132667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.492438+0000","last_change":"2023-10-08T12:00:59.313441+0000","last_active":"2023-10-08T12:01:00.492438+0000","last_peered":"2023-10-08T12:01:00.492438+0000","last_clean":"2023-10-08T12:01:00.492438+0000","last_became_active":"2023-10-08T12:00:59.312551+0000","last_became_peered":"2023-10-08T12:00:59.312551+0000","last_unstale":"2023-10-08T12:01:00.492438+0000","last_undegraded":"2023-10-08T12:01:00.492438+0000","last_fullsized":"2023-10-08T12:01:00.492438+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:58.820915+0000","last_clean_scrub_stamp":"2023-10-08T12:00:58.820915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:46:58.018052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T12:01:00.488179+0000","last_change":"2023-10-08T12:00:58.859077+0000","last_active":"2023-10-08T12:01:00.488179+0000","last_peered":"2023-10-08T12:01:00.488179+0000","last_clean":"2023-10-08T12:01:00.488179+0000","last_became_active":"2023-10-08T12:00:58.858432+0000","last_became_peered":"2023-10-08T12:00:58.858432+0000","last_unstale":"2023-10-08T12:01:00.488179+0000","last_undegraded":"2023-10-08T12:01:00.488179+0000","last_fullsized":"2023-10-08T12:01:00.488179+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:57.809995+0000","last_clean_scrub_stamp":"2023-10-08T12:00:57.809995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:55:21.623674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":173,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-08T12:00:59.299547+0000","last_change":"2023-10-08T12:00:08.887559+0000","last_active":"2023-10-08T12:00:59.299547+0000","last_peered":"2023-10-08T12:00:59.299547+0000","last_clean":"2023-10-08T12:00:59.299547+0000","last_became_active":"2023-10-08T12:00:08.884794+0000","last_became_peered":"2023-10-08T12:00:08.884794+0000","last_unstale":"2023-10-08T12:00:59.299547+0000","last_undegraded":"2023-10-08T12:00:59.299547+0000","last_fullsized":"2023-10-08T12:00:59.299547+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:00:07.812869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:00:07.812869+0000","last_clean_scrub_stamp":"2023-10-08T12:00:07.812869+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:58:36.123159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":933888,"data_stored":719491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0229999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.163}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0509999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94599999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":344064,"data_stored":129649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.256}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93799999999999994}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.363}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2230000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3400000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":344064,"data_stored":129705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.105}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94199999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":344064,"data_stored":129137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0189999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.274}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1020000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1990000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":352256,"data_stored":130667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0429999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.091}]}]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":339968,"data_stored":129103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2230000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1850000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.274}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":352256,"data_stored":130667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.8600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.4860000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.0910000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":10.920999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574861,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":929792,"data_stored":719401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.044}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.391}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.351}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T12:01:04.260 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-08T12:01:04.261 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-08T12:01:04.436 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.434+0000 7f5c4f729640 1 -- 172.21.15.62:0/1962331313 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c340047d0 msgr2=0x7f5c34004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:01:04.437 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.434+0000 7f5c4f729640 1 --2- 172.21.15.62:0/1962331313 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c340047d0 0x7f5c34004c50 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f5c44009b90 tx=0x7f5c4401d290 comp rx=0 tx=0).stop 2023-10-08T12:01:04.437 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.434+0000 7f5c4dcc6640 1 -- 172.21.15.62:0/1962331313 reap_dead start 2023-10-08T12:01:04.437 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.434+0000 7f5c4f729640 1 -- 172.21.15.62:0/1962331313 shutdown_connections 2023-10-08T12:01:04.437 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.434+0000 7f5c4f729640 1 -- 172.21.15.62:0/1962331313 >> 172.21.15.62:0/1962331313 conn(0x7f5c480b82f0 msgr2=0x7f5c480b8700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:01:04.437 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.434+0000 7f5c4f729640 1 -- 172.21.15.62:0/1962331313 shutdown_connections 2023-10-08T12:01:04.437 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.434+0000 7f5c4f729640 1 -- 172.21.15.62:0/1962331313 wait complete. 2023-10-08T12:01:04.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.434+0000 7f5c4f729640 1 Processor -- start 2023-10-08T12:01:04.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.434+0000 7f5c4f729640 1 -- start start 2023-10-08T12:01:04.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.438+0000 7f5c4f729640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5c340047d0 0x7f5c480b5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:01:04.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.438+0000 7f5c4f729640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c480a13b0 0x7f5c4809ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:01:04.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.438+0000 7f5c4f729640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5c4809f230 0x7f5c481e3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:01:04.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.438+0000 7f5c4f729640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c480b4df0 con 0x7f5c480a13b0 2023-10-08T12:01:04.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.438+0000 7f5c4f729640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c480b3210 con 0x7f5c4809f230 2023-10-08T12:01:04.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.438+0000 7f5c4f729640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4809f6b0 con 0x7f5c340047d0 2023-10-08T12:01:04.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.438+0000 7f5c4ccc4640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c480a13b0 0x7f5c4809ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:01:04.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.438+0000 7f5c4ccc4640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c480a13b0 0x7f5c4809ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46472/0 (socket says 172.21.15.62:46472) 2023-10-08T12:01:04.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.438+0000 7f5c4ccc4640 1 -- 172.21.15.62:0/932637309 learned_addr learned my addr 172.21.15.62:0/932637309 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:01:04.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.438+0000 7f5c4d4c5640 1 --2- 172.21.15.62:0/932637309 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5c340047d0 0x7f5c480b5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:01:04.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.438+0000 7f5c4ccc4640 1 -- 172.21.15.62:0/932637309 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5c340047d0 msgr2=0x7f5c480b5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:01:04.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.438+0000 7f5c4dcc6640 1 --2- 172.21.15.62:0/932637309 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5c4809f230 0x7f5c481e3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:01:04.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.438+0000 7f5c4ccc4640 1 --2- 172.21.15.62:0/932637309 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5c340047d0 0x7f5c480b5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:04.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.438+0000 7f5c4ccc4640 1 -- 172.21.15.62:0/932637309 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5c4809f230 msgr2=0x7f5c481e3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:01:04.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.438+0000 7f5c4ccc4640 1 --2- 172.21.15.62:0/932637309 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5c4809f230 0x7f5c481e3ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:04.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.438+0000 7f5c4ccc4640 1 -- 172.21.15.62:0/932637309 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c480a1830 con 0x7f5c480a13b0 2023-10-08T12:01:04.442 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.438+0000 7f5c4ccc4640 1 --2- 172.21.15.62:0/932637309 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c480a13b0 0x7f5c4809ecf0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f5c44009b90 tx=0x7f5c440055d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:01:04.442 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.438+0000 7f5c3dffb640 1 -- 172.21.15.62:0/932637309 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c440042f0 con 0x7f5c480a13b0 2023-10-08T12:01:04.442 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.438+0000 7f5c3dffb640 1 -- 172.21.15.62:0/932637309 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5c440046d0 con 0x7f5c480a13b0 2023-10-08T12:01:04.442 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.438+0000 7f5c4f729640 1 -- 172.21.15.62:0/932637309 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c480b44c0 con 0x7f5c480a13b0 2023-10-08T12:01:04.442 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.438+0000 7f5c3dffb640 1 -- 172.21.15.62:0/932637309 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c44004ac0 con 0x7f5c480a13b0 2023-10-08T12:01:04.442 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.438+0000 7f5c4f729640 1 -- 172.21.15.62:0/932637309 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c480b4a80 con 0x7f5c480a13b0 2023-10-08T12:01:04.443 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.438+0000 7f5c4f729640 1 -- 172.21.15.62:0/932637309 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c4809e9f0 con 0x7f5c480a13b0 2023-10-08T12:01:04.443 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.438+0000 7f5c3dffb640 1 -- 172.21.15.62:0/932637309 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f5c440b3070 con 0x7f5c480a13b0 2023-10-08T12:01:04.443 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.438+0000 7f5c3dffb640 1 --2- 172.21.15.62:0/932637309 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f5c2c066470 0x7f5c2c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:01:04.443 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.438+0000 7f5c3dffb640 1 -- 172.21.15.62:0/932637309 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5c4411eea0 con 0x7f5c480a13b0 2023-10-08T12:01:04.443 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.438+0000 7f5c4d4c5640 1 --2- 172.21.15.62:0/932637309 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f5c2c066470 0x7f5c2c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:01:04.443 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.442+0000 7f5c4d4c5640 1 --2- 172.21.15.62:0/932637309 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f5c2c066470 0x7f5c2c068930 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5c38009a60 tx=0x7f5c380091e0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:01:04.445 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.442+0000 7f5c3dffb640 1 -- 172.21.15.62:0/932637309 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5c440ec3b0 con 0x7f5c480a13b0 2023-10-08T12:01:04.649 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.646+0000 7f5c4f729640 1 -- 172.21.15.62:0/932637309 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f5c4804da80 con 0x7f5c480a13b0 2023-10-08T12:01:04.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.650+0000 7f5c3dffb640 1 -- 172.21.15.62:0/932637309 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+147 (secure 0 0 0) 0x7f5c440ba0e0 con 0x7f5c480a13b0 2023-10-08T12:01:04.653 INFO:teuthology.orchestra.run.smithi062.stdout:[client.0] 2023-10-08T12:01:04.654 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCYmSJlBqVKNRAAty1+t99MyOB+ME+wqN8uCA== 2023-10-08T12:01:04.654 INFO:teuthology.orchestra.run.smithi062.stdout: caps mds = "allow" 2023-10-08T12:01:04.654 INFO:teuthology.orchestra.run.smithi062.stdout: caps mon = "allow r" 2023-10-08T12:01:04.654 INFO:teuthology.orchestra.run.smithi062.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-10-08T12:01:04.654 INFO:teuthology.orchestra.run.smithi062.stderr:updated caps for client.0 2023-10-08T12:01:04.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.654+0000 7f5c4f729640 1 -- 172.21.15.62:0/932637309 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f5c2c066470 msgr2=0x7f5c2c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:01:04.656 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.654+0000 7f5c4f729640 1 --2- 172.21.15.62:0/932637309 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f5c2c066470 0x7f5c2c068930 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5c38009a60 tx=0x7f5c380091e0 comp rx=0 tx=0).stop 2023-10-08T12:01:04.656 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.654+0000 7f5c4f729640 1 -- 172.21.15.62:0/932637309 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c480a13b0 msgr2=0x7f5c4809ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:01:04.656 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.654+0000 7f5c4f729640 1 --2- 172.21.15.62:0/932637309 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c480a13b0 0x7f5c4809ecf0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f5c44009b90 tx=0x7f5c440055d0 comp rx=0 tx=0).stop 2023-10-08T12:01:04.656 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.654+0000 7f5c4f729640 1 -- 172.21.15.62:0/932637309 shutdown_connections 2023-10-08T12:01:04.656 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.654+0000 7f5c4f729640 1 --2- 172.21.15.62:0/932637309 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f5c2c066470 0x7f5c2c068930 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:04.656 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.654+0000 7f5c4f729640 1 --2- 172.21.15.62:0/932637309 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5c4809f230 0x7f5c481e3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:04.657 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.654+0000 7f5c4f729640 1 --2- 172.21.15.62:0/932637309 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c480a13b0 0x7f5c4809ecf0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:04.657 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.654+0000 7f5c4f729640 1 --2- 172.21.15.62:0/932637309 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5c340047d0 0x7f5c480b5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:04.657 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.654+0000 7f5c4f729640 1 -- 172.21.15.62:0/932637309 >> 172.21.15.62:0/932637309 conn(0x7f5c480b82f0 msgr2=0x7f5c4809b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:01:04.657 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.654+0000 7f5c4f729640 1 -- 172.21.15.62:0/932637309 shutdown_connections 2023-10-08T12:01:04.657 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.654+0000 7f5c4f729640 1 -- 172.21.15.62:0/932637309 wait complete. 2023-10-08T12:01:04.672 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:01:04.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.786+0000 7f8773b0a640 1 -- 172.21.15.62:0/2656720201 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8758005190 msgr2=0x7f875800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:01:04.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.786+0000 7f8773b0a640 1 --2- 172.21.15.62:0/2656720201 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8758005190 0x7f875800b990 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f876400c5c0 tx=0x7f876401d340 comp rx=0 tx=0).stop 2023-10-08T12:01:04.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.786+0000 7f8773b0a640 1 -- 172.21.15.62:0/2656720201 shutdown_connections 2023-10-08T12:01:04.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.786+0000 7f8773b0a640 1 --2- 172.21.15.62:0/2656720201 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8758005190 0x7f875800b990 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:04.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.786+0000 7f8773b0a640 1 -- 172.21.15.62:0/2656720201 >> 172.21.15.62:0/2656720201 conn(0x7f876c09e540 msgr2=0x7f876c09e950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:01:04.788 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.786+0000 7f8773b0a640 1 -- 172.21.15.62:0/2656720201 shutdown_connections 2023-10-08T12:01:04.788 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.786+0000 7f8773b0a640 1 -- 172.21.15.62:0/2656720201 wait complete. 2023-10-08T12:01:04.790 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.786+0000 7f8773b0a640 1 Processor -- start 2023-10-08T12:01:04.790 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.786+0000 7f8773b0a640 1 -- start start 2023-10-08T12:01:04.790 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.786+0000 7f8773b0a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8758005190 0x7f876c09ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:01:04.790 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.786+0000 7f8773b0a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f876c09b090 0x7f876c0983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:01:04.790 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.786+0000 7f8773b0a640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f876c098930 0x7f876c1e02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:01:04.790 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.786+0000 7f8773b0a640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f876c09a670 con 0x7f8758005190 2023-10-08T12:01:04.790 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.786+0000 7f8773b0a640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f876c09b4f0 con 0x7f876c09b090 2023-10-08T12:01:04.791 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.786+0000 7f8773b0a640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f876c1d23b0 con 0x7f876c098930 2023-10-08T12:01:04.791 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.786+0000 7f87718a6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8758005190 0x7f876c09ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:01:04.791 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.786+0000 7f87718a6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8758005190 0x7f876c09ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46496/0 (socket says 172.21.15.62:46496) 2023-10-08T12:01:04.791 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.786+0000 7f87718a6640 1 -- 172.21.15.62:0/1562995860 learned_addr learned my addr 172.21.15.62:0/1562995860 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:01:04.791 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.786+0000 7f87718a6640 1 -- 172.21.15.62:0/1562995860 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f876c098930 msgr2=0x7f876c1e02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:01:04.791 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.786+0000 7f87718a6640 1 --2- 172.21.15.62:0/1562995860 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f876c098930 0x7f876c1e02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:04.791 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.786+0000 7f87718a6640 1 -- 172.21.15.62:0/1562995860 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f876c09b090 msgr2=0x7f876c0983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:01:04.791 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.786+0000 7f87718a6640 1 --2- 172.21.15.62:0/1562995860 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f876c09b090 0x7f876c0983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:04.791 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.786+0000 7f87718a6640 1 -- 172.21.15.62:0/1562995860 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f876c1d2690 con 0x7f8758005190 2023-10-08T12:01:04.791 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.786+0000 7f87718a6640 1 --2- 172.21.15.62:0/1562995860 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8758005190 0x7f876c09ab50 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f876800f7d0 tx=0x7f876800fc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:01:04.791 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.786+0000 7f875e7fc640 1 -- 172.21.15.62:0/1562995860 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f876800bcb0 con 0x7f8758005190 2023-10-08T12:01:04.792 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.786+0000 7f875e7fc640 1 -- 172.21.15.62:0/1562995860 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f876800fe80 con 0x7f8758005190 2023-10-08T12:01:04.792 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.786+0000 7f8773b0a640 1 -- 172.21.15.62:0/1562995860 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f876c1d2970 con 0x7f8758005190 2023-10-08T12:01:04.792 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.786+0000 7f875e7fc640 1 -- 172.21.15.62:0/1562995860 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87680116a0 con 0x7f8758005190 2023-10-08T12:01:04.792 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.786+0000 7f8773b0a640 1 -- 172.21.15.62:0/1562995860 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f876c099d30 con 0x7f8758005190 2023-10-08T12:01:04.792 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.790+0000 7f8773b0a640 1 -- 172.21.15.62:0/1562995860 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f876c04da80 con 0x7f8758005190 2023-10-08T12:01:04.793 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.790+0000 7f875e7fc640 1 -- 172.21.15.62:0/1562995860 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8768011800 con 0x7f8758005190 2023-10-08T12:01:04.793 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.790+0000 7f875e7fc640 1 --2- 172.21.15.62:0/1562995860 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f8750066470 0x7f8750068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:01:04.793 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.790+0000 7f875e7fc640 1 -- 172.21.15.62:0/1562995860 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8768084a40 con 0x7f8758005190 2023-10-08T12:01:04.793 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.790+0000 7f87710a5640 1 --2- 172.21.15.62:0/1562995860 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f8750066470 0x7f8750068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:01:04.793 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.790+0000 7f87710a5640 1 --2- 172.21.15.62:0/1562995860 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f8750066470 0x7f8750068930 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f876c14a3b0 tx=0x7f87600060d0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:01:04.795 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.794+0000 7f875e7fc640 1 -- 172.21.15.62:0/1562995860 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8768086e60 con 0x7f8758005190 2023-10-08T12:01:04.975 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.974+0000 7f8773b0a640 1 -- 172.21.15.62:0/1562995860 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f876c09d770 con 0x7f8758005190 2023-10-08T12:01:04.976 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.974+0000 7f875e7fc640 1 -- 172.21.15.62:0/1562995860 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4125 (secure 0 0 0) 0x7f8768051ec0 con 0x7f8758005190 2023-10-08T12:01:04.976 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T12:01:04.976 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4640,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/2660860288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":2660860288},{"type":"v1","addr":"172.21.15.130:6835","nonce":2660860288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5052,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6834/1276558017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":1276558017},{"type":"v1","addr":"172.21.15.62:6834","nonce":1276558017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T12:00:59.198090+0000","modified":"2023-10-08T12:01:02.234023+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5055},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5055":{"gid":5055,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6835/4173823127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":4173823127},{"type":"v1","addr":"172.21.15.62:6835","nonce":4173823127}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-08T12:01:04.977 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 16 2023-10-08T12:01:04.978 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.974+0000 7f8773b0a640 1 -- 172.21.15.62:0/1562995860 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f8750066470 msgr2=0x7f8750068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:01:04.978 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.974+0000 7f8773b0a640 1 --2- 172.21.15.62:0/1562995860 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f8750066470 0x7f8750068930 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f876c14a3b0 tx=0x7f87600060d0 comp rx=0 tx=0).stop 2023-10-08T12:01:04.978 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.974+0000 7f8773b0a640 1 -- 172.21.15.62:0/1562995860 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8758005190 msgr2=0x7f876c09ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:01:04.978 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.974+0000 7f8773b0a640 1 --2- 172.21.15.62:0/1562995860 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8758005190 0x7f876c09ab50 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f876800f7d0 tx=0x7f876800fc90 comp rx=0 tx=0).stop 2023-10-08T12:01:04.978 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.978+0000 7f8773b0a640 1 -- 172.21.15.62:0/1562995860 shutdown_connections 2023-10-08T12:01:04.979 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.978+0000 7f8773b0a640 1 --2- 172.21.15.62:0/1562995860 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f8750066470 0x7f8750068930 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:04.979 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.978+0000 7f8773b0a640 1 --2- 172.21.15.62:0/1562995860 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f876c098930 0x7f876c1e02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:04.979 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.978+0000 7f8773b0a640 1 --2- 172.21.15.62:0/1562995860 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f876c09b090 0x7f876c0983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:04.979 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.978+0000 7f8773b0a640 1 --2- 172.21.15.62:0/1562995860 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8758005190 0x7f876c09ab50 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:04.979 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.978+0000 7f8773b0a640 1 -- 172.21.15.62:0/1562995860 >> 172.21.15.62:0/1562995860 conn(0x7f876c09e540 msgr2=0x7f876c09cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:01:04.979 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.978+0000 7f8773b0a640 1 -- 172.21.15.62:0/1562995860 shutdown_connections 2023-10-08T12:01:04.979 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:04.978+0000 7f8773b0a640 1 -- 172.21.15.62:0/1562995860 wait complete. 2023-10-08T12:01:05.296 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-08T12:00:59.198090+0000', 'modified': '2023-10-08T12:01:02.234023+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5055}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5055': {'gid': 5055, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.62:6835/4173823127', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6833', 'nonce': 4173823127}, {'type': 'v1', 'addr': '172.21.15.62:6835', 'nonce': 4173823127}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-08T12:01:05.297 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-08T12:01:05.297 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-08T12:01:05.431 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.430+0000 7fad82935640 1 -- 172.21.15.62:0/3452080835 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad7c071410 msgr2=0x7fad7c0b6ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:01:05.432 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.430+0000 7fad82935640 1 --2- 172.21.15.62:0/3452080835 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad7c071410 0x7fad7c0b6ad0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fad74009bc0 tx=0x7fad7401cb80 comp rx=0 tx=0).stop 2023-10-08T12:01:05.432 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.430+0000 7fad82935640 1 -- 172.21.15.62:0/3452080835 shutdown_connections 2023-10-08T12:01:05.432 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.430+0000 7fad82935640 1 --2- 172.21.15.62:0/3452080835 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad7c071410 0x7fad7c0b6ad0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:05.432 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.430+0000 7fad82935640 1 --2- 172.21.15.62:0/3452080835 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fad7c147920 0x7fad7c0b8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:05.432 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.430+0000 7fad82935640 1 -- 172.21.15.62:0/3452080835 >> 172.21.15.62:0/3452080835 conn(0x7fad7c09c520 msgr2=0x7fad7c09c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:01:05.432 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.430+0000 7fad82935640 1 -- 172.21.15.62:0/3452080835 shutdown_connections 2023-10-08T12:01:05.432 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.430+0000 7fad82935640 1 -- 172.21.15.62:0/3452080835 wait complete. 2023-10-08T12:01:05.434 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.430+0000 7fad82935640 1 Processor -- start 2023-10-08T12:01:05.435 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.430+0000 7fad82935640 1 -- start start 2023-10-08T12:01:05.435 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.430+0000 7fad82935640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad7c071410 0x7fad7c09dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:01:05.435 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.430+0000 7fad82935640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fad7c0b9260 0x7fad7c09e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:01:05.435 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.430+0000 7fad82935640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fad7c147920 0x7fad7c09f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:01:05.435 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.430+0000 7fad82935640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad7c142480 con 0x7fad7c071410 2023-10-08T12:01:05.435 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.430+0000 7fad82935640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad7c141b80 con 0x7fad7c147920 2023-10-08T12:01:05.435 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.430+0000 7fad82935640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad7c1e2060 con 0x7fad7c0b9260 2023-10-08T12:01:05.435 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.430+0000 7fad7bfff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad7c071410 0x7fad7c09dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:01:05.435 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.430+0000 7fad7bfff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad7c071410 0x7fad7c09dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46502/0 (socket says 172.21.15.62:46502) 2023-10-08T12:01:05.436 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.430+0000 7fad7bfff640 1 -- 172.21.15.62:0/1135228059 learned_addr learned my addr 172.21.15.62:0/1135228059 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:01:05.436 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.430+0000 7fad73fff640 1 --2- 172.21.15.62:0/1135228059 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fad7c0b9260 0x7fad7c09e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:01:05.436 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.430+0000 7fad80ed2640 1 --2- 172.21.15.62:0/1135228059 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fad7c147920 0x7fad7c09f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:01:05.436 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.430+0000 7fad7bfff640 1 -- 172.21.15.62:0/1135228059 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fad7c0b9260 msgr2=0x7fad7c09e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:01:05.436 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.430+0000 7fad7bfff640 1 --2- 172.21.15.62:0/1135228059 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fad7c0b9260 0x7fad7c09e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:05.436 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.430+0000 7fad7bfff640 1 -- 172.21.15.62:0/1135228059 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fad7c147920 msgr2=0x7fad7c09f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:01:05.436 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.430+0000 7fad7bfff640 1 --2- 172.21.15.62:0/1135228059 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fad7c147920 0x7fad7c09f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:05.436 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.430+0000 7fad7bfff640 1 -- 172.21.15.62:0/1135228059 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad74009820 con 0x7fad7c071410 2023-10-08T12:01:05.436 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.430+0000 7fad80ed2640 1 --2- 172.21.15.62:0/1135228059 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fad7c147920 0x7fad7c09f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:01:05.436 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.430+0000 7fad7bfff640 1 --2- 172.21.15.62:0/1135228059 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad7c071410 0x7fad7c09dc60 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fad6400c480 tx=0x7fad6400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:01:05.437 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.430+0000 7fad797fa640 1 -- 172.21.15.62:0/1135228059 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad64012830 con 0x7fad7c071410 2023-10-08T12:01:05.437 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.434+0000 7fad797fa640 1 -- 172.21.15.62:0/1135228059 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fad64012a80 con 0x7fad7c071410 2023-10-08T12:01:05.437 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.434+0000 7fad82935640 1 -- 172.21.15.62:0/1135228059 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad7c1e2340 con 0x7fad7c071410 2023-10-08T12:01:05.437 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.434+0000 7fad797fa640 1 -- 172.21.15.62:0/1135228059 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad64011380 con 0x7fad7c071410 2023-10-08T12:01:05.437 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.434+0000 7fad82935640 1 -- 172.21.15.62:0/1135228059 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad7c1e2900 con 0x7fad7c071410 2023-10-08T12:01:05.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.434+0000 7fad797fa640 1 -- 172.21.15.62:0/1135228059 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fad640114e0 con 0x7fad7c071410 2023-10-08T12:01:05.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.434+0000 7fad797fa640 1 --2- 172.21.15.62:0/1135228059 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fad5c0664a0 0x7fad5c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:01:05.445 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.434+0000 7fad797fa640 1 -- 172.21.15.62:0/1135228059 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fad640842c0 con 0x7fad7c071410 2023-10-08T12:01:05.445 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.434+0000 7fad73fff640 1 --2- 172.21.15.62:0/1135228059 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fad5c0664a0 0x7fad5c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:01:05.445 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.434+0000 7fad85a7e000 1 Processor -- start 2023-10-08T12:01:05.445 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.434+0000 7fad85a7e000 1 -- start start 2023-10-08T12:01:05.445 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.434+0000 7fad73fff640 1 --2- 172.21.15.62:0/1135228059 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fad5c0664a0 0x7fad5c068960 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fad6c0058d0 tx=0x7fad6c005860 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:01:05.445 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.434+0000 7fad85a7e000 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5649fefdb1e0 0x5649fefdb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:01:05.445 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.434+0000 7fad85a7e000 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5649fefdbb00 0x5649fefdbee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:01:05.445 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.434+0000 7fad85a7e000 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5649fefdc420 0x5649fefe6470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:01:05.445 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.434+0000 7fad85a7e000 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649fed9bcc0 con 0x5649fefdbb00 2023-10-08T12:01:05.445 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.434+0000 7fad85a7e000 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649fedfe8e0 con 0x5649fefdc420 2023-10-08T12:01:05.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.434+0000 7fad85a7e000 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x5649fedfbe10 con 0x5649fefdb1e0 2023-10-08T12:01:05.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.434+0000 7fad73fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5649fefdbb00 0x5649fefdbee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:01:05.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.434+0000 7fad73fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5649fefdbb00 0x5649fefdbee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46514/0 (socket says 172.21.15.62:46514) 2023-10-08T12:01:05.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.434+0000 7fad73fff640 1 -- 172.21.15.62:0/2880221164 learned_addr learned my addr 172.21.15.62:0/2880221164 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:01:05.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.434+0000 7fad80ed2640 1 --2- 172.21.15.62:0/2880221164 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5649fefdc420 0x5649fefe6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:01:05.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.438+0000 7fad7bfff640 1 --2- 172.21.15.62:0/2880221164 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5649fefdb1e0 0x5649fefdb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:01:05.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.438+0000 7fad73fff640 1 -- 172.21.15.62:0/2880221164 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5649fefdb1e0 msgr2=0x5649fefdb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:01:05.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.438+0000 7fad73fff640 1 --2- 172.21.15.62:0/2880221164 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5649fefdb1e0 0x5649fefdb5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:05.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.438+0000 7fad73fff640 1 -- 172.21.15.62:0/2880221164 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5649fefdc420 msgr2=0x5649fefe6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:01:05.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.438+0000 7fad73fff640 1 --2- 172.21.15.62:0/2880221164 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5649fefdc420 0x5649fefe6470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:05.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.438+0000 7fad73fff640 1 -- 172.21.15.62:0/2880221164 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5649feaf0890 con 0x5649fefdbb00 2023-10-08T12:01:05.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.438+0000 7fad80ed2640 1 --2- 172.21.15.62:0/2880221164 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5649fefdc420 0x5649fefe6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:01:05.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.438+0000 7fad7bfff640 1 --2- 172.21.15.62:0/2880221164 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5649fefdb1e0 0x5649fefdb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:01:05.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.438+0000 7fad73fff640 1 --2- 172.21.15.62:0/2880221164 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5649fefdbb00 0x5649fefdbee0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fad6c00ed20 tx=0x7fad6c011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ced9f26b522beaa server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:01:05.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.438+0000 7fad71ffb640 1 -- 172.21.15.62:0/2880221164 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6c022070 con 0x5649fefdbb00 2023-10-08T12:01:05.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.438+0000 7fad71ffb640 1 -- 172.21.15.62:0/2880221164 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fad6c00ed50 con 0x5649fefdbb00 2023-10-08T12:01:05.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.438+0000 7fad71ffb640 1 -- 172.21.15.62:0/2880221164 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6c00eee0 con 0x5649fefdbb00 2023-10-08T12:01:05.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.438+0000 7fad85a7e000 1 -- 172.21.15.62:0/2880221164 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5649fefdbb00 msgr2=0x5649fefdbee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:01:05.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.438+0000 7fad85a7e000 1 --2- 172.21.15.62:0/2880221164 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5649fefdbb00 0x5649fefdbee0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fad6c00ed20 tx=0x7fad6c011000 comp rx=0 tx=0).stop 2023-10-08T12:01:05.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.438+0000 7fad85a7e000 1 -- 172.21.15.62:0/2880221164 shutdown_connections 2023-10-08T12:01:05.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.438+0000 7fad85a7e000 1 --2- 172.21.15.62:0/2880221164 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5649fefdc420 0x5649fefe6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:05.448 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.438+0000 7fad85a7e000 1 --2- 172.21.15.62:0/2880221164 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5649fefdbb00 0x5649fefdbee0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:05.448 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.438+0000 7fad85a7e000 1 --2- 172.21.15.62:0/2880221164 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5649fefdb1e0 0x5649fefdb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:05.448 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.438+0000 7fad85a7e000 1 -- 172.21.15.62:0/2880221164 >> 172.21.15.62:0/2880221164 conn(0x5649fefd6f90 msgr2=0x5649fefd9380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:01:05.448 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.438+0000 7fad85a7e000 1 -- 172.21.15.62:0/2880221164 shutdown_connections 2023-10-08T12:01:05.448 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.438+0000 7fad85a7e000 1 -- 172.21.15.62:0/2880221164 wait complete. 2023-10-08T12:01:05.448 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.438+0000 7fad85a7e000 1 -- start start 2023-10-08T12:01:05.448 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.438+0000 7fad85a7e000 1 Processor -- start 2023-10-08T12:01:05.448 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.438+0000 7fad85a7e000 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5649fefdb1e0 0x5649fefacab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:01:05.448 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.438+0000 7fad85a7e000 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5649fefdbb00 0x5649fefacff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:01:05.448 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.438+0000 7fad85a7e000 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5649fefdc420 0x5649fefe0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:01:05.448 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.438+0000 7fad85a7e000 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649fedf7700 con 0x5649fefdbb00 2023-10-08T12:01:05.449 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.438+0000 7fad85a7e000 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649fedb6d10 con 0x5649fefdc420 2023-10-08T12:01:05.449 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.438+0000 7fad85a7e000 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x5649fedb69b0 con 0x5649fefdb1e0 2023-10-08T12:01:05.449 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.438+0000 7fad85a7e000 10 client.0 _ll_register_callbacks cb 0x5649fef92660 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:01:05.449 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.438+0000 7fad73fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5649fefdbb00 0x5649fefacff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:01:05.449 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.438+0000 7fad73fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5649fefdbb00 0x5649fefacff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46526/0 (socket says 172.21.15.62:46526) 2023-10-08T12:01:05.449 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.438+0000 7fad73fff640 1 -- 172.21.15.62:0/179404447 learned_addr learned my addr 172.21.15.62:0/179404447 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:01:05.449 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.438+0000 7fad7bfff640 1 --2- 172.21.15.62:0/179404447 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5649fefdb1e0 0x5649fefacab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:01:05.449 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.438+0000 7fad80ed2640 1 --2- 172.21.15.62:0/179404447 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5649fefdc420 0x5649fefe0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:01:05.449 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.438+0000 7fad73fff640 1 -- 172.21.15.62:0/179404447 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5649fefdb1e0 msgr2=0x5649fefacab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:01:05.449 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.438+0000 7fad73fff640 1 --2- 172.21.15.62:0/179404447 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5649fefdb1e0 0x5649fefacab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:05.449 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.438+0000 7fad73fff640 1 -- 172.21.15.62:0/179404447 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5649fefdc420 msgr2=0x5649fefe0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:01:05.450 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.438+0000 7fad73fff640 1 --2- 172.21.15.62:0/179404447 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5649fefdc420 0x5649fefe0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:05.450 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.438+0000 7fad73fff640 1 -- 172.21.15.62:0/179404447 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad6c00ea00 con 0x5649fefdbb00 2023-10-08T12:01:05.450 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.438+0000 7fad73fff640 1 --2- 172.21.15.62:0/179404447 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5649fefdbb00 0x5649fefacff0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x5649fee753d0 tx=0x7fad6c005600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53815ae5d4e954bd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:01:05.450 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.438+0000 7fad5affd640 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2023-10-08T12:01:05.450 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.438+0000 7fad5affd640 1 -- 172.21.15.62:0/179404447 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6c022040 con 0x5649fefdbb00 2023-10-08T12:01:05.450 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.438+0000 7fad85a7e000 1 -- 172.21.15.62:0/179404447 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5649fedab370 con 0x5649fefdbb00 2023-10-08T12:01:05.450 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.438+0000 7fad5affd640 1 -- 172.21.15.62:0/179404447 <== mon.0 v2:172.21.15.62:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fad6c004bc0 con 0x5649fefdbb00 2023-10-08T12:01:05.450 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.438+0000 7fad5affd640 1 -- 172.21.15.62:0/179404447 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fad6c00eee0 con 0x5649fefdbb00 2023-10-08T12:01:05.450 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.438+0000 7fad85a7e000 10 client.5217 fetch_fsmap learned FSMap version 16 2023-10-08T12:01:05.450 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.438+0000 7fad85a7e000 1 -- 172.21.15.62:0/179404447 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x5649fedb9460 con 0x5649fefdbb00 2023-10-08T12:01:05.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.438+0000 7fad5affd640 1 -- 172.21.15.62:0/179404447 <== mon.0 v2:172.21.15.62:3300/0 4 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x5649fedab370 con 0x5649fefdbb00 2023-10-08T12:01:05.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.438+0000 7fad5affd640 1 -- 172.21.15.62:0/179404447 <== mon.0 v2:172.21.15.62:3300/0 5 ==== fsmap(e 16) v1 ==== 2719+0+0 (secure 0 0 0) 0x7fad6c01e440 con 0x5649fefdbb00 2023-10-08T12:01:05.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.438+0000 7fad85a7e000 10 client.5217 fetch_fsmap finished waiting for FSMap version 16 2023-10-08T12:01:05.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.438+0000 7fad85a7e000 10 client.5217 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-08T12:01:05.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.438+0000 7fad85a7e000 20 client.5217 populate_metadata read hostname 'smithi062' 2023-10-08T12:01:05.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.438+0000 7fad85a7e000 1 --2- 172.21.15.62:0/179404447 >> [v2:172.21.15.62:6833/4173823127,v1:172.21.15.62:6835/4173823127] conn(0x5649fefe0d60 0x5649fefe1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:01:05.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.438+0000 7fad85a7e000 4 client.5217 mds_command: new command op to 5055 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:01:05.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.438+0000 7fad85a7e000 1 -- 172.21.15.62:0/179404447 --> [v2:172.21.15.62:6833/4173823127,v1:172.21.15.62:6835/4173823127] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5649fed912d0 con 0x5649fefe0d60 2023-10-08T12:01:05.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.438+0000 7fad7bfff640 1 --2- 172.21.15.62:0/179404447 >> [v2:172.21.15.62:6833/4173823127,v1:172.21.15.62:6835/4173823127] conn(0x5649fefe0d60 0x5649fefe1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:01:05.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.442+0000 7fad7bfff640 1 --2- 172.21.15.62:0/179404447 >> [v2:172.21.15.62:6833/4173823127,v1:172.21.15.62:6835/4173823127] conn(0x5649fefe0d60 0x5649fefe1140 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db3e9ddc6ae4e89e server_cookie=7b20248109fa56d4 in_seq=0 out_seq=0 2023-10-08T12:01:05.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.442+0000 7fad5affd640 10 client.5217 ms_handle_connect on v2:172.21.15.62:6833/4173823127 2023-10-08T12:01:05.452 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.442+0000 7fad5affd640 1 -- 172.21.15.62:0/179404447 <== mds.0 v2:172.21.15.62:6833/4173823127 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5649fed912d0 con 0x5649fefe0d60 2023-10-08T12:01:05.452 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.442+0000 7fad5affd640 10 client.5217 handle_command_reply: tid=0 2023-10-08T12:01:05.452 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.442+0000 7fad85a7e000 1 client.5217 shutdown 2023-10-08T12:01:05.452 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.442+0000 7fad85a7e000 1 -- 172.21.15.62:0/179404447 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5649fefdbb00 msgr2=0x5649fefacff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:01:05.452 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.442+0000 7fad85a7e000 1 --2- 172.21.15.62:0/179404447 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5649fefdbb00 0x5649fefacff0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x5649fee753d0 tx=0x7fad6c005600 comp rx=0 tx=0).stop 2023-10-08T12:01:05.452 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.442+0000 7fad85a7e000 1 -- 172.21.15.62:0/179404447 shutdown_connections 2023-10-08T12:01:05.452 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.442+0000 7fad85a7e000 1 --2- 172.21.15.62:0/179404447 >> [v2:172.21.15.62:6833/4173823127,v1:172.21.15.62:6835/4173823127] conn(0x5649fefe0d60 0x5649fefe1140 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:05.452 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.442+0000 7fad85a7e000 1 --2- 172.21.15.62:0/179404447 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5649fefdc420 0x5649fefe0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:05.452 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.442+0000 7fad5affd640 0 client.5217 ms_handle_reset on v2:172.21.15.62:6833/4173823127 2023-10-08T12:01:05.452 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.442+0000 7fad85a7e000 1 --2- 172.21.15.62:0/179404447 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5649fefdbb00 0x5649fefacff0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:05.452 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.442+0000 7fad85a7e000 1 --2- 172.21.15.62:0/179404447 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5649fefdb1e0 0x5649fefacab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:05.452 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.442+0000 7fad85a7e000 1 -- 172.21.15.62:0/179404447 >> 172.21.15.62:0/179404447 conn(0x5649fefd6f90 msgr2=0x5649fefd9380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:01:05.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.442+0000 7fad85a7e000 1 -- 172.21.15.62:0/179404447 shutdown_connections 2023-10-08T12:01:05.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.442+0000 7fad85a7e000 1 -- 172.21.15.62:0/179404447 wait complete. 2023-10-08T12:01:05.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.442+0000 7fad85a7e000 20 client.5217 trim_cache size 0 max 16384 2023-10-08T12:01:05.458 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.458+0000 7fad85a7e000 1 Processor -- start 2023-10-08T12:01:05.458 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.458+0000 7fad85a7e000 1 -- start start 2023-10-08T12:01:05.460 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.458+0000 7fad85a7e000 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5649fefdb1e0 0x5649fefe1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:01:05.460 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.458+0000 7fad85a7e000 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5649fefdbb00 0x5649fefe1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:01:05.460 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.458+0000 7fad85a7e000 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5649fefdc420 0x5649fefe1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:01:05.460 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.458+0000 7fad85a7e000 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649feab1940 con 0x5649fefdb1e0 2023-10-08T12:01:05.461 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.458+0000 7fad85a7e000 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649fed7b3b0 con 0x5649fefdc420 2023-10-08T12:01:05.461 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.458+0000 7fad85a7e000 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x5649fedbda00 con 0x5649fefdbb00 2023-10-08T12:01:05.461 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.458+0000 7fad7bfff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5649fefdb1e0 0x5649fefe1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:01:05.461 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.458+0000 7fad7bfff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5649fefdb1e0 0x5649fefe1140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46536/0 (socket says 172.21.15.62:46536) 2023-10-08T12:01:05.461 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.458+0000 7fad7bfff640 1 -- 172.21.15.62:0/2578333619 learned_addr learned my addr 172.21.15.62:0/2578333619 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:01:05.461 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.458+0000 7fad7bfff640 1 -- 172.21.15.62:0/2578333619 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5649fefdbb00 msgr2=0x5649fefe1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:01:05.461 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.458+0000 7fad7bfff640 1 --2- 172.21.15.62:0/2578333619 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5649fefdbb00 0x5649fefe1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:05.461 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.458+0000 7fad7bfff640 1 -- 172.21.15.62:0/2578333619 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5649fefdc420 msgr2=0x5649fefe1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:01:05.462 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.458+0000 7fad7bfff640 1 --2- 172.21.15.62:0/2578333619 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5649fefdc420 0x5649fefe1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:05.462 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.458+0000 7fad7bfff640 1 -- 172.21.15.62:0/2578333619 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5649fed9f760 con 0x5649fefdb1e0 2023-10-08T12:01:05.462 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.458+0000 7fad7bfff640 1 --2- 172.21.15.62:0/2578333619 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5649fefdb1e0 0x5649fefe1140 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fad6400ce40 tx=0x7fad64000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8a7cf5b1fa14216 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:01:05.462 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.458+0000 7fad727fc640 1 -- 172.21.15.62:0/2578333619 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad640537a0 con 0x5649fefdb1e0 2023-10-08T12:01:05.462 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.458+0000 7fad727fc640 1 -- 172.21.15.62:0/2578333619 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fad64051b10 con 0x5649fefdb1e0 2023-10-08T12:01:05.462 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.458+0000 7fad727fc640 1 -- 172.21.15.62:0/2578333619 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad64051c80 con 0x5649fefdb1e0 2023-10-08T12:01:05.463 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.458+0000 7fad85a7e000 1 -- 172.21.15.62:0/2578333619 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5649fefdb1e0 msgr2=0x5649fefe1140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:01:05.463 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.458+0000 7fad85a7e000 1 --2- 172.21.15.62:0/2578333619 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5649fefdb1e0 0x5649fefe1140 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fad6400ce40 tx=0x7fad64000ee0 comp rx=0 tx=0).stop 2023-10-08T12:01:05.463 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.458+0000 7fad85a7e000 1 -- 172.21.15.62:0/2578333619 shutdown_connections 2023-10-08T12:01:05.463 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.458+0000 7fad85a7e000 1 --2- 172.21.15.62:0/2578333619 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5649fefdbb00 0x5649fefe1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:05.463 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.458+0000 7fad85a7e000 1 --2- 172.21.15.62:0/2578333619 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5649fefdc420 0x5649fefe1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:05.463 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.458+0000 7fad85a7e000 1 --2- 172.21.15.62:0/2578333619 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5649fefdb1e0 0x5649fefe1140 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:05.463 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.458+0000 7fad85a7e000 1 -- 172.21.15.62:0/2578333619 >> 172.21.15.62:0/2578333619 conn(0x5649fefd6f90 msgr2=0x5649fefdef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:01:05.463 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.458+0000 7fad85a7e000 1 -- 172.21.15.62:0/2578333619 shutdown_connections 2023-10-08T12:01:05.463 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.458+0000 7fad85a7e000 1 -- 172.21.15.62:0/2578333619 wait complete. 2023-10-08T12:01:05.463 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.458+0000 7fad85a7e000 1 -- start start 2023-10-08T12:01:05.463 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.458+0000 7fad85a7e000 1 Processor -- start 2023-10-08T12:01:05.467 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.458+0000 7fad85a7e000 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5649fefdb1e0 0x5649feff3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:01:05.467 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.458+0000 7fad85a7e000 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5649fefdbb00 0x5649feff32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:01:05.468 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.458+0000 7fad85a7e000 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5649fefdc420 0x5649feff1280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:01:05.468 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.458+0000 7fad85a7e000 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649fedf1a00 con 0x5649fefdbb00 2023-10-08T12:01:05.468 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.458+0000 7fad85a7e000 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649fee38e70 con 0x5649fefdb1e0 2023-10-08T12:01:05.468 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.458+0000 7fad85a7e000 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x5649fedfc870 con 0x5649fefdc420 2023-10-08T12:01:05.468 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.458+0000 7fad85a7e000 10 client.0 _ll_register_callbacks cb 0x5649fedf7100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:01:05.468 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.458+0000 7fad73fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5649fefdbb00 0x5649feff32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:01:05.468 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.458+0000 7fad73fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5649fefdbb00 0x5649feff32a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46546/0 (socket says 172.21.15.62:46546) 2023-10-08T12:01:05.468 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.458+0000 7fad73fff640 1 -- 172.21.15.62:0/1382904481 learned_addr learned my addr 172.21.15.62:0/1382904481 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:01:05.468 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.458+0000 7fad7bfff640 1 --2- 172.21.15.62:0/1382904481 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5649fefdb1e0 0x5649feff3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:01:05.468 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.458+0000 7fad80ed2640 1 --2- 172.21.15.62:0/1382904481 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5649fefdc420 0x5649feff1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:01:05.468 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.458+0000 7fad73fff640 1 -- 172.21.15.62:0/1382904481 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5649fefdc420 msgr2=0x5649feff1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:01:05.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.458+0000 7fad73fff640 1 --2- 172.21.15.62:0/1382904481 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5649fefdc420 0x5649feff1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:05.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.458+0000 7fad73fff640 1 -- 172.21.15.62:0/1382904481 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5649fefdb1e0 msgr2=0x5649feff3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:01:05.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.458+0000 7fad73fff640 1 --2- 172.21.15.62:0/1382904481 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5649fefdb1e0 0x5649feff3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:05.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.458+0000 7fad73fff640 1 -- 172.21.15.62:0/1382904481 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad7c1e2900 con 0x5649fefdbb00 2023-10-08T12:01:05.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.458+0000 7fad80ed2640 1 --2- 172.21.15.62:0/1382904481 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5649fefdc420 0x5649feff1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:01:05.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.462+0000 7fad7bfff640 1 --2- 172.21.15.62:0/1382904481 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5649fefdb1e0 0x5649feff3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:01:05.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.462+0000 7fad73fff640 1 --2- 172.21.15.62:0/1382904481 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5649fefdbb00 0x5649feff32a0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fad6c00a010 tx=0x7fad6c011e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9db9c839a92bfc19 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:01:05.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.462+0000 7fad5affd640 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2023-10-08T12:01:05.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.462+0000 7fad5affd640 1 -- 172.21.15.62:0/1382904481 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6c022040 con 0x5649fefdbb00 2023-10-08T12:01:05.470 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.462+0000 7fad5affd640 1 -- 172.21.15.62:0/1382904481 <== mon.0 v2:172.21.15.62:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fad6c01ea20 con 0x5649fefdbb00 2023-10-08T12:01:05.470 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.462+0000 7fad85a7e000 1 -- 172.21.15.62:0/1382904481 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5649fed8f6f0 con 0x5649fefdbb00 2023-10-08T12:01:05.470 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.462+0000 7fad5affd640 1 -- 172.21.15.62:0/1382904481 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fad6c0049c0 con 0x5649fefdbb00 2023-10-08T12:01:05.470 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.462+0000 7fad85a7e000 10 client.5223 fetch_fsmap learned FSMap version 16 2023-10-08T12:01:05.470 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.462+0000 7fad85a7e000 1 -- 172.21.15.62:0/1382904481 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x5649feaf0cc0 con 0x5649fefdbb00 2023-10-08T12:01:05.470 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.462+0000 7fad5affd640 1 -- 172.21.15.62:0/1382904481 <== mon.0 v2:172.21.15.62:3300/0 4 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x5649fed8f6f0 con 0x5649fefdbb00 2023-10-08T12:01:05.470 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.462+0000 7fad5affd640 1 -- 172.21.15.62:0/1382904481 <== mon.0 v2:172.21.15.62:3300/0 5 ==== fsmap(e 16) v1 ==== 2719+0+0 (secure 0 0 0) 0x7fad6c004c10 con 0x5649fefdbb00 2023-10-08T12:01:05.470 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.462+0000 7fad85a7e000 10 client.5223 fetch_fsmap finished waiting for FSMap version 16 2023-10-08T12:01:05.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.462+0000 7fad85a7e000 10 client.5223 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-08T12:01:05.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.462+0000 7fad85a7e000 20 client.5223 populate_metadata read hostname 'smithi062' 2023-10-08T12:01:05.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.462+0000 7fad85a7e000 1 --2- 172.21.15.62:0/1382904481 >> [v2:172.21.15.62:6833/4173823127,v1:172.21.15.62:6835/4173823127] conn(0x5649feff17c0 0x5649feff1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:01:05.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.462+0000 7fad85a7e000 4 client.5223 mds_command: new command op to 5055 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-08T12:01:05.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.462+0000 7fad85a7e000 1 -- 172.21.15.62:0/1382904481 --> [v2:172.21.15.62:6833/4173823127,v1:172.21.15.62:6835/4173823127] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5649fedf06e0 con 0x5649feff17c0 2023-10-08T12:01:05.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.462+0000 7fad7bfff640 1 --2- 172.21.15.62:0/1382904481 >> [v2:172.21.15.62:6833/4173823127,v1:172.21.15.62:6835/4173823127] conn(0x5649feff17c0 0x5649feff1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:01:05.472 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.462+0000 7fad5affd640 10 client.5223 ms_handle_connect on v2:172.21.15.62:6833/4173823127 2023-10-08T12:01:05.472 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.462+0000 7fad7bfff640 1 --2- 172.21.15.62:0/1382904481 >> [v2:172.21.15.62:6833/4173823127,v1:172.21.15.62:6835/4173823127] conn(0x5649feff17c0 0x5649feff1ba0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=135ad46c12f500b9 server_cookie=2d30f17f1bba7d5d in_seq=0 out_seq=0 2023-10-08T12:01:05.472 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.462+0000 7fad5affd640 1 -- 172.21.15.62:0/1382904481 <== mds.0 v2:172.21.15.62:6833/4173823127 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+318 (crc 0 0 0) 0x5649fedf06e0 con 0x5649feff17c0 2023-10-08T12:01:05.472 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.462+0000 7fad5affd640 10 client.5223 handle_command_reply: tid=0 2023-10-08T12:01:05.472 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.462+0000 7fad85a7e000 1 client.5223 shutdown 2023-10-08T12:01:05.472 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.462+0000 7fad85a7e000 1 -- 172.21.15.62:0/1382904481 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5649fefdbb00 msgr2=0x5649feff32a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:01:05.472 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.462+0000 7fad85a7e000 1 --2- 172.21.15.62:0/1382904481 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5649fefdbb00 0x5649feff32a0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fad6c00a010 tx=0x7fad6c011e80 comp rx=0 tx=0).stop 2023-10-08T12:01:05.473 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.462+0000 7fad85a7e000 1 -- 172.21.15.62:0/1382904481 shutdown_connections 2023-10-08T12:01:05.473 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.462+0000 7fad85a7e000 1 --2- 172.21.15.62:0/1382904481 >> [v2:172.21.15.62:6833/4173823127,v1:172.21.15.62:6835/4173823127] conn(0x5649feff17c0 0x5649feff1ba0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:05.473 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.462+0000 7fad85a7e000 1 --2- 172.21.15.62:0/1382904481 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5649fefdc420 0x5649feff1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:05.473 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.462+0000 7fad85a7e000 1 --2- 172.21.15.62:0/1382904481 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5649fefdbb00 0x5649feff32a0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:05.473 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.462+0000 7fad5affd640 0 client.5223 ms_handle_reset on v2:172.21.15.62:6833/4173823127 2023-10-08T12:01:05.473 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.462+0000 7fad85a7e000 1 --2- 172.21.15.62:0/1382904481 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5649fefdb1e0 0x5649feff3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:05.474 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.462+0000 7fad85a7e000 1 -- 172.21.15.62:0/1382904481 >> 172.21.15.62:0/1382904481 conn(0x5649fefd6f90 msgr2=0x5649fefdf7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:01:05.474 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.462+0000 7fad85a7e000 1 -- 172.21.15.62:0/1382904481 shutdown_connections 2023-10-08T12:01:05.474 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.462+0000 7fad85a7e000 1 -- 172.21.15.62:0/1382904481 wait complete. 2023-10-08T12:01:05.474 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.462+0000 7fad85a7e000 20 client.5223 trim_cache size 0 max 16384 2023-10-08T12:01:05.474 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2023-10-08T12:01:05.475 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_fsid": "3e777930-c2c1-4f2b-a903-c07ee4ca2c52", 2023-10-08T12:01:05.475 INFO:teuthology.orchestra.run.smithi062.stdout: "whoami": 0, 2023-10-08T12:01:05.475 INFO:teuthology.orchestra.run.smithi062.stdout: "id": 5055, 2023-10-08T12:01:05.475 INFO:teuthology.orchestra.run.smithi062.stdout: "want_state": "up:active", 2023-10-08T12:01:05.475 INFO:teuthology.orchestra.run.smithi062.stdout: "state": "up:active", 2023-10-08T12:01:05.475 INFO:teuthology.orchestra.run.smithi062.stdout: "fs_name": "cephfs", 2023-10-08T12:01:05.476 INFO:teuthology.orchestra.run.smithi062.stdout: "rank_uptime": 5.606875821, 2023-10-08T12:01:05.476 INFO:teuthology.orchestra.run.smithi062.stdout: "mdsmap_epoch": 16, 2023-10-08T12:01:05.476 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_epoch": 30, 2023-10-08T12:01:05.476 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_epoch_barrier": 30, 2023-10-08T12:01:05.476 INFO:teuthology.orchestra.run.smithi062.stdout: "uptime": 12.644777439 2023-10-08T12:01:05.476 INFO:teuthology.orchestra.run.smithi062.stdout:} 2023-10-08T12:01:05.477 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.462+0000 7fad82935640 1 -- 172.21.15.62:0/1135228059 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fad5c0664a0 msgr2=0x7fad5c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:01:05.477 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.462+0000 7fad82935640 1 --2- 172.21.15.62:0/1135228059 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fad5c0664a0 0x7fad5c068960 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fad6c0058d0 tx=0x7fad6c005860 comp rx=0 tx=0).stop 2023-10-08T12:01:05.477 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.462+0000 7fad82935640 1 -- 172.21.15.62:0/1135228059 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad7c071410 msgr2=0x7fad7c09dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:01:05.477 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.462+0000 7fad82935640 1 --2- 172.21.15.62:0/1135228059 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad7c071410 0x7fad7c09dc60 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fad6400c480 tx=0x7fad6400c940 comp rx=0 tx=0).stop 2023-10-08T12:01:05.477 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.462+0000 7fad82935640 1 -- 172.21.15.62:0/1135228059 shutdown_connections 2023-10-08T12:01:05.477 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.462+0000 7fad82935640 1 --2- 172.21.15.62:0/1135228059 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fad5c0664a0 0x7fad5c068960 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:05.477 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.462+0000 7fad82935640 1 --2- 172.21.15.62:0/1135228059 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fad7c0b9260 0x7fad7c09e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:05.477 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.462+0000 7fad82935640 1 --2- 172.21.15.62:0/1135228059 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fad7c147920 0x7fad7c09f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:05.478 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.462+0000 7fad82935640 1 --2- 172.21.15.62:0/1135228059 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad7c071410 0x7fad7c09dc60 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:05.478 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.462+0000 7fad82935640 1 -- 172.21.15.62:0/1135228059 >> 172.21.15.62:0/1135228059 conn(0x7fad7c09c520 msgr2=0x7fad7c142910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:01:05.478 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.462+0000 7fad82935640 1 -- 172.21.15.62:0/1135228059 shutdown_connections 2023-10-08T12:01:05.478 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.462+0000 7fad82935640 1 -- 172.21.15.62:0/1135228059 wait complete. 2023-10-08T12:01:05.480 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T12:01:05.595 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.594+0000 7f34bd242640 1 -- 172.21.15.62:0/4289639967 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a80b0aa0 con 0x7f34b80ba240 2023-10-08T12:01:05.596 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.594+0000 7f34c04a8640 1 -- 172.21.15.62:0/4289639967 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f34b80ba240 msgr2=0x7f34b806b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:01:05.596 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.594+0000 7f34c04a8640 1 --2- 172.21.15.62:0/4289639967 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f34b80ba240 0x7f34b806b1c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f34a8009900 tx=0x7f34a801f0b0 comp rx=0 tx=0).stop 2023-10-08T12:01:05.596 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.594+0000 7f34c04a8640 1 -- 172.21.15.62:0/4289639967 shutdown_connections 2023-10-08T12:01:05.596 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.594+0000 7f34c04a8640 1 --2- 172.21.15.62:0/4289639967 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f34b80ba240 0x7f34b806b1c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:05.596 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.594+0000 7f34c04a8640 1 --2- 172.21.15.62:0/4289639967 >> v2:172.21.15.130:3300/0 conn(0x7f34b80b9e60 0x7f34b80b5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:05.597 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.594+0000 7f34c04a8640 1 -- 172.21.15.62:0/4289639967 >> 172.21.15.62:0/4289639967 conn(0x7f34b809c520 msgr2=0x7f34b809c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:01:05.597 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.594+0000 7f34c04a8640 1 -- 172.21.15.62:0/4289639967 shutdown_connections 2023-10-08T12:01:05.597 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.594+0000 7f34c04a8640 1 -- 172.21.15.62:0/4289639967 wait complete. 2023-10-08T12:01:05.599 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.594+0000 7f34c04a8640 1 Processor -- start 2023-10-08T12:01:05.599 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.594+0000 7f34c04a8640 1 -- start start 2023-10-08T12:01:05.600 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.594+0000 7f34c04a8640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f34b80b09e0 0x7f34b81d2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:01:05.600 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.594+0000 7f34c04a8640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f34b80b9e60 0x7f34b809f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:01:05.600 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.594+0000 7f34c04a8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f34b80ba240 0x7f34b81e2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:01:05.600 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.594+0000 7f34c04a8640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34b81d3430 con 0x7f34b80b9e60 2023-10-08T12:01:05.600 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.594+0000 7f34c04a8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34b80b4b50 con 0x7f34b80ba240 2023-10-08T12:01:05.601 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.594+0000 7f34c04a8640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34b806f480 con 0x7f34b80b09e0 2023-10-08T12:01:05.601 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.594+0000 7f34bda43640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f34b80b9e60 0x7f34b809f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:01:05.601 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.594+0000 7f34bda43640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f34b80b9e60 0x7f34b809f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46548/0 (socket says 172.21.15.62:46548) 2023-10-08T12:01:05.601 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.594+0000 7f34bda43640 1 -- 172.21.15.62:0/3974947423 learned_addr learned my addr 172.21.15.62:0/3974947423 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:01:05.601 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.594+0000 7f34be244640 1 --2- 172.21.15.62:0/3974947423 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f34b80b09e0 0x7f34b81d2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:01:05.601 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.594+0000 7f34bea45640 1 --2- 172.21.15.62:0/3974947423 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f34b80ba240 0x7f34b81e2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:01:05.602 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.594+0000 7f34bda43640 1 -- 172.21.15.62:0/3974947423 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f34b80b09e0 msgr2=0x7f34b81d2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:01:05.602 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.594+0000 7f34bda43640 1 --2- 172.21.15.62:0/3974947423 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f34b80b09e0 0x7f34b81d2ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:05.602 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.594+0000 7f34bda43640 1 -- 172.21.15.62:0/3974947423 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f34b80ba240 msgr2=0x7f34b81e2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:01:05.602 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.594+0000 7f34bda43640 1 --2- 172.21.15.62:0/3974947423 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f34b80ba240 0x7f34b81e2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:05.603 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.594+0000 7f34bda43640 1 -- 172.21.15.62:0/3974947423 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34b400a930 con 0x7f34b80b9e60 2023-10-08T12:01:05.603 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.598+0000 7f34bda43640 1 --2- 172.21.15.62:0/3974947423 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f34b80b9e60 0x7f34b809f400 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f34a8009850 tx=0x7f34a80b04c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:01:05.603 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.598+0000 7f34aeffd640 1 -- 172.21.15.62:0/3974947423 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a8005220 con 0x7f34b80b9e60 2023-10-08T12:01:05.604 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.598+0000 7f34aeffd640 1 -- 172.21.15.62:0/3974947423 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f34a8005470 con 0x7f34b80b9e60 2023-10-08T12:01:05.604 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.598+0000 7f34c04a8640 1 -- 172.21.15.62:0/3974947423 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34a8009560 con 0x7f34b80b9e60 2023-10-08T12:01:05.604 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.598+0000 7f34aeffd640 1 -- 172.21.15.62:0/3974947423 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a80b0a40 con 0x7f34b80b9e60 2023-10-08T12:01:05.605 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.598+0000 7f34c04a8640 1 -- 172.21.15.62:0/3974947423 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34b8098a60 con 0x7f34b80b9e60 2023-10-08T12:01:05.605 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.598+0000 7f34c04a8640 1 -- 172.21.15.62:0/3974947423 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34b806f610 con 0x7f34b80b9e60 2023-10-08T12:01:05.605 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.598+0000 7f34aeffd640 1 -- 172.21.15.62:0/3974947423 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f34a80b7040 con 0x7f34b80b9e60 2023-10-08T12:01:05.606 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.598+0000 7f34aeffd640 1 --2- 172.21.15.62:0/3974947423 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f349c0664a0 0x7f349c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:01:05.606 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.598+0000 7f34aeffd640 1 -- 172.21.15.62:0/3974947423 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f34a81214d0 con 0x7f34b80b9e60 2023-10-08T12:01:05.606 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.598+0000 7f34be244640 1 --2- 172.21.15.62:0/3974947423 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f349c0664a0 0x7f349c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:01:05.607 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.598+0000 7f34be244640 1 --2- 172.21.15.62:0/3974947423 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f349c0664a0 0x7f349c068960 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f34b400e500 tx=0x7f34b400a610 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:01:05.607 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.602+0000 7f34aeffd640 1 -- 172.21.15.62:0/3974947423 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f34a80ee9e0 con 0x7f34b80b9e60 2023-10-08T12:01:05.798 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.798+0000 7f34c04a8640 1 -- 172.21.15.62:0/3974947423 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f34b804da80 con 0x7f34b80b9e60 2023-10-08T12:01:05.798 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.798+0000 7f34aeffd640 1 -- 172.21.15.62:0/3974947423 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7f34a80f2000 con 0x7f34b80b9e60 2023-10-08T12:01:05.799 INFO:teuthology.orchestra.run.smithi062.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T12:01:05.801 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.798+0000 7f34c04a8640 1 -- 172.21.15.62:0/3974947423 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f349c0664a0 msgr2=0x7f349c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:01:05.801 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.798+0000 7f34c04a8640 1 --2- 172.21.15.62:0/3974947423 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f349c0664a0 0x7f349c068960 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f34b400e500 tx=0x7f34b400a610 comp rx=0 tx=0).stop 2023-10-08T12:01:05.801 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.798+0000 7f34c04a8640 1 -- 172.21.15.62:0/3974947423 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f34b80b9e60 msgr2=0x7f34b809f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:01:05.801 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.798+0000 7f34c04a8640 1 --2- 172.21.15.62:0/3974947423 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f34b80b9e60 0x7f34b809f400 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f34a8009850 tx=0x7f34a80b04c0 comp rx=0 tx=0).stop 2023-10-08T12:01:05.801 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.798+0000 7f34c04a8640 1 -- 172.21.15.62:0/3974947423 shutdown_connections 2023-10-08T12:01:05.801 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.798+0000 7f34c04a8640 1 --2- 172.21.15.62:0/3974947423 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f349c0664a0 0x7f349c068960 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:05.801 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.798+0000 7f34c04a8640 1 --2- 172.21.15.62:0/3974947423 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f34b80ba240 0x7f34b81e2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:05.801 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.798+0000 7f34c04a8640 1 --2- 172.21.15.62:0/3974947423 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f34b80b9e60 0x7f34b809f400 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:05.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.798+0000 7f34c04a8640 1 --2- 172.21.15.62:0/3974947423 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f34b80b09e0 0x7f34b81d2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:05.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.798+0000 7f34c04a8640 1 -- 172.21.15.62:0/3974947423 >> 172.21.15.62:0/3974947423 conn(0x7f34b809c520 msgr2=0x7f34b8098350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:01:05.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.798+0000 7f34c04a8640 1 -- 172.21.15.62:0/3974947423 shutdown_connections 2023-10-08T12:01:05.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:05.798+0000 7f34c04a8640 1 -- 172.21.15.62:0/3974947423 wait complete. 2023-10-08T12:01:05.816 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-08T12:01:05.816 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T12:01:05.816 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi156.front.sepia.ceph.com 2023-10-08T12:01:05.816 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-08T12:01:05.816 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-08T12:01:05.816 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-08T12:01:05.817 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-08T12:01:05.817 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T12:01:05.817 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T12:01:05.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:01:05.817 DEBUG:teuthology.orchestra.run.smithi156:> ip addr 2023-10-08T12:01:05.828 INFO:teuthology.orchestra.run.smithi156.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T12:01:05.828 INFO:teuthology.orchestra.run.smithi156.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T12:01:05.828 INFO:teuthology.orchestra.run.smithi156.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T12:01:05.829 INFO:teuthology.orchestra.run.smithi156.stdout: valid_lft forever preferred_lft forever 2023-10-08T12:01:05.829 INFO:teuthology.orchestra.run.smithi156.stdout: inet6 ::1/128 scope host 2023-10-08T12:01:05.829 INFO:teuthology.orchestra.run.smithi156.stdout: valid_lft forever preferred_lft forever 2023-10-08T12:01:05.829 INFO:teuthology.orchestra.run.smithi156.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-08T12:01:05.829 INFO:teuthology.orchestra.run.smithi156.stdout: link/ether 0c:c4:7a:da:6a:c0 brd ff:ff:ff:ff:ff:ff 2023-10-08T12:01:05.829 INFO:teuthology.orchestra.run.smithi156.stdout: altname enp7s0f0 2023-10-08T12:01:05.829 INFO:teuthology.orchestra.run.smithi156.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-08T12:01:05.829 INFO:teuthology.orchestra.run.smithi156.stdout: link/ether 0c:c4:7a:da:6a:c1 brd ff:ff:ff:ff:ff:ff 2023-10-08T12:01:05.829 INFO:teuthology.orchestra.run.smithi156.stdout: altname enp7s0f1 2023-10-08T12:01:05.829 INFO:teuthology.orchestra.run.smithi156.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-08T12:01:05.829 INFO:teuthology.orchestra.run.smithi156.stdout: link/ether 0c:c4:7a:88:6d:fc brd ff:ff:ff:ff:ff:ff 2023-10-08T12:01:05.830 INFO:teuthology.orchestra.run.smithi156.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T12:01:05.830 INFO:teuthology.orchestra.run.smithi156.stdout: link/ether 0c:c4:7a:88:6d:fd brd ff:ff:ff:ff:ff:ff 2023-10-08T12:01:05.830 INFO:teuthology.orchestra.run.smithi156.stdout: inet 172.21.15.156/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-10-08T12:01:05.830 INFO:teuthology.orchestra.run.smithi156.stdout: valid_lft 42402sec preferred_lft 42402sec 2023-10-08T12:01:05.830 INFO:teuthology.orchestra.run.smithi156.stdout: inet6 fe80::ec4:7aff:fe88:6dfd/64 scope link 2023-10-08T12:01:05.830 INFO:teuthology.orchestra.run.smithi156.stdout: valid_lft forever preferred_lft forever 2023-10-08T12:01:05.830 INFO:teuthology.orchestra.run.smithi156.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-08T12:01:05.830 INFO:teuthology.orchestra.run.smithi156.stdout: link/ether 02:42:50:b6:93:f5 brd ff:ff:ff:ff:ff:ff 2023-10-08T12:01:05.830 INFO:teuthology.orchestra.run.smithi156.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-08T12:01:05.831 INFO:teuthology.orchestra.run.smithi156.stdout: valid_lft forever preferred_lft forever 2023-10-08T12:01:05.831 INFO:teuthology.orchestra.run.smithi156.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T12:01:05.831 INFO:teuthology.orchestra.run.smithi156.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-10-08T12:01:05.831 INFO:teuthology.orchestra.run.smithi156.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T12:01:05.831 INFO:teuthology.orchestra.run.smithi156.stdout: valid_lft forever preferred_lft forever 2023-10-08T12:01:05.831 INFO:teuthology.orchestra.run.smithi156.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-10-08T12:01:05.831 INFO:teuthology.orchestra.run.smithi156.stdout: valid_lft forever preferred_lft forever 2023-10-08T12:01:05.832 INFO:teuthology.orchestra.run.smithi156.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T12:01:05.832 INFO:teuthology.orchestra.run.smithi156.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T12:01:05.832 INFO:teuthology.orchestra.run.smithi156.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-10-08T12:01:05.832 INFO:teuthology.orchestra.run.smithi156.stdout: valid_lft forever preferred_lft forever 2023-10-08T12:01:05.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:01:05.832 DEBUG:teuthology.orchestra.run.smithi156:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T12:01:05.892 INFO:teuthology.orchestra.run.smithi156.stdout:1 2023-10-08T12:01:05.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:01:05.894 DEBUG:teuthology.orchestra.run.smithi156:> route 2023-10-08T12:01:05.951 INFO:teuthology.orchestra.run.smithi156.stdout:Kernel IP routing table 2023-10-08T12:01:05.951 INFO:teuthology.orchestra.run.smithi156.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T12:01:05.951 INFO:teuthology.orchestra.run.smithi156.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-10-08T12:01:05.951 INFO:teuthology.orchestra.run.smithi156.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-08T12:01:05.951 INFO:teuthology.orchestra.run.smithi156.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-08T12:01:05.951 INFO:teuthology.orchestra.run.smithi156.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-08T12:01:05.951 INFO:teuthology.orchestra.run.smithi156.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-08T12:01:05.952 INFO:teuthology.orchestra.run.smithi156.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-08T12:01:05.952 INFO:teuthology.orchestra.run.smithi156.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-08T12:01:05.952 INFO:teuthology.orchestra.run.smithi156.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T12:01:05.952 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:01:05.952 DEBUG:teuthology.orchestra.run.smithi156:> (cd / && exec bash -c ' 2023-10-08T12:01:05.952 DEBUG:teuthology.orchestra.run.smithi156:> set -e 2023-10-08T12:01:05.952 DEBUG:teuthology.orchestra.run.smithi156:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-08T12:01:05.952 DEBUG:teuthology.orchestra.run.smithi156:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-08T12:01:05.952 DEBUG:teuthology.orchestra.run.smithi156:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-08T12:01:05.953 DEBUG:teuthology.orchestra.run.smithi156:> ') 2023-10-08T12:01:06.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:01:06.052 DEBUG:teuthology.orchestra.run.smithi156:> ip netns list 2023-10-08T12:01:06.061 INFO:teuthology.orchestra.run.smithi156.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-08T12:01:06.062 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T12:01:06.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:01:06.062 DEBUG:teuthology.orchestra.run.smithi156:> sudo ip link set brx.0 up 2023-10-08T12:01:06.130 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T12:01:06.131 DEBUG:teuthology.orchestra.run.smithi156:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-08T12:01:06.184 INFO:teuthology.orchestra.run.smithi156.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-08T12:01:06.185 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T12:01:06.185 DEBUG:teuthology.orchestra.run.smithi156:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-08T12:01:06.239 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-08T12:01:06.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:01:06.240 DEBUG:teuthology.orchestra.run.smithi156:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T12:01:06.337 INFO:teuthology.orchestra.run.smithi156.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T12:01:06.337 INFO:teuthology.orchestra.run.smithi156.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T12:01:06.354 INFO:teuthology.orchestra.run.smithi156.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T12:01:06.354 INFO:teuthology.orchestra.run.smithi156.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T12:01:06.354 INFO:teuthology.orchestra.run.smithi156.stdout:mount.ceph: resolved to: "172.21.15.62:3300,172.21.15.130:3300,172.21.15.130:3301" 2023-10-08T12:01:06.355 INFO:teuthology.orchestra.run.smithi156.stdout:mount.ceph: trying mount with new device syntax: 0@3e777930-c2c1-4f2b-a903-c07ee4ca2c52.cephfs=/ 2023-10-08T12:01:06.355 INFO:teuthology.orchestra.run.smithi156.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.62:3300/172.21.15.130:3300/172.21.15.130:3301" will pass to kernel 2023-10-08T12:01:06.358 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T12:01:06.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:01:06.358 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-08T12:01:06.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:01:06.382 DEBUG:teuthology.orchestra.run.smithi156:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-08T12:01:06.457 INFO:teuthology.orchestra.run.smithi156.stdout:client5229 2023-10-08T12:01:06.458 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-10-08T12:01:06.458 DEBUG:teuthology.orchestra.run.smithi156:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-08T12:01:06.508 DEBUG:teuthology.orchestra.run.smithi156:> mktemp -d --suffix=xfstests-dev 2023-10-08T12:01:06.561 INFO:teuthology.orchestra.run.smithi156.stdout:/tmp/tmp.3RpD2mKkbxxfstests-dev 2023-10-08T12:01:06.561 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:01:06.561 DEBUG:teuthology.orchestra.run.smithi156:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.3RpD2mKkbxxfstests-dev) 2023-10-08T12:01:06.630 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:01:06.631 DEBUG:teuthology.orchestra.run.smithi156:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.3RpD2mKkbxxfstests-dev) 2023-10-08T12:01:06.693 INFO:teuthology.orchestra.run.smithi156.stderr:Cloning into '/tmp/tmp.3RpD2mKkbxxfstests-dev'... 2023-10-08T12:01:07.592 DEBUG:teuthology.orchestra.run.smithi156:> mktemp -d --suffix=xfsprogs-dev 2023-10-08T12:01:07.647 INFO:teuthology.orchestra.run.smithi156.stdout:/tmp/tmp.yqkYNsO2b0xfsprogs-dev 2023-10-08T12:01:07.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:01:07.648 DEBUG:teuthology.orchestra.run.smithi156:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.yqkYNsO2b0xfsprogs-dev) 2023-10-08T12:01:07.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:01:07.717 DEBUG:teuthology.orchestra.run.smithi156:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfsprogs-dev.git --depth 1 /tmp/tmp.yqkYNsO2b0xfsprogs-dev) 2023-10-08T12:01:07.779 INFO:teuthology.orchestra.run.smithi156.stderr:Cloning into '/tmp/tmp.yqkYNsO2b0xfsprogs-dev'... 2023-10-08T12:01:08.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:01:08.305 DEBUG:teuthology.orchestra.run.smithi156:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2023-10-08T12:01:08.365 DEBUG:teuthology.orchestra.run.smithi156:> mktemp -d --suffix=test 2023-10-08T12:01:08.419 INFO:teuthology.orchestra.run.smithi156.stdout:/tmp/tmp.ZQPbrv5NcXtest 2023-10-08T12:01:08.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:01:08.420 DEBUG:teuthology.orchestra.run.smithi156:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2023-10-08T12:01:08.480 DEBUG:teuthology.orchestra.run.smithi156:> mktemp -d --suffix=scratch 2023-10-08T12:01:08.531 INFO:teuthology.orchestra.run.smithi156.stdout:/tmp/tmp.9EPeO8cn4xscratch 2023-10-08T12:01:08.531 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "ubuntu" and "22.04". 2023-10-08T12:01:08.532 DEBUG:teuthology.orchestra.run.smithi156:> sudo apt-get install -y xfslibs-dev uuid-dev libtool-bin e2fsprogs automake gcc libuuid1 quota attr libattr1-dev make libacl1-dev libaio-dev xfsprogs libgdbm-dev gawk fio dbench uuid-runtime python2 sqlite3 libinih-dev liburcu-dev libblkid-dev gettext libedit-dev libattr1-dev libdevmapper-dev libicu-dev pkg-config 2023-10-08T12:01:08.654 INFO:teuthology.orchestra.run.smithi156.stdout:Reading package lists... 2023-10-08T12:01:08.819 INFO:teuthology.orchestra.run.smithi156.stdout:Building dependency tree... 2023-10-08T12:01:08.819 INFO:teuthology.orchestra.run.smithi156.stdout:Reading state information... 2023-10-08T12:01:08.966 INFO:teuthology.orchestra.run.smithi156.stdout:attr is already the newest version (1:2.5.1-1build1). 2023-10-08T12:01:08.966 INFO:teuthology.orchestra.run.smithi156.stdout:automake is already the newest version (1:1.16.5-1.3). 2023-10-08T12:01:08.966 INFO:teuthology.orchestra.run.smithi156.stdout:gcc is already the newest version (4:11.2.0-1ubuntu1). 2023-10-08T12:01:08.966 INFO:teuthology.orchestra.run.smithi156.stdout:gcc set to manually installed. 2023-10-08T12:01:08.967 INFO:teuthology.orchestra.run.smithi156.stdout:gettext is already the newest version (0.21-4ubuntu4). 2023-10-08T12:01:08.967 INFO:teuthology.orchestra.run.smithi156.stdout:libacl1-dev is already the newest version (2.3.1-1). 2023-10-08T12:01:08.967 INFO:teuthology.orchestra.run.smithi156.stdout:libaio-dev is already the newest version (0.3.112-13build1). 2023-10-08T12:01:08.967 INFO:teuthology.orchestra.run.smithi156.stdout:libattr1-dev is already the newest version (1:2.5.1-1build1). 2023-10-08T12:01:08.967 INFO:teuthology.orchestra.run.smithi156.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-10-08T12:01:08.967 INFO:teuthology.orchestra.run.smithi156.stdout:libuuid1 is already the newest version (2.37.2-4ubuntu3). 2023-10-08T12:01:08.967 INFO:teuthology.orchestra.run.smithi156.stdout:make is already the newest version (4.3-4.1build1). 2023-10-08T12:01:08.967 INFO:teuthology.orchestra.run.smithi156.stdout:make set to manually installed. 2023-10-08T12:01:08.967 INFO:teuthology.orchestra.run.smithi156.stdout:quota is already the newest version (4.06-1build2). 2023-10-08T12:01:08.967 INFO:teuthology.orchestra.run.smithi156.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-10-08T12:01:08.968 INFO:teuthology.orchestra.run.smithi156.stdout:uuid-runtime is already the newest version (2.37.2-4ubuntu3). 2023-10-08T12:01:08.968 INFO:teuthology.orchestra.run.smithi156.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-10-08T12:01:08.968 INFO:teuthology.orchestra.run.smithi156.stdout:xfsprogs is already the newest version (5.13.0-1ubuntu2). 2023-10-08T12:01:08.968 INFO:teuthology.orchestra.run.smithi156.stdout:dbench is already the newest version (4.0-2build1). 2023-10-08T12:01:08.968 INFO:teuthology.orchestra.run.smithi156.stdout:python2 is already the newest version (2.7.18-3). 2023-10-08T12:01:08.968 INFO:teuthology.orchestra.run.smithi156.stdout:python2 set to manually installed. 2023-10-08T12:01:08.968 INFO:teuthology.orchestra.run.smithi156.stdout:e2fsprogs is already the newest version (1.46.5-2ubuntu1.1). 2023-10-08T12:01:08.968 INFO:teuthology.orchestra.run.smithi156.stdout:The following packages were automatically installed and are no longer required: 2023-10-08T12:01:08.968 INFO:teuthology.orchestra.run.smithi156.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libiscsi7 libpmemobj1 2023-10-08T12:01:08.968 INFO:teuthology.orchestra.run.smithi156.stdout: libpython2-dev libpython2.7 libpython2.7-dev linux-image-5.4.0-135-generic 2023-10-08T12:01:08.969 INFO:teuthology.orchestra.run.smithi156.stdout: linux-modules-5.4.0-135-generic python2-dev python2.7-dev 2023-10-08T12:01:08.969 INFO:teuthology.orchestra.run.smithi156.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-08T12:01:08.969 INFO:teuthology.orchestra.run.smithi156.stdout:Suggested packages: 2023-10-08T12:01:08.969 INFO:teuthology.orchestra.run.smithi156.stdout: gnuplot gfio python-scipy gawk-doc icu-doc sqlite3-doc systemd-container 2023-10-08T12:01:08.969 INFO:teuthology.orchestra.run.smithi156.stdout: libtss2-esys-3.0.2-0 libtss2-mu0 libtss2-rc0 2023-10-08T12:01:09.012 INFO:teuthology.orchestra.run.smithi156.stdout:The following NEW packages will be installed: 2023-10-08T12:01:09.013 INFO:teuthology.orchestra.run.smithi156.stdout: fio icu-devtools libblkid-dev libbsd-dev libdevmapper-dev libedit-dev 2023-10-08T12:01:09.013 INFO:teuthology.orchestra.run.smithi156.stdout: libgdbm-dev libicu-dev libinih-dev libinireader0 libmd-dev libpcre2-32-0 2023-10-08T12:01:09.013 INFO:teuthology.orchestra.run.smithi156.stdout: libpcre2-dev libpcre2-posix3 libpmemblk1 libselinux1-dev libsepol-dev 2023-10-08T12:01:09.013 INFO:teuthology.orchestra.run.smithi156.stdout: libudev-dev liburcu-dev pkg-config sqlite3 2023-10-08T12:01:09.013 INFO:teuthology.orchestra.run.smithi156.stdout:The following packages will be upgraded: 2023-10-08T12:01:09.014 INFO:teuthology.orchestra.run.smithi156.stdout: gawk libnss-systemd libpam-systemd libsystemd0 libudev1 systemd systemd-sysv 2023-10-08T12:01:09.014 INFO:teuthology.orchestra.run.smithi156.stdout: udev 2023-10-08T12:01:09.097 INFO:teuthology.orchestra.run.smithi156.stdout:8 upgraded, 21 newly installed, 0 to remove and 248 not upgraded. 2023-10-08T12:01:09.098 INFO:teuthology.orchestra.run.smithi156.stdout:Need to get 26.4 MB of archives. 2023-10-08T12:01:09.098 INFO:teuthology.orchestra.run.smithi156.stdout:After this operation, 67.5 MB of additional disk space will be used. 2023-10-08T12:01:09.098 INFO:teuthology.orchestra.run.smithi156.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libsystemd0 amd64 249.11-0ubuntu3.10 [319 kB] 2023-10-08T12:01:09.197 INFO:teuthology.orchestra.run.smithi156.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 systemd-sysv amd64 249.11-0ubuntu3.10 [10.5 kB] 2023-10-08T12:01:09.197 INFO:teuthology.orchestra.run.smithi156.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnss-systemd amd64 249.11-0ubuntu3.10 [133 kB] 2023-10-08T12:01:09.203 INFO:teuthology.orchestra.run.smithi156.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpam-systemd amd64 249.11-0ubuntu3.10 [203 kB] 2023-10-08T12:01:09.214 INFO:teuthology.orchestra.run.smithi156.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 systemd amd64 249.11-0ubuntu3.10 [4,581 kB] 2023-10-08T12:01:09.282 INFO:teuthology.orchestra.run.smithi156.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 udev amd64 249.11-0ubuntu3.10 [1,557 kB] 2023-10-08T12:01:09.298 INFO:teuthology.orchestra.run.smithi156.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libudev1 amd64 249.11-0ubuntu3.10 [78.0 kB] 2023-10-08T12:01:09.299 INFO:teuthology.orchestra.run.smithi156.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 gawk amd64 1:5.1.0-1ubuntu0.1 [447 kB] 2023-10-08T12:01:09.304 INFO:teuthology.orchestra.run.smithi156.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libpmemblk1 amd64 1.11.1-3build1 [65.6 kB] 2023-10-08T12:01:09.305 INFO:teuthology.orchestra.run.smithi156.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 fio amd64 3.28-1 [4,047 kB] 2023-10-08T12:01:09.346 INFO:teuthology.orchestra.run.smithi156.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 icu-devtools amd64 70.1-2 [197 kB] 2023-10-08T12:01:09.348 INFO:teuthology.orchestra.run.smithi156.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libmd-dev amd64 1.0.4-1build1 [40.0 kB] 2023-10-08T12:01:09.348 INFO:teuthology.orchestra.run.smithi156.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbsd-dev amd64 0.11.5-1 [168 kB] 2023-10-08T12:01:09.350 INFO:teuthology.orchestra.run.smithi156.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libudev-dev amd64 249.11-0ubuntu3.10 [20.7 kB] 2023-10-08T12:01:09.351 INFO:teuthology.orchestra.run.smithi156.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libsepol-dev amd64 3.3-1build1 [378 kB] 2023-10-08T12:01:09.355 INFO:teuthology.orchestra.run.smithi156.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-32-0 amd64 10.39-3ubuntu0.1 [194 kB] 2023-10-08T12:01:09.357 INFO:teuthology.orchestra.run.smithi156.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-posix3 amd64 10.39-3ubuntu0.1 [6,130 B] 2023-10-08T12:01:09.357 INFO:teuthology.orchestra.run.smithi156.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-dev amd64 10.39-3ubuntu0.1 [730 kB] 2023-10-08T12:01:09.364 INFO:teuthology.orchestra.run.smithi156.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 libselinux1-dev amd64 3.3-1build2 [158 kB] 2023-10-08T12:01:09.367 INFO:teuthology.orchestra.run.smithi156.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libdevmapper-dev amd64 2:1.02.175-2.1ubuntu4 [36.6 kB] 2023-10-08T12:01:09.384 INFO:teuthology.orchestra.run.smithi156.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 libedit-dev amd64 3.1-20210910-1build1 [118 kB] 2023-10-08T12:01:09.386 INFO:teuthology.orchestra.run.smithi156.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 libgdbm-dev amd64 1.23-1 [117 kB] 2023-10-08T12:01:09.388 INFO:teuthology.orchestra.run.smithi156.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libicu-dev amd64 70.1-2 [11.6 MB] 2023-10-08T12:01:09.501 INFO:teuthology.orchestra.run.smithi156.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 libinireader0 amd64 53-1ubuntu3 [9,636 B] 2023-10-08T12:01:09.501 INFO:teuthology.orchestra.run.smithi156.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 libinih-dev amd64 53-1ubuntu3 [20.6 kB] 2023-10-08T12:01:09.501 INFO:teuthology.orchestra.run.smithi156.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2023-10-08T12:01:09.502 INFO:teuthology.orchestra.run.smithi156.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 sqlite3 amd64 3.37.2-2ubuntu0.1 [768 kB] 2023-10-08T12:01:09.509 INFO:teuthology.orchestra.run.smithi156.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 libblkid-dev amd64 2.37.2-4ubuntu3 [185 kB] 2023-10-08T12:01:09.511 INFO:teuthology.orchestra.run.smithi156.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 liburcu-dev amd64 0.13.1-1 [125 kB] 2023-10-08T12:01:09.768 INFO:teuthology.orchestra.run.smithi156.stderr:debconf: unable to initialize frontend: Dialog 2023-10-08T12:01:09.769 INFO:teuthology.orchestra.run.smithi156.stderr:debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.) 2023-10-08T12:01:09.769 INFO:teuthology.orchestra.run.smithi156.stderr:debconf: falling back to frontend: Readline 2023-10-08T12:01:09.783 INFO:teuthology.orchestra.run.smithi156.stderr:debconf: unable to initialize frontend: Readline 2023-10-08T12:01:09.783 INFO:teuthology.orchestra.run.smithi156.stderr:debconf: (This frontend requires a controlling tty.) 2023-10-08T12:01:09.783 INFO:teuthology.orchestra.run.smithi156.stderr:debconf: falling back to frontend: Teletype 2023-10-08T12:01:09.790 INFO:teuthology.orchestra.run.smithi156.stderr:dpkg-preconfigure: unable to re-open stdin: 2023-10-08T12:01:09.833 INFO:teuthology.orchestra.run.smithi156.stdout:Fetched 26.4 MB in 0s (53.7 MB/s) 2023-10-08T12:01:10.089 INFO:teuthology.orchestra.run.smithi156.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 142656 files and directories currently installed.) 2023-10-08T12:01:10.093 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../libsystemd0_249.11-0ubuntu3.10_amd64.deb ... 2023-10-08T12:01:10.285 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libsystemd0:amd64 (249.11-0ubuntu3.10) over (249.11-0ubuntu3.6) ... 2023-10-08T12:01:10.617 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libsystemd0:amd64 (249.11-0ubuntu3.10) ... 2023-10-08T12:01:11.013 INFO:teuthology.orchestra.run.smithi156.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 142656 files and directories currently installed.) 2023-10-08T12:01:11.017 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../0-systemd-sysv_249.11-0ubuntu3.10_amd64.deb ... 2023-10-08T12:01:11.162 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking systemd-sysv (249.11-0ubuntu3.10) over (249.11-0ubuntu3.6) ... 2023-10-08T12:01:11.623 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../1-libnss-systemd_249.11-0ubuntu3.10_amd64.deb ... 2023-10-08T12:01:11.759 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libnss-systemd:amd64 (249.11-0ubuntu3.10) over (249.11-0ubuntu3.6) ... 2023-10-08T12:01:12.112 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../2-libpam-systemd_249.11-0ubuntu3.10_amd64.deb ... 2023-10-08T12:01:12.214 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libpam-systemd:amd64 (249.11-0ubuntu3.10) over (249.11-0ubuntu3.6) ... 2023-10-08T12:01:12.674 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../3-systemd_249.11-0ubuntu3.10_amd64.deb ... 2023-10-08T12:01:12.887 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking systemd (249.11-0ubuntu3.10) over (249.11-0ubuntu3.6) ... 2023-10-08T12:01:13.897 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../4-udev_249.11-0ubuntu3.10_amd64.deb ... 2023-10-08T12:01:14.058 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking udev (249.11-0ubuntu3.10) over (249.11-0ubuntu3.6) ... 2023-10-08T12:01:14.624 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../5-libudev1_249.11-0ubuntu3.10_amd64.deb ... 2023-10-08T12:01:14.769 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libudev1:amd64 (249.11-0ubuntu3.10) over (249.11-0ubuntu3.6) ... 2023-10-08T12:01:15.101 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libudev1:amd64 (249.11-0ubuntu3.10) ... 2023-10-08T12:01:15.567 INFO:teuthology.orchestra.run.smithi156.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 142656 files and directories currently installed.) 2023-10-08T12:01:15.571 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../00-gawk_1%3a5.1.0-1ubuntu0.1_amd64.deb ... 2023-10-08T12:01:15.735 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking gawk (1:5.1.0-1ubuntu0.1) over (1:5.1.0-1build3) ... 2023-10-08T12:01:16.220 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libpmemblk1:amd64. 2023-10-08T12:01:16.236 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../01-libpmemblk1_1.11.1-3build1_amd64.deb ... 2023-10-08T12:01:16.279 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libpmemblk1:amd64 (1.11.1-3build1) ... 2023-10-08T12:01:16.598 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package fio. 2023-10-08T12:01:16.614 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../02-fio_3.28-1_amd64.deb ... 2023-10-08T12:01:16.690 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking fio (3.28-1) ... 2023-10-08T12:01:17.078 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package icu-devtools. 2023-10-08T12:01:17.092 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../03-icu-devtools_70.1-2_amd64.deb ... 2023-10-08T12:01:17.136 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking icu-devtools (70.1-2) ... 2023-10-08T12:01:17.416 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libmd-dev:amd64. 2023-10-08T12:01:17.430 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../04-libmd-dev_1.0.4-1build1_amd64.deb ... 2023-10-08T12:01:17.474 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libmd-dev:amd64 (1.0.4-1build1) ... 2023-10-08T12:01:17.738 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libbsd-dev:amd64. 2023-10-08T12:01:17.753 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../05-libbsd-dev_0.11.5-1_amd64.deb ... 2023-10-08T12:01:17.799 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libbsd-dev:amd64 (0.11.5-1) ... 2023-10-08T12:01:18.130 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libudev-dev:amd64. 2023-10-08T12:01:18.145 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../06-libudev-dev_249.11-0ubuntu3.10_amd64.deb ... 2023-10-08T12:01:18.180 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libudev-dev:amd64 (249.11-0ubuntu3.10) ... 2023-10-08T12:01:18.435 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libsepol-dev:amd64. 2023-10-08T12:01:18.451 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../07-libsepol-dev_3.3-1build1_amd64.deb ... 2023-10-08T12:01:18.494 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libsepol-dev:amd64 (3.3-1build1) ... 2023-10-08T12:01:18.574 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:01:18.577 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:01:18.579 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:01:18.856 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libpcre2-32-0:amd64. 2023-10-08T12:01:18.871 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../08-libpcre2-32-0_10.39-3ubuntu0.1_amd64.deb ... 2023-10-08T12:01:18.906 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libpcre2-32-0:amd64 (10.39-3ubuntu0.1) ... 2023-10-08T12:01:19.267 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libpcre2-posix3:amd64. 2023-10-08T12:01:19.283 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../09-libpcre2-posix3_10.39-3ubuntu0.1_amd64.deb ... 2023-10-08T12:01:19.326 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libpcre2-posix3:amd64 (10.39-3ubuntu0.1) ... 2023-10-08T12:01:19.578 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libpcre2-dev:amd64. 2023-10-08T12:01:19.594 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../10-libpcre2-dev_10.39-3ubuntu0.1_amd64.deb ... 2023-10-08T12:01:19.637 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libpcre2-dev:amd64 (10.39-3ubuntu0.1) ... 2023-10-08T12:01:19.960 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libselinux1-dev:amd64. 2023-10-08T12:01:19.974 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../11-libselinux1-dev_3.3-1build2_amd64.deb ... 2023-10-08T12:01:20.018 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libselinux1-dev:amd64 (3.3-1build2) ... 2023-10-08T12:01:20.324 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libdevmapper-dev:amd64. 2023-10-08T12:01:20.339 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../12-libdevmapper-dev_2%3a1.02.175-2.1ubuntu4_amd64.deb ... 2023-10-08T12:01:20.383 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libdevmapper-dev:amd64 (2:1.02.175-2.1ubuntu4) ... 2023-10-08T12:01:20.635 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libedit-dev:amd64. 2023-10-08T12:01:20.650 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../13-libedit-dev_3.1-20210910-1build1_amd64.deb ... 2023-10-08T12:01:20.685 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libedit-dev:amd64 (3.1-20210910-1build1) ... 2023-10-08T12:01:20.940 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libgdbm-dev:amd64. 2023-10-08T12:01:20.957 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../14-libgdbm-dev_1.23-1_amd64.deb ... 2023-10-08T12:01:20.998 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libgdbm-dev:amd64 (1.23-1) ... 2023-10-08T12:01:21.419 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libicu-dev:amd64. 2023-10-08T12:01:21.434 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../15-libicu-dev_70.1-2_amd64.deb ... 2023-10-08T12:01:21.477 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libicu-dev:amd64 (70.1-2) ... 2023-10-08T12:01:22.697 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libinireader0:amd64. 2023-10-08T12:01:22.713 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../16-libinireader0_53-1ubuntu3_amd64.deb ... 2023-10-08T12:01:22.756 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libinireader0:amd64 (53-1ubuntu3) ... 2023-10-08T12:01:22.984 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libinih-dev:amd64. 2023-10-08T12:01:22.999 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../17-libinih-dev_53-1ubuntu3_amd64.deb ... 2023-10-08T12:01:23.033 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libinih-dev:amd64 (53-1ubuntu3) ... 2023-10-08T12:01:23.378 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package pkg-config. 2023-10-08T12:01:23.394 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../18-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2023-10-08T12:01:23.436 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2023-10-08T12:01:23.690 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package sqlite3. 2023-10-08T12:01:23.705 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../19-sqlite3_3.37.2-2ubuntu0.1_amd64.deb ... 2023-10-08T12:01:23.748 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking sqlite3 (3.37.2-2ubuntu0.1) ... 2023-10-08T12:01:24.009 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libblkid-dev:amd64. 2023-10-08T12:01:24.025 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../20-libblkid-dev_2.37.2-4ubuntu3_amd64.deb ... 2023-10-08T12:01:24.059 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libblkid-dev:amd64 (2.37.2-4ubuntu3) ... 2023-10-08T12:01:24.328 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package liburcu-dev:amd64. 2023-10-08T12:01:24.344 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../21-liburcu-dev_0.13.1-1_amd64.deb ... 2023-10-08T12:01:24.386 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking liburcu-dev:amd64 (0.13.1-1) ... 2023-10-08T12:01:24.769 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up liburcu-dev:amd64 (0.13.1-1) ... 2023-10-08T12:01:24.893 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libblkid-dev:amd64 (2.37.2-4ubuntu3) ... 2023-10-08T12:01:25.019 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libinireader0:amd64 (53-1ubuntu3) ... 2023-10-08T12:01:25.137 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up gawk (1:5.1.0-1ubuntu0.1) ... 2023-10-08T12:01:25.339 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up systemd (249.11-0ubuntu3.10) ... 2023-10-08T12:01:26.855 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libpcre2-32-0:amd64 (10.39-3ubuntu0.1) ... 2023-10-08T12:01:27.006 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up udev (249.11-0ubuntu3.10) ... 2023-10-08T12:01:28.492 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up icu-devtools (70.1-2) ... 2023-10-08T12:01:28.618 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2023-10-08T12:01:28.861 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libudev-dev:amd64 (249.11-0ubuntu3.10) ... 2023-10-08T12:01:28.963 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libsepol-dev:amd64 (3.3-1build1) ... 2023-10-08T12:01:29.063 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libpmemblk1:amd64 (1.11.1-3build1) ... 2023-10-08T12:01:29.181 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libinih-dev:amd64 (53-1ubuntu3) ... 2023-10-08T12:01:29.307 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libpcre2-posix3:amd64 (10.39-3ubuntu0.1) ... 2023-10-08T12:01:29.442 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libmd-dev:amd64 (1.0.4-1build1) ... 2023-10-08T12:01:29.601 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libgdbm-dev:amd64 (1.23-1) ... 2023-10-08T12:01:29.727 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libicu-dev:amd64 (70.1-2) ... 2023-10-08T12:01:29.853 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libbsd-dev:amd64 (0.11.5-1) ... 2023-10-08T12:01:29.971 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up sqlite3 (3.37.2-2ubuntu0.1) ... 2023-10-08T12:01:30.072 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up systemd-sysv (249.11-0ubuntu3.10) ... 2023-10-08T12:01:30.181 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libpcre2-dev:amd64 (10.39-3ubuntu0.1) ... 2023-10-08T12:01:30.307 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libselinux1-dev:amd64 (3.3-1build2) ... 2023-10-08T12:01:30.434 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libnss-systemd:amd64 (249.11-0ubuntu3.10) ... 2023-10-08T12:01:30.559 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up fio (3.28-1) ... 2023-10-08T12:01:31.119 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libedit-dev:amd64 (3.1-20210910-1build1) ... 2023-10-08T12:01:31.245 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libdevmapper-dev:amd64 (2:1.02.175-2.1ubuntu4) ... 2023-10-08T12:01:31.371 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libpam-systemd:amd64 (249.11-0ubuntu3.10) ... 2023-10-08T12:01:31.576 INFO:teuthology.orchestra.run.smithi156.stdout:debconf: unable to initialize frontend: Dialog 2023-10-08T12:01:31.576 INFO:teuthology.orchestra.run.smithi156.stdout:debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.) 2023-10-08T12:01:31.577 INFO:teuthology.orchestra.run.smithi156.stdout:debconf: falling back to frontend: Readline 2023-10-08T12:01:31.874 INFO:teuthology.orchestra.run.smithi156.stdout:Processing triggers for initramfs-tools (0.140ubuntu13.1) ... 2023-10-08T12:01:31.961 INFO:teuthology.orchestra.run.smithi156.stdout:update-initramfs: Generating /boot/initrd.img-6.5.0-rc7-gfef64f93da2b 2023-10-08T12:01:45.838 INFO:teuthology.orchestra.run.smithi156.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-10-08T12:01:45.990 INFO:teuthology.orchestra.run.smithi156.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-10-08T12:01:47.426 INFO:teuthology.orchestra.run.smithi156.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-10-08T12:01:47.518 INFO:teuthology.orchestra.run.smithi156.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-10-08T12:01:48.124 DEBUG:teuthology.orchestra.run.smithi156:> sudo useradd -m fsgqa 2023-10-08T12:01:48.144 INFO:teuthology.orchestra.run.smithi156.stderr:useradd: user 'fsgqa' already exists 2023-10-08T12:01:48.146 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-10-08T12:01:48.146 DEBUG:teuthology.orchestra.run.smithi156:> sudo groupadd fsgqa 2023-10-08T12:01:48.210 INFO:teuthology.orchestra.run.smithi156.stderr:groupadd: group 'fsgqa' already exists 2023-10-08T12:01:48.211 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-10-08T12:01:48.212 DEBUG:teuthology.orchestra.run.smithi156:> sudo useradd fsgqa2 2023-10-08T12:01:48.640 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:01:48.642 DEBUG:teuthology.orchestra.run.smithi156:> sudo useradd 123456-fsgqa 2023-10-08T12:01:48.643 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:01:48.645 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:01:49.030 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-10-08T12:01:49.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.165+0000 7fdc57d7f640 1 -- 172.21.15.62:0/1841775191 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc50069790 msgr2=0x7fdc50153930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:01:49.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.165+0000 7fdc57d7f640 1 --2- 172.21.15.62:0/1841775191 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc50069790 0x7fdc50153930 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fdc48009900 tx=0x7fdc4801c720 comp rx=0 tx=0).stop 2023-10-08T12:01:49.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.165+0000 7fdc57d7f640 1 -- 172.21.15.62:0/1841775191 shutdown_connections 2023-10-08T12:01:49.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.165+0000 7fdc57d7f640 1 --2- 172.21.15.62:0/1841775191 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc50069790 0x7fdc50153930 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:49.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.165+0000 7fdc57d7f640 1 --2- 172.21.15.62:0/1841775191 >> v2:172.21.15.130:3300/0 conn(0x7fdc5006a520 0x7fdc50149be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:49.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.165+0000 7fdc57d7f640 1 -- 172.21.15.62:0/1841775191 >> 172.21.15.62:0/1841775191 conn(0x7fdc500a0540 msgr2=0x7fdc500a0950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:01:49.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.165+0000 7fdc57d7f640 1 -- 172.21.15.62:0/1841775191 shutdown_connections 2023-10-08T12:01:49.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.165+0000 7fdc57d7f640 1 -- 172.21.15.62:0/1841775191 wait complete. 2023-10-08T12:01:49.176 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.169+0000 7fdc57d7f640 1 Processor -- start 2023-10-08T12:01:49.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.169+0000 7fdc57d7f640 1 -- start start 2023-10-08T12:01:49.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.169+0000 7fdc57d7f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc50069790 0x7fdc50140880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:01:49.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.169+0000 7fdc57d7f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc5006a520 0x7fdc5013d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:01:49.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.169+0000 7fdc57d7f640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdc500bc670 0x7fdc500a34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:01:49.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.169+0000 7fdc57d7f640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc5013d5a0 con 0x7fdc5006a520 2023-10-08T12:01:49.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.169+0000 7fdc57d7f640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc500a39f0 con 0x7fdc50069790 2023-10-08T12:01:49.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.169+0000 7fdc57d7f640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc500a25d0 con 0x7fdc500bc670 2023-10-08T12:01:49.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.169+0000 7fdc5531a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc5006a520 0x7fdc5013d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:01:49.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.169+0000 7fdc5531a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc5006a520 0x7fdc5013d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:38380/0 (socket says 172.21.15.62:38380) 2023-10-08T12:01:49.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.169+0000 7fdc5531a640 1 -- 172.21.15.62:0/248395018 learned_addr learned my addr 172.21.15.62:0/248395018 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:01:49.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.169+0000 7fdc5631c640 1 --2- 172.21.15.62:0/248395018 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdc500bc670 0x7fdc500a34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:01:49.178 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.169+0000 7fdc55b1b640 1 --2- 172.21.15.62:0/248395018 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc50069790 0x7fdc50140880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:01:49.178 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.169+0000 7fdc5531a640 1 -- 172.21.15.62:0/248395018 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdc500bc670 msgr2=0x7fdc500a34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:01:49.178 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.169+0000 7fdc5531a640 1 --2- 172.21.15.62:0/248395018 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdc500bc670 0x7fdc500a34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:49.178 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.169+0000 7fdc5531a640 1 -- 172.21.15.62:0/248395018 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc50069790 msgr2=0x7fdc50140880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:01:49.178 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.169+0000 7fdc5531a640 1 --2- 172.21.15.62:0/248395018 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc50069790 0x7fdc50140880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:49.178 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.169+0000 7fdc5531a640 1 -- 172.21.15.62:0/248395018 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc48009560 con 0x7fdc5006a520 2023-10-08T12:01:49.178 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.169+0000 7fdc5631c640 1 --2- 172.21.15.62:0/248395018 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdc500bc670 0x7fdc500a34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:01:49.178 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.169+0000 7fdc5531a640 1 --2- 172.21.15.62:0/248395018 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc5006a520 0x7fdc5013d060 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fdc4400c440 tx=0x7fdc4400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:01:49.178 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.169+0000 7fdc4e7fc640 1 -- 172.21.15.62:0/248395018 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc44005480 con 0x7fdc5006a520 2023-10-08T12:01:49.178 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.169+0000 7fdc4e7fc640 1 -- 172.21.15.62:0/248395018 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fdc44003600 con 0x7fdc5006a520 2023-10-08T12:01:49.178 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.169+0000 7fdc57d7f640 1 -- 172.21.15.62:0/248395018 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc500bd9c0 con 0x7fdc5006a520 2023-10-08T12:01:49.179 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.169+0000 7fdc4e7fc640 1 -- 172.21.15.62:0/248395018 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc440039f0 con 0x7fdc5006a520 2023-10-08T12:01:49.179 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.169+0000 7fdc57d7f640 1 -- 172.21.15.62:0/248395018 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc500a2840 con 0x7fdc5006a520 2023-10-08T12:01:49.179 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.169+0000 7fdc57d7f640 1 -- 172.21.15.62:0/248395018 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc50066a30 con 0x7fdc5006a520 2023-10-08T12:01:49.179 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.173+0000 7fdc4e7fc640 1 -- 172.21.15.62:0/248395018 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fdc44003b50 con 0x7fdc5006a520 2023-10-08T12:01:49.179 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.173+0000 7fdc4e7fc640 1 --2- 172.21.15.62:0/248395018 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fdc3c066470 0x7fdc3c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:01:49.179 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.173+0000 7fdc4e7fc640 1 -- 172.21.15.62:0/248395018 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdc440834c0 con 0x7fdc5006a520 2023-10-08T12:01:49.179 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.173+0000 7fdc55b1b640 1 --2- 172.21.15.62:0/248395018 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fdc3c066470 0x7fdc3c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:01:49.179 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.173+0000 7fdc55b1b640 1 --2- 172.21.15.62:0/248395018 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fdc3c066470 0x7fdc3c068930 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fdc40005c50 tx=0x7fdc40008230 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:01:49.179 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.177+0000 7fdc4e7fc640 1 -- 172.21.15.62:0/248395018 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fdc44050a80 con 0x7fdc5006a520 2023-10-08T12:01:49.393 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.389+0000 7fdc57d7f640 1 -- 172.21.15.62:0/248395018 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fdc5009de80 con 0x7fdc5006a520 2023-10-08T12:01:49.394 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.389+0000 7fdc4e7fc640 1 -- 172.21.15.62:0/248395018 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1276 (secure 0 0 0) 0x7fdc44017090 con 0x7fdc5006a520 2023-10-08T12:01:49.394 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T12:01:49.394 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":1,"fsid":"3e777930-c2c1-4f2b-a903-c07ee4ca2c52","modified":"2023-10-08T11:59:19.870927Z","created":"2023-10-08T11:59:19.870927Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:3300","nonce":0},{"type":"v1","addr":"172.21.15.62:6789","nonce":0}]},"addr":"172.21.15.62:6789/0","public_addr":"172.21.15.62:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:3300","nonce":0},{"type":"v1","addr":"172.21.15.130:6789","nonce":0}]},"addr":"172.21.15.130:6789/0","public_addr":"172.21.15.130:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:3301","nonce":0},{"type":"v1","addr":"172.21.15.130:6790","nonce":0}]},"addr":"172.21.15.130:6790/0","public_addr":"172.21.15.130:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-10-08T12:01:49.394 INFO:teuthology.orchestra.run.smithi062.stderr:dumped monmap epoch 1 2023-10-08T12:01:49.396 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.393+0000 7fdc57d7f640 1 -- 172.21.15.62:0/248395018 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fdc3c066470 msgr2=0x7fdc3c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:01:49.396 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.393+0000 7fdc57d7f640 1 --2- 172.21.15.62:0/248395018 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fdc3c066470 0x7fdc3c068930 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fdc40005c50 tx=0x7fdc40008230 comp rx=0 tx=0).stop 2023-10-08T12:01:49.396 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.393+0000 7fdc57d7f640 1 -- 172.21.15.62:0/248395018 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc5006a520 msgr2=0x7fdc5013d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:01:49.396 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.393+0000 7fdc57d7f640 1 --2- 172.21.15.62:0/248395018 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc5006a520 0x7fdc5013d060 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fdc4400c440 tx=0x7fdc4400c900 comp rx=0 tx=0).stop 2023-10-08T12:01:49.396 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.393+0000 7fdc57d7f640 1 -- 172.21.15.62:0/248395018 shutdown_connections 2023-10-08T12:01:49.396 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.393+0000 7fdc57d7f640 1 --2- 172.21.15.62:0/248395018 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fdc3c066470 0x7fdc3c068930 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:49.396 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.393+0000 7fdc57d7f640 1 --2- 172.21.15.62:0/248395018 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdc500bc670 0x7fdc500a34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:49.396 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.393+0000 7fdc57d7f640 1 --2- 172.21.15.62:0/248395018 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc5006a520 0x7fdc5013d060 secure :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fdc4400c440 tx=0x7fdc4400c900 comp rx=0 tx=0).stop 2023-10-08T12:01:49.396 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.393+0000 7fdc57d7f640 1 --2- 172.21.15.62:0/248395018 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc50069790 0x7fdc50140880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:49.397 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.393+0000 7fdc57d7f640 1 -- 172.21.15.62:0/248395018 >> 172.21.15.62:0/248395018 conn(0x7fdc500a0540 msgr2=0x7fdc50146f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:01:49.397 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.393+0000 7fdc57d7f640 1 -- 172.21.15.62:0/248395018 shutdown_connections 2023-10-08T12:01:49.397 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.393+0000 7fdc57d7f640 1 -- 172.21.15.62:0/248395018 wait complete. 2023-10-08T12:01:49.411 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2023-10-08T12:01:49.540 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.537+0000 7f254a9c2640 1 -- 172.21.15.62:0/3677192472 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2544071410 msgr2=0x7f25440b6ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:01:49.540 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.537+0000 7f254a9c2640 1 --2- 172.21.15.62:0/3677192472 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2544071410 0x7f25440b6ad0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f2544073480 tx=0x7f253c01cd60 comp rx=0 tx=0).stop 2023-10-08T12:01:49.540 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.537+0000 7f254a9c2640 1 -- 172.21.15.62:0/3677192472 shutdown_connections 2023-10-08T12:01:49.540 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.537+0000 7f254a9c2640 1 --2- 172.21.15.62:0/3677192472 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2544071410 0x7f25440b6ad0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:49.540 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.537+0000 7f254a9c2640 1 --2- 172.21.15.62:0/3677192472 >> v2:172.21.15.130:3300/0 conn(0x7f25440b9260 0x7f25440b8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:49.540 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.537+0000 7f254a9c2640 1 -- 172.21.15.62:0/3677192472 >> 172.21.15.62:0/3677192472 conn(0x7f254409c520 msgr2=0x7f254409c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:01:49.540 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.537+0000 7f254a9c2640 1 -- 172.21.15.62:0/3677192472 shutdown_connections 2023-10-08T12:01:49.540 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.537+0000 7f254a9c2640 1 -- 172.21.15.62:0/3677192472 wait complete. 2023-10-08T12:01:49.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.537+0000 7f254a9c2640 1 Processor -- start 2023-10-08T12:01:49.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.537+0000 7f254a9c2640 1 -- start start 2023-10-08T12:01:49.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.537+0000 7f254a9c2640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2544071410 0x7f2544140500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:01:49.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.537+0000 7f254a9c2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f25440b9260 0x7f254413d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:01:49.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.537+0000 7f254a9c2640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2544147920 0x7f254413c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:01:49.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.537+0000 7f254a9c2640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2544145300 con 0x7f25440b9260 2023-10-08T12:01:49.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.537+0000 7f254a9c2640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2544140a40 con 0x7f2544071410 2023-10-08T12:01:49.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.537+0000 7f254a9c2640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2544146500 con 0x7f2544147920 2023-10-08T12:01:49.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.537+0000 7f25437fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f25440b9260 0x7f254413d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:01:49.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.537+0000 7f25437fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f25440b9260 0x7f254413d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:38398/0 (socket says 172.21.15.62:38398) 2023-10-08T12:01:49.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.537+0000 7f25437fe640 1 -- 172.21.15.62:0/1098323720 learned_addr learned my addr 172.21.15.62:0/1098323720 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:01:49.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.537+0000 7f2548f5f640 1 --2- 172.21.15.62:0/1098323720 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2544147920 0x7f254413c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:01:49.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.537+0000 7f2543fff640 1 --2- 172.21.15.62:0/1098323720 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2544071410 0x7f2544140500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:01:49.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.541+0000 7f25437fe640 1 -- 172.21.15.62:0/1098323720 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2544147920 msgr2=0x7f254413c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:01:49.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.541+0000 7f25437fe640 1 --2- 172.21.15.62:0/1098323720 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2544147920 0x7f254413c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:49.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.541+0000 7f25437fe640 1 -- 172.21.15.62:0/1098323720 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2544071410 msgr2=0x7f2544140500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:01:49.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.541+0000 7f25437fe640 1 --2- 172.21.15.62:0/1098323720 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2544071410 0x7f2544140500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:49.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.541+0000 7f25437fe640 1 -- 172.21.15.62:0/1098323720 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f253c0098e0 con 0x7f25440b9260 2023-10-08T12:01:49.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.541+0000 7f2543fff640 1 --2- 172.21.15.62:0/1098323720 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2544071410 0x7f2544140500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:01:49.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.541+0000 7f25437fe640 1 --2- 172.21.15.62:0/1098323720 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f25440b9260 0x7f254413d150 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f253800c450 tx=0x7f253800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:01:49.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.541+0000 7f2540ff9640 1 -- 172.21.15.62:0/1098323720 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2538005480 con 0x7f25440b9260 2023-10-08T12:01:49.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.541+0000 7f2540ff9640 1 -- 172.21.15.62:0/1098323720 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f25380036f0 con 0x7f25440b9260 2023-10-08T12:01:49.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.541+0000 7f2540ff9640 1 -- 172.21.15.62:0/1098323720 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2538003b00 con 0x7f25440b9260 2023-10-08T12:01:49.545 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.541+0000 7f254a9c2640 1 -- 172.21.15.62:0/1098323720 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f254413d690 con 0x7f25440b9260 2023-10-08T12:01:49.545 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.541+0000 7f254a9c2640 1 -- 172.21.15.62:0/1098323720 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2544146190 con 0x7f25440b9260 2023-10-08T12:01:49.545 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.541+0000 7f254a9c2640 1 -- 172.21.15.62:0/1098323720 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25440b5be0 con 0x7f25440b9260 2023-10-08T12:01:49.546 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.541+0000 7f2540ff9640 1 -- 172.21.15.62:0/1098323720 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2538003c60 con 0x7f25440b9260 2023-10-08T12:01:49.546 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.541+0000 7f2540ff9640 1 --2- 172.21.15.62:0/1098323720 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f2530066470 0x7f2530068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:01:49.546 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.541+0000 7f2540ff9640 1 -- 172.21.15.62:0/1098323720 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f25380836b0 con 0x7f25440b9260 2023-10-08T12:01:49.546 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.541+0000 7f2543fff640 1 --2- 172.21.15.62:0/1098323720 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f2530066470 0x7f2530068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:01:49.546 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.541+0000 7f2543fff640 1 --2- 172.21.15.62:0/1098323720 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f2530066470 0x7f2530068930 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f253400a8b0 tx=0x7f2534008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:01:49.549 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.545+0000 7f2540ff9640 1 -- 172.21.15.62:0/1098323720 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2538050ab0 con 0x7f25440b9260 2023-10-08T12:01:49.760 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.757+0000 7f254a9c2640 1 -- 172.21.15.62:0/1098323720 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) v1 -- 0x7f2544146a50 con 0x7f25440b9260 2023-10-08T12:01:49.760 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.757+0000 7f2540ff9640 1 -- 172.21.15.62:0/1098323720 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v15) v1 ==== 92+0+63 (secure 0 0 0) 0x7f2538017050 con 0x7f25440b9260 2023-10-08T12:01:49.761 INFO:teuthology.orchestra.run.smithi062.stdout:[client.admin] 2023-10-08T12:01:49.761 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCYmSJlZGuKBRAAwp6lQTFcdd0ZaqeY7H1U5A== 2023-10-08T12:01:49.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.761+0000 7f254a9c2640 1 -- 172.21.15.62:0/1098323720 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f2530066470 msgr2=0x7f2530068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:01:49.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.761+0000 7f254a9c2640 1 --2- 172.21.15.62:0/1098323720 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f2530066470 0x7f2530068930 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f253400a8b0 tx=0x7f2534008040 comp rx=0 tx=0).stop 2023-10-08T12:01:49.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.761+0000 7f254a9c2640 1 -- 172.21.15.62:0/1098323720 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f25440b9260 msgr2=0x7f254413d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:01:49.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.761+0000 7f254a9c2640 1 --2- 172.21.15.62:0/1098323720 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f25440b9260 0x7f254413d150 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f253800c450 tx=0x7f253800c910 comp rx=0 tx=0).stop 2023-10-08T12:01:49.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.761+0000 7f254a9c2640 1 -- 172.21.15.62:0/1098323720 shutdown_connections 2023-10-08T12:01:49.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.761+0000 7f254a9c2640 1 --2- 172.21.15.62:0/1098323720 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7f2530066470 0x7f2530068930 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:49.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.761+0000 7f254a9c2640 1 --2- 172.21.15.62:0/1098323720 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2544147920 0x7f254413c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:49.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.761+0000 7f254a9c2640 1 --2- 172.21.15.62:0/1098323720 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f25440b9260 0x7f254413d150 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:49.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.761+0000 7f254a9c2640 1 --2- 172.21.15.62:0/1098323720 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2544071410 0x7f2544140500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:01:49.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.761+0000 7f254a9c2640 1 -- 172.21.15.62:0/1098323720 >> 172.21.15.62:0/1098323720 conn(0x7f254409c520 msgr2=0x7f254406a930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:01:49.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.761+0000 7f254a9c2640 1 -- 172.21.15.62:0/1098323720 shutdown_connections 2023-10-08T12:01:49.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:01:49.761+0000 7f254a9c2640 1 -- 172.21.15.62:0/1098323720 wait complete. 2023-10-08T12:01:49.779 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-10-08T12:01:49.779 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/tmp/tmp.3RpD2mKkbxxfstests-dev/local.config 2023-10-08T12:01:49.799 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.62:6789:/test export TEST_DIR=/tmp/tmp.ZQPbrv5NcXtest export SCRATCH_DEV=172.21.15.62:6789:/scratch export SCRATCH_MNT=/tmp/tmp.9EPeO8cn4xscratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQCYmSJlZGuKBRAAwp6lQTFcdd0ZaqeY7H1U5A==" 2023-10-08T12:01:49.799 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-10-08T12:01:49.800 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/tmp/tmp.3RpD2mKkbxxfstests-dev/ceph.exclude 2023-10-08T12:01:49.863 DEBUG:teuthology.orchestra.run.smithi156:> (cd /tmp/tmp.3RpD2mKkbxxfstests-dev && exec sudo make) 2023-10-08T12:01:49.928 INFO:teuthology.orchestra.run.smithi156.stdout:libtoolize -cfi 2023-10-08T12:01:50.298 INFO:teuthology.orchestra.run.smithi156.stdout:libtoolize: putting auxiliary files in '.'. 2023-10-08T12:01:50.298 INFO:teuthology.orchestra.run.smithi156.stdout:libtoolize: copying file './config.guess' 2023-10-08T12:01:50.308 INFO:teuthology.orchestra.run.smithi156.stdout:libtoolize: copying file './config.sub' 2023-10-08T12:01:50.321 INFO:teuthology.orchestra.run.smithi156.stdout:libtoolize: copying file './install-sh' 2023-10-08T12:01:50.332 INFO:teuthology.orchestra.run.smithi156.stdout:libtoolize: copying file './ltmain.sh' 2023-10-08T12:01:50.376 INFO:teuthology.orchestra.run.smithi156.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-10-08T12:01:50.376 INFO:teuthology.orchestra.run.smithi156.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-10-08T12:01:50.386 INFO:teuthology.orchestra.run.smithi156.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-10-08T12:01:50.398 INFO:teuthology.orchestra.run.smithi156.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-10-08T12:01:50.408 INFO:teuthology.orchestra.run.smithi156.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-10-08T12:01:50.419 INFO:teuthology.orchestra.run.smithi156.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-10-08T12:01:50.430 INFO:teuthology.orchestra.run.smithi156.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-10-08T12:01:50.432 INFO:teuthology.orchestra.run.smithi156.stdout:cp include/install-sh . 2023-10-08T12:01:50.434 INFO:teuthology.orchestra.run.smithi156.stdout:aclocal -I m4 2023-10-08T12:01:51.494 INFO:teuthology.orchestra.run.smithi156.stdout:autoheader 2023-10-08T12:01:51.849 INFO:teuthology.orchestra.run.smithi156.stdout:autoconf 2023-10-08T12:01:52.246 INFO:teuthology.orchestra.run.smithi156.stdout:./configure \ 2023-10-08T12:01:52.247 INFO:teuthology.orchestra.run.smithi156.stdout: --libexecdir=/usr/lib \ 2023-10-08T12:01:52.247 INFO:teuthology.orchestra.run.smithi156.stdout: --exec_prefix=/var/lib 2023-10-08T12:01:52.782 INFO:teuthology.orchestra.run.smithi156.stdout:checking build system type... x86_64-pc-linux-gnu 2023-10-08T12:01:52.782 INFO:teuthology.orchestra.run.smithi156.stdout:checking host system type... x86_64-pc-linux-gnu 2023-10-08T12:01:52.838 INFO:teuthology.orchestra.run.smithi156.stdout:checking how to print strings... printf 2023-10-08T12:01:52.839 INFO:teuthology.orchestra.run.smithi156.stdout:checking for gcc... gcc 2023-10-08T12:01:53.082 INFO:teuthology.orchestra.run.smithi156.stdout:checking whether the C compiler works... yes 2023-10-08T12:01:53.082 INFO:teuthology.orchestra.run.smithi156.stdout:checking for C compiler default output file name... a.out 2023-10-08T12:01:53.125 INFO:teuthology.orchestra.run.smithi156.stdout:checking for suffix of executables... 2023-10-08T12:01:53.225 INFO:teuthology.orchestra.run.smithi156.stdout:checking whether we are cross compiling... no 2023-10-08T12:01:53.252 INFO:teuthology.orchestra.run.smithi156.stdout:checking for suffix of object files... o 2023-10-08T12:01:53.275 INFO:teuthology.orchestra.run.smithi156.stdout:checking whether the compiler supports GNU C... yes 2023-10-08T12:01:53.298 INFO:teuthology.orchestra.run.smithi156.stdout:checking whether gcc accepts -g... yes 2023-10-08T12:01:53.425 INFO:teuthology.orchestra.run.smithi156.stdout:checking for gcc option to enable C11 features... none needed 2023-10-08T12:01:53.431 INFO:teuthology.orchestra.run.smithi156.stdout:checking for a sed that does not truncate output... /usr/bin/sed 2023-10-08T12:01:53.436 INFO:teuthology.orchestra.run.smithi156.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2023-10-08T12:01:53.439 INFO:teuthology.orchestra.run.smithi156.stdout:checking for egrep... /usr/bin/grep -E 2023-10-08T12:01:53.442 INFO:teuthology.orchestra.run.smithi156.stdout:checking for fgrep... /usr/bin/grep -F 2023-10-08T12:01:53.449 INFO:teuthology.orchestra.run.smithi156.stdout:checking for ld used by gcc... /usr/bin/ld 2023-10-08T12:01:53.453 INFO:teuthology.orchestra.run.smithi156.stdout:checking if the linker (/usr/bin/ld) is GNU ld... yes 2023-10-08T12:01:53.462 INFO:teuthology.orchestra.run.smithi156.stdout:checking for BSD- or MS-compatible name lister (nm)... /usr/bin/nm -B 2023-10-08T12:01:53.493 INFO:teuthology.orchestra.run.smithi156.stdout:checking the name lister (/usr/bin/nm -B) interface... BSD nm 2023-10-08T12:01:53.494 INFO:teuthology.orchestra.run.smithi156.stdout:checking whether ln -s works... yes 2023-10-08T12:01:53.527 INFO:teuthology.orchestra.run.smithi156.stdout:checking the maximum length of command line arguments... 1572864 2023-10-08T12:01:53.533 INFO:teuthology.orchestra.run.smithi156.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-10-08T12:01:53.533 INFO:teuthology.orchestra.run.smithi156.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-10-08T12:01:53.533 INFO:teuthology.orchestra.run.smithi156.stdout:checking for /usr/bin/ld option to reload object files... -r 2023-10-08T12:01:53.533 INFO:teuthology.orchestra.run.smithi156.stdout:checking for objdump... objdump 2023-10-08T12:01:53.533 INFO:teuthology.orchestra.run.smithi156.stdout:checking how to recognize dependent libraries... pass_all 2023-10-08T12:01:53.534 INFO:teuthology.orchestra.run.smithi156.stdout:checking for dlltool... no 2023-10-08T12:01:53.534 INFO:teuthology.orchestra.run.smithi156.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-10-08T12:01:53.534 INFO:teuthology.orchestra.run.smithi156.stdout:checking for ar... ar 2023-10-08T12:01:53.580 INFO:teuthology.orchestra.run.smithi156.stdout:checking for archiver @FILE support... @ 2023-10-08T12:01:53.580 INFO:teuthology.orchestra.run.smithi156.stdout:checking for strip... strip 2023-10-08T12:01:53.581 INFO:teuthology.orchestra.run.smithi156.stdout:checking for ranlib... ranlib 2023-10-08T12:01:53.581 INFO:teuthology.orchestra.run.smithi156.stdout:checking for gawk... gawk 2023-10-08T12:01:53.669 INFO:teuthology.orchestra.run.smithi156.stdout:checking command to parse /usr/bin/nm -B output from gcc object... ok 2023-10-08T12:01:53.672 INFO:teuthology.orchestra.run.smithi156.stdout:checking for sysroot... no 2023-10-08T12:01:53.679 INFO:teuthology.orchestra.run.smithi156.stdout:checking for a working dd... /usr/bin/dd 2023-10-08T12:01:53.686 INFO:teuthology.orchestra.run.smithi156.stdout:checking how to truncate binary pipes... /usr/bin/dd bs=4096 count=1 2023-10-08T12:01:53.706 INFO:teuthology.orchestra.run.smithi156.stdout:checking for mt... mt 2023-10-08T12:01:53.725 INFO:teuthology.orchestra.run.smithi156.stdout:checking if mt is a manifest tool... no 2023-10-08T12:01:53.753 INFO:teuthology.orchestra.run.smithi156.stdout:checking for stdio.h... yes 2023-10-08T12:01:53.795 INFO:teuthology.orchestra.run.smithi156.stdout:checking for stdlib.h... yes 2023-10-08T12:01:53.830 INFO:teuthology.orchestra.run.smithi156.stdout:checking for string.h... yes 2023-10-08T12:01:53.867 INFO:teuthology.orchestra.run.smithi156.stdout:checking for inttypes.h... yes 2023-10-08T12:01:53.899 INFO:teuthology.orchestra.run.smithi156.stdout:checking for stdint.h... yes 2023-10-08T12:01:53.932 INFO:teuthology.orchestra.run.smithi156.stdout:checking for strings.h... yes 2023-10-08T12:01:53.966 INFO:teuthology.orchestra.run.smithi156.stdout:checking for sys/stat.h... yes 2023-10-08T12:01:53.998 INFO:teuthology.orchestra.run.smithi156.stdout:checking for sys/types.h... yes 2023-10-08T12:01:54.060 INFO:teuthology.orchestra.run.smithi156.stdout:checking for unistd.h... yes 2023-10-08T12:01:54.099 INFO:teuthology.orchestra.run.smithi156.stdout:checking for dlfcn.h... yes 2023-10-08T12:01:54.104 INFO:teuthology.orchestra.run.smithi156.stdout:checking for objdir... .libs 2023-10-08T12:01:54.217 INFO:teuthology.orchestra.run.smithi156.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-10-08T12:01:54.217 INFO:teuthology.orchestra.run.smithi156.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-10-08T12:01:54.244 INFO:teuthology.orchestra.run.smithi156.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-10-08T12:01:54.450 INFO:teuthology.orchestra.run.smithi156.stdout:checking if gcc static flag -static works... yes 2023-10-08T12:01:54.492 INFO:teuthology.orchestra.run.smithi156.stdout:checking if gcc supports -c -o file.o... yes 2023-10-08T12:01:54.492 INFO:teuthology.orchestra.run.smithi156.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-10-08T12:01:54.506 INFO:teuthology.orchestra.run.smithi156.stdout:checking whether the gcc linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-10-08T12:01:54.542 INFO:teuthology.orchestra.run.smithi156.stdout:checking whether -lc should be explicitly linked in... no 2023-10-08T12:01:54.641 INFO:teuthology.orchestra.run.smithi156.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-10-08T12:01:54.642 INFO:teuthology.orchestra.run.smithi156.stdout:checking how to hardcode library paths into programs... immediate 2023-10-08T12:01:54.659 INFO:teuthology.orchestra.run.smithi156.stdout:checking whether stripping libraries is possible... yes 2023-10-08T12:01:54.660 INFO:teuthology.orchestra.run.smithi156.stdout:checking if libtool supports shared libraries... yes 2023-10-08T12:01:54.660 INFO:teuthology.orchestra.run.smithi156.stdout:checking whether to build shared libraries... yes 2023-10-08T12:01:54.660 INFO:teuthology.orchestra.run.smithi156.stdout:checking whether to build static libraries... yes 2023-10-08T12:01:54.674 INFO:teuthology.orchestra.run.smithi156.stdout:checking for gcc... (cached) gcc 2023-10-08T12:01:54.717 INFO:teuthology.orchestra.run.smithi156.stdout:checking whether the compiler supports GNU C... (cached) yes 2023-10-08T12:01:54.717 INFO:teuthology.orchestra.run.smithi156.stdout:checking whether gcc accepts -g... (cached) yes 2023-10-08T12:01:54.717 INFO:teuthology.orchestra.run.smithi156.stdout:checking for gcc option to enable C11 features... (cached) none needed 2023-10-08T12:01:54.717 INFO:teuthology.orchestra.run.smithi156.stdout:checking for gmake... /usr/bin/gmake 2023-10-08T12:01:54.718 INFO:teuthology.orchestra.run.smithi156.stderr:./configure: line 12753: test: $(SHELL): binary operator expected 2023-10-08T12:01:54.718 INFO:teuthology.orchestra.run.smithi156.stdout:checking for tar... /bin/tar 2023-10-08T12:01:54.719 INFO:teuthology.orchestra.run.smithi156.stdout:checking for gzip... /bin/gzip 2023-10-08T12:01:54.732 INFO:teuthology.orchestra.run.smithi156.stdout:checking whether gcc -MM is supported... yes 2023-10-08T12:01:54.733 INFO:teuthology.orchestra.run.smithi156.stdout:checking for sort... /bin/sort 2023-10-08T12:01:54.734 INFO:teuthology.orchestra.run.smithi156.stdout:checking whether ln -s works... yes 2023-10-08T12:01:54.734 INFO:teuthology.orchestra.run.smithi156.stdout:checking for rpm... no 2023-10-08T12:01:54.772 INFO:teuthology.orchestra.run.smithi156.stdout:checking for assert.h... yes 2023-10-08T12:01:54.814 INFO:teuthology.orchestra.run.smithi156.stdout:checking for bstring.h... no 2023-10-08T12:01:54.852 INFO:teuthology.orchestra.run.smithi156.stdout:checking for libgen.h... yes 2023-10-08T12:01:54.923 INFO:teuthology.orchestra.run.smithi156.stdout:checking for dirent.h... yes 2023-10-08T12:01:54.999 INFO:teuthology.orchestra.run.smithi156.stdout:checking for errno.h... yes 2023-10-08T12:01:55.037 INFO:teuthology.orchestra.run.smithi156.stdout:checking for malloc.h... yes 2023-10-08T12:01:55.078 INFO:teuthology.orchestra.run.smithi156.stdout:checking for uuid.h... no 2023-10-08T12:01:55.132 INFO:teuthology.orchestra.run.smithi156.stdout:checking for uuid/uuid.h... yes 2023-10-08T12:01:55.174 INFO:teuthology.orchestra.run.smithi156.stdout:checking for sys/uuid.h... no 2023-10-08T12:01:55.214 INFO:teuthology.orchestra.run.smithi156.stdout:checking for sys/file.h... yes 2023-10-08T12:01:55.253 INFO:teuthology.orchestra.run.smithi156.stdout:checking for sys/fcntl.h... yes 2023-10-08T12:01:55.294 INFO:teuthology.orchestra.run.smithi156.stdout:checking for sys/syssgi.h... no 2023-10-08T12:01:55.351 INFO:teuthology.orchestra.run.smithi156.stdout:checking for sys/param.h... yes 2023-10-08T12:01:55.352 INFO:teuthology.orchestra.run.smithi156.stdout:checking for sys/stat.h... (cached) yes 2023-10-08T12:01:55.391 INFO:teuthology.orchestra.run.smithi156.stdout:checking for sys/statvfs.h... yes 2023-10-08T12:01:55.428 INFO:teuthology.orchestra.run.smithi156.stdout:checking for sys/time.h... yes 2023-10-08T12:01:55.489 INFO:teuthology.orchestra.run.smithi156.stdout:checking for sys/ioctl.h... yes 2023-10-08T12:01:55.530 INFO:teuthology.orchestra.run.smithi156.stdout:checking for sys/wait.h... yes 2023-10-08T12:01:55.530 INFO:teuthology.orchestra.run.smithi156.stdout:checking for sys/types.h... (cached) yes 2023-10-08T12:01:55.530 INFO:teuthology.orchestra.run.smithi156.stdout:checking for strings.h... (cached) yes 2023-10-08T12:01:55.567 INFO:teuthology.orchestra.run.smithi156.stdout:checking for err.h... yes 2023-10-08T12:01:55.606 INFO:teuthology.orchestra.run.smithi156.stdout:checking for linux/falloc.h... yes 2023-10-08T12:01:55.647 INFO:teuthology.orchestra.run.smithi156.stdout:checking for sys/fs/xfs_fsops.h... no 2023-10-08T12:01:55.688 INFO:teuthology.orchestra.run.smithi156.stdout:checking for sys/fs/xfs_itable.h... no 2023-10-08T12:01:55.730 INFO:teuthology.orchestra.run.smithi156.stdout:checking for xfs/platform_defs.h... no 2023-10-08T12:01:55.771 INFO:teuthology.orchestra.run.smithi156.stdout:checking for btrfs/ioctl.h... no 2023-10-08T12:01:55.813 INFO:teuthology.orchestra.run.smithi156.stdout:checking for cifs/ioctl.h... no 2023-10-08T12:01:55.852 INFO:teuthology.orchestra.run.smithi156.stdout:checking for sys/mman.h... yes 2023-10-08T12:01:55.876 INFO:teuthology.orchestra.run.smithi156.stdout:checking for xfs/xfs_log_format.h... no 2023-10-08T12:01:55.934 INFO:teuthology.orchestra.run.smithi156.stdout:checking for uuid_compare... no 2023-10-08T12:01:55.981 INFO:teuthology.orchestra.run.smithi156.stdout:checking for uuid_compare in -luuid... yes 2023-10-08T12:01:56.098 INFO:teuthology.orchestra.run.smithi156.stdout:checking for xfs/xfs.h... yes 2023-10-08T12:01:56.122 INFO:teuthology.orchestra.run.smithi156.stdout:checking for xfs/libxfs.h... no 2023-10-08T12:01:56.171 INFO:teuthology.orchestra.run.smithi156.stdout:checking for gcc options needed to detect all undeclared functions... none needed 2023-10-08T12:01:56.203 INFO:teuthology.orchestra.run.smithi156.stdout:checking whether xlog_assign_lsn is declared... no 2023-10-08T12:01:56.250 INFO:teuthology.orchestra.run.smithi156.stdout:checking for xfs/xqm.h... yes 2023-10-08T12:01:56.323 INFO:teuthology.orchestra.run.smithi156.stdout:checking xfsctl from xfs/xfs.h... ok 2023-10-08T12:01:56.364 INFO:teuthology.orchestra.run.smithi156.stdout:checking for xfs/handle.h... yes 2023-10-08T12:01:56.412 INFO:teuthology.orchestra.run.smithi156.stdout:checking for attr_list_by_handle in -lhandle... yes 2023-10-08T12:01:56.452 INFO:teuthology.orchestra.run.smithi156.stdout:checking for sys/acl.h... yes 2023-10-08T12:01:56.494 INFO:teuthology.orchestra.run.smithi156.stdout:checking for acl/libacl.h... yes 2023-10-08T12:01:56.542 INFO:teuthology.orchestra.run.smithi156.stdout:checking for acl_init in -lacl... yes 2023-10-08T12:01:56.584 INFO:teuthology.orchestra.run.smithi156.stdout:checking for gdbm-ndbm.h... no 2023-10-08T12:01:56.625 INFO:teuthology.orchestra.run.smithi156.stdout:checking for gdbm/ndbm.h... no 2023-10-08T12:01:56.666 INFO:teuthology.orchestra.run.smithi156.stdout:checking for ndbm.h... no 2023-10-08T12:01:56.707 INFO:teuthology.orchestra.run.smithi156.stdout:checking for libaio.h... yes 2023-10-08T12:01:56.749 INFO:teuthology.orchestra.run.smithi156.stdout:checking for liburing.h... no 2023-10-08T12:01:56.791 INFO:teuthology.orchestra.run.smithi156.stdout:checking for sys/capability.h... no 2023-10-08T12:01:56.830 INFO:teuthology.orchestra.run.smithi156.stdout:checking for linux/fiemap.h... yes 2023-10-08T12:01:56.880 INFO:teuthology.orchestra.run.smithi156.stdout:checking for fallocate... yes 2023-10-08T12:01:56.933 INFO:teuthology.orchestra.run.smithi156.stdout:checking for open_by_handle_at... yes 2023-10-08T12:01:56.974 INFO:teuthology.orchestra.run.smithi156.stdout:checking for sys/prctl.h... yes 2023-10-08T12:01:57.013 INFO:teuthology.orchestra.run.smithi156.stdout:checking for linux/fs.h... yes 2023-10-08T12:01:57.054 INFO:teuthology.orchestra.run.smithi156.stdout:checking for btrfsutil.h... no 2023-10-08T12:01:57.110 INFO:teuthology.orchestra.run.smithi156.stdout:checking for copy_file_range... yes 2023-10-08T12:01:57.167 INFO:teuthology.orchestra.run.smithi156.stdout:checking for SEEK_DATA... yes 2023-10-08T12:01:57.243 INFO:teuthology.orchestra.run.smithi156.stdout:checking for BMV_OF_SHARED... yes 2023-10-08T12:01:57.298 INFO:teuthology.orchestra.run.smithi156.stdout:checking for nftw... yes 2023-10-08T12:01:57.352 INFO:teuthology.orchestra.run.smithi156.stdout:checking for RLIMIT_NOFILE... yes 2023-10-08T12:01:57.388 INFO:teuthology.orchestra.run.smithi156.stdout:checking for FIEXCHANGE_RANGE... no 2023-10-08T12:01:57.441 INFO:teuthology.orchestra.run.smithi156.stdout:checking for renameat2... yes 2023-10-08T12:01:57.490 INFO:teuthology.orchestra.run.smithi156.stdout:checking for reallocarray... yes 2023-10-08T12:01:57.546 INFO:teuthology.orchestra.run.smithi156.stdout:checking for struct mount_attr... yes 2023-10-08T12:01:57.602 INFO:teuthology.orchestra.run.smithi156.stdout:checking for struct btrfs_qgroup_limit... yes 2023-10-08T12:01:57.662 INFO:teuthology.orchestra.run.smithi156.stdout:checking for struct btrfs_qgroup_inherit... yes 2023-10-08T12:01:57.707 INFO:teuthology.orchestra.run.smithi156.stdout:checking for struct btrfs_ioctl_vol_args... yes 2023-10-08T12:01:57.760 INFO:teuthology.orchestra.run.smithi156.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2023-10-08T12:01:57.813 INFO:teuthology.orchestra.run.smithi156.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2023-10-08T12:01:57.866 INFO:teuthology.orchestra.run.smithi156.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2023-10-08T12:01:57.919 INFO:teuthology.orchestra.run.smithi156.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2023-10-08T12:01:57.958 INFO:teuthology.orchestra.run.smithi156.stdout:checking for linux/btrfs.h... yes 2023-10-08T12:01:58.000 INFO:teuthology.orchestra.run.smithi156.stdout:checking for linux/btrfs_tree.h... yes 2023-10-08T12:01:58.028 INFO:teuthology.orchestra.run.smithi156.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... yes 2023-10-08T12:01:58.054 INFO:teuthology.orchestra.run.smithi156.stdout:configure: creating ./config.status 2023-10-08T12:01:58.872 INFO:teuthology.orchestra.run.smithi156.stdout:config.status: creating include/builddefs 2023-10-08T12:01:58.900 INFO:teuthology.orchestra.run.smithi156.stdout:config.status: creating include/config.h 2023-10-08T12:01:58.921 INFO:teuthology.orchestra.run.smithi156.stdout:config.status: executing libtool commands 2023-10-08T12:01:58.991 INFO:teuthology.orchestra.run.smithi156.stdout:Building include 2023-10-08T12:01:58.997 INFO:teuthology.orchestra.run.smithi156.stdout:Building lib 2023-10-08T12:01:59.003 INFO:teuthology.orchestra.run.smithi156.stdout: [LTDEP] 2023-10-08T12:01:59.199 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] dataascii.lo 2023-10-08T12:01:59.345 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] databin.lo 2023-10-08T12:01:59.530 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] datapid.lo 2023-10-08T12:01:59.669 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] file_lock.lo 2023-10-08T12:01:59.859 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] forker.lo 2023-10-08T12:02:00.031 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] pattern.lo 2023-10-08T12:02:00.183 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] open_flags.lo 2023-10-08T12:02:00.360 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] random_range.lo 2023-10-08T12:02:00.617 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] string_to_tokens.lo 2023-10-08T12:02:00.745 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] str_to_bytes.lo 2023-10-08T12:02:00.914 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] tlibio.lo 2023-10-08T12:02:01.200 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] write_log.lo 2023-10-08T12:02:01.286 INFO:teuthology.orchestra.run.smithi156.stderr:write_log.c: In function 'wlog_record_write': 2023-10-08T12:02:01.286 INFO:teuthology.orchestra.run.smithi156.stderr:write_log.c:205:13: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:01.286 INFO:teuthology.orchestra.run.smithi156.stderr: 205 | write(wfile->w_afd, wbuf, reclen); 2023-10-08T12:02:01.286 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:01.286 INFO:teuthology.orchestra.run.smithi156.stderr:write_log.c:209:13: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:01.286 INFO:teuthology.orchestra.run.smithi156.stderr: 209 | write(wfile->w_rfd, wbuf, reclen); 2023-10-08T12:02:01.287 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:01.470 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] random.lo 2023-10-08T12:02:01.598 INFO:teuthology.orchestra.run.smithi156.stdout: [LD] 2023-10-08T12:02:01.711 INFO:teuthology.orchestra.run.smithi156.stdout:Building ltp 2023-10-08T12:02:01.717 INFO:teuthology.orchestra.run.smithi156.stdout: [DEP] 2023-10-08T12:02:01.923 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] doio 2023-10-08T12:02:02.654 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] fsstress 2023-10-08T12:02:04.152 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] fsx 2023-10-08T12:02:04.946 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] growfiles 2023-10-08T12:02:05.524 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] iogen 2023-10-08T12:02:05.688 INFO:teuthology.orchestra.run.smithi156.stderr:iogen.c: In function 'main': 2023-10-08T12:02:05.688 INFO:teuthology.orchestra.run.smithi156.stderr:iogen.c:280:9: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:05.688 INFO:teuthology.orchestra.run.smithi156.stderr: 280 | write(outfd, (char *)&req, sizeof(req)); 2023-10-08T12:02:05.689 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:05.691 INFO:teuthology.orchestra.run.smithi156.stderr:iogen.c: In function 'parse_cmdline': 2023-10-08T12:02:05.691 INFO:teuthology.orchestra.run.smithi156.stderr:iogen.c:1535:17: warning: ignoring return value of 'getcwd' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:05.691 INFO:teuthology.orchestra.run.smithi156.stderr: 1535 | getcwd(fptr->f_path, 2023-10-08T12:02:05.692 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:05.692 INFO:teuthology.orchestra.run.smithi156.stderr: 1536 | sizeof(fptr->f_path)-1); 2023-10-08T12:02:05.692 INFO:teuthology.orchestra.run.smithi156.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:05.972 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] aio-stress 2023-10-08T12:02:06.131 INFO:teuthology.orchestra.run.smithi156.stderr:aio-stress.c: In function 'setup_shared_mem': 2023-10-08T12:02:06.131 INFO:teuthology.orchestra.run.smithi156.stderr:aio-stress.c:1013:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:06.131 INFO:teuthology.orchestra.run.smithi156.stderr: 1013 | ftruncate(fd, total_ram); 2023-10-08T12:02:06.131 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:06.452 INFO:teuthology.orchestra.run.smithi156.stdout:Building src 2023-10-08T12:02:06.460 INFO:teuthology.orchestra.run.smithi156.stdout: [DEP] 2023-10-08T12:02:08.862 INFO:teuthology.orchestra.run.smithi156.stdout: [DEP] 2023-10-08T12:02:08.909 INFO:teuthology.orchestra.run.smithi156.stdout: [DEP] 2023-10-08T12:02:08.923 INFO:teuthology.orchestra.run.smithi156.stdout: [DEP] 2023-10-08T12:02:09.256 INFO:teuthology.orchestra.run.smithi156.stdout: [DEP] 2023-10-08T12:02:09.291 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] dirstress 2023-10-08T12:02:09.580 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] fill 2023-10-08T12:02:09.770 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] fill2 2023-10-08T12:02:10.040 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] getpagesize 2023-10-08T12:02:10.212 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] holes 2023-10-08T12:02:10.450 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] lstat64 2023-10-08T12:02:10.674 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] nametest 2023-10-08T12:02:10.835 INFO:teuthology.orchestra.run.smithi156.stderr:nametest.c: In function 'main': 2023-10-08T12:02:10.835 INFO:teuthology.orchestra.run.smithi156.stderr:nametest.c:236:33: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:10.835 INFO:teuthology.orchestra.run.smithi156.stderr: 236 | write(1, "\n", 1); 2023-10-08T12:02:10.835 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~ 2023-10-08T12:02:10.835 INFO:teuthology.orchestra.run.smithi156.stderr:nametest.c:238:25: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:10.835 INFO:teuthology.orchestra.run.smithi156.stderr: 238 | write(1, ".", 1); 2023-10-08T12:02:10.836 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~ 2023-10-08T12:02:10.836 INFO:teuthology.orchestra.run.smithi156.stderr:nametest.c:288:33: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:10.836 INFO:teuthology.orchestra.run.smithi156.stderr: 288 | write(1, ".", 1); 2023-10-08T12:02:10.836 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~ 2023-10-08T12:02:10.957 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] permname 2023-10-08T12:02:11.199 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] randholes 2023-10-08T12:02:11.496 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] runas 2023-10-08T12:02:11.713 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] truncfile 2023-10-08T12:02:11.935 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] usemem 2023-10-08T12:02:12.125 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] mmapcat 2023-10-08T12:02:12.269 INFO:teuthology.orchestra.run.smithi156.stderr:mmapcat.c: In function 'main': 2023-10-08T12:02:12.270 INFO:teuthology.orchestra.run.smithi156.stderr:mmapcat.c:29:9: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:12.270 INFO:teuthology.orchestra.run.smithi156.stderr: 29 | write(1,ptr2,ptr - ptr2); 2023-10-08T12:02:12.270 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:12.312 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] append_reader 2023-10-08T12:02:12.504 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] append_writer 2023-10-08T12:02:12.696 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] dirperf 2023-10-08T12:02:12.960 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] metaperf 2023-10-08T12:02:13.115 INFO:teuthology.orchestra.run.smithi156.stderr:metaperf.c: In function 'crfiles': 2023-10-08T12:02:13.115 INFO:teuthology.orchestra.run.smithi156.stderr:metaperf.c:166:25: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:13.115 INFO:teuthology.orchestra.run.smithi156.stderr: 166 | write(fd, buf, fsize); 2023-10-08T12:02:13.115 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:13.116 INFO:teuthology.orchestra.run.smithi156.stderr:metaperf.c: In function 't_linkun': 2023-10-08T12:02:13.116 INFO:teuthology.orchestra.run.smithi156.stderr:metaperf.c:454:25: warning: ignoring return value of 'link' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:13.116 INFO:teuthology.orchestra.run.smithi156.stderr: 454 | link("a", *fnp); 2023-10-08T12:02:13.117 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~ 2023-10-08T12:02:13.117 INFO:teuthology.orchestra.run.smithi156.stderr:metaperf.c: In function 't_chown': 2023-10-08T12:02:13.117 INFO:teuthology.orchestra.run.smithi156.stderr:metaperf.c:404:33: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:13.117 INFO:teuthology.orchestra.run.smithi156.stderr: 404 | chown(*fnp, 2, -1); 2023-10-08T12:02:13.117 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:13.117 INFO:teuthology.orchestra.run.smithi156.stderr:metaperf.c:406:33: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:13.117 INFO:teuthology.orchestra.run.smithi156.stderr: 406 | chown(*fnp, 1, -1); 2023-10-08T12:02:13.117 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:13.117 INFO:teuthology.orchestra.run.smithi156.stderr:metaperf.c: In function 'i_chown': 2023-10-08T12:02:13.117 INFO:teuthology.orchestra.run.smithi156.stderr:metaperf.c:291:17: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:13.118 INFO:teuthology.orchestra.run.smithi156.stderr: 291 | chown(*fnp, 1, -1); 2023-10-08T12:02:13.118 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:13.118 INFO:teuthology.orchestra.run.smithi156.stderr:metaperf.c: In function 'main': 2023-10-08T12:02:13.118 INFO:teuthology.orchestra.run.smithi156.stderr:metaperf.c:152:9: warning: ignoring return value of 'chdir' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:13.118 INFO:teuthology.orchestra.run.smithi156.stderr: 152 | chdir(".."); 2023-10-08T12:02:13.118 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~ 2023-10-08T12:02:13.287 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] devzero 2023-10-08T12:02:13.506 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] feature 2023-10-08T12:02:13.766 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] alloc 2023-10-08T12:02:13.928 INFO:teuthology.orchestra.run.smithi156.stderr:alloc.c: In function 'main': 2023-10-08T12:02:13.928 INFO:teuthology.orchestra.run.smithi156.stderr:alloc.c:247:17: warning: ignoring return value of 'mkstemp' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:13.928 INFO:teuthology.orchestra.run.smithi156.stderr: 247 | mkstemp(tmpfile); 2023-10-08T12:02:13.928 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~ 2023-10-08T12:02:14.023 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] fault 2023-10-08T12:02:14.228 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] fstest 2023-10-08T12:02:14.510 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] t_access_root 2023-10-08T12:02:14.656 INFO:teuthology.orchestra.run.smithi156.stderr:t_access_root.c: In function 'main': 2023-10-08T12:02:14.656 INFO:teuthology.orchestra.run.smithi156.stderr:t_access_root.c:55:5: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:14.656 INFO:teuthology.orchestra.run.smithi156.stderr: 55 | system(cmd); 2023-10-08T12:02:14.657 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~ 2023-10-08T12:02:14.705 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] godown 2023-10-08T12:02:14.917 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] resvtest 2023-10-08T12:02:15.147 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] writemod 2023-10-08T12:02:15.331 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] writev_on_pagefault 2023-10-08T12:02:15.531 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] makeextents 2023-10-08T12:02:15.752 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] itrash 2023-10-08T12:02:15.942 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] rename 2023-10-08T12:02:16.117 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] multi_open_unlink 2023-10-08T12:02:16.324 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] unwritten_sync 2023-10-08T12:02:16.547 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] genhashnames 2023-10-08T12:02:16.774 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] t_holes 2023-10-08T12:02:16.960 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] t_mmap_writev 2023-10-08T12:02:17.149 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] t_truncate_cmtime 2023-10-08T12:02:17.348 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] dirhash_collide 2023-10-08T12:02:17.569 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] t_rename_overwrite 2023-10-08T12:02:17.746 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] holetest 2023-10-08T12:02:17.900 INFO:teuthology.orchestra.run.smithi156.stderr:holetest.c: In function 'pt_write_marker': 2023-10-08T12:02:17.900 INFO:teuthology.orchestra.run.smithi156.stderr:holetest.c:140:17: warning: ignoring return value of 'pwrite' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:17.900 INFO:teuthology.orchestra.run.smithi156.stderr: 140 | pwrite(fd, &tid, sizeof(tid), i * page_size + pgoff); 2023-10-08T12:02:17.901 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:18.015 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] t_truncate_self 2023-10-08T12:02:18.193 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] af_unix 2023-10-08T12:02:18.394 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] t_mmap_stale_pmd 2023-10-08T12:02:18.542 INFO:teuthology.orchestra.run.smithi156.stderr:t_mmap_stale_pmd.c: In function 'main': 2023-10-08T12:02:18.542 INFO:teuthology.orchestra.run.smithi156.stderr:t_mmap_stale_pmd.c:42:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:18.542 INFO:teuthology.orchestra.run.smithi156.stderr: 42 | ftruncate(fd, 0); 2023-10-08T12:02:18.542 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~ 2023-10-08T12:02:18.543 INFO:teuthology.orchestra.run.smithi156.stderr:t_mmap_stale_pmd.c:43:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:18.543 INFO:teuthology.orchestra.run.smithi156.stderr: 43 | ftruncate(fd, MiB(4)); 2023-10-08T12:02:18.543 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:18.543 INFO:teuthology.orchestra.run.smithi156.stderr:t_mmap_stale_pmd.c:55:9: warning: ignoring return value of 'pwrite' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:18.543 INFO:teuthology.orchestra.run.smithi156.stderr: 55 | pwrite(fd, buffer, strlen(buffer), MiB(2)); 2023-10-08T12:02:18.543 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:18.587 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] t_mmap_cow_race 2023-10-08T12:02:18.739 INFO:teuthology.orchestra.run.smithi156.stderr:t_mmap_cow_race.c: In function 'main': 2023-10-08T12:02:18.739 INFO:teuthology.orchestra.run.smithi156.stderr:t_mmap_cow_race.c:61:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:18.739 INFO:teuthology.orchestra.run.smithi156.stderr: 61 | ftruncate(fd, 0); 2023-10-08T12:02:18.739 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~ 2023-10-08T12:02:18.739 INFO:teuthology.orchestra.run.smithi156.stderr:t_mmap_cow_race.c:62:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:18.740 INFO:teuthology.orchestra.run.smithi156.stderr: 62 | ftruncate(fd, MiB(2)); 2023-10-08T12:02:18.740 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:18.793 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] t_mmap_fallocate 2023-10-08T12:02:18.854 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:02:18.858 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:02:18.861 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:02:18.985 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] fsync-err 2023-10-08T12:02:19.212 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] t_mmap_write_ro 2023-10-08T12:02:19.405 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] t_ext4_dax_journal_corruption 2023-10-08T12:02:19.554 INFO:teuthology.orchestra.run.smithi156.stderr:t_ext4_dax_journal_corruption.c: In function 'main': 2023-10-08T12:02:19.554 INFO:teuthology.orchestra.run.smithi156.stderr:t_ext4_dax_journal_corruption.c:61:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:19.554 INFO:teuthology.orchestra.run.smithi156.stderr: 61 | ftruncate(fd, 0); 2023-10-08T12:02:19.554 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~ 2023-10-08T12:02:19.606 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] t_ext4_dax_inline_corruption 2023-10-08T12:02:19.802 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] t_ofd_locks 2023-10-08T12:02:20.040 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] t_mmap_collision 2023-10-08T12:02:20.282 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] mmap-write-concurrent 2023-10-08T12:02:20.493 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] t_get_file_time 2023-10-08T12:02:20.679 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] t_create_short_dirs 2023-10-08T12:02:20.886 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] t_create_long_dirs 2023-10-08T12:02:21.091 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] t_enospc 2023-10-08T12:02:21.337 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] t_mmap_writev_overlap 2023-10-08T12:02:21.664 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] checkpoint_journal 2023-10-08T12:02:21.861 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] mmap-rw-fault 2023-10-08T12:02:22.087 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] allocstale 2023-10-08T12:02:22.300 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] t_mmap_cow_memory_failure 2023-10-08T12:02:22.514 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] fake-dump-rootino 2023-10-08T12:02:22.703 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] dio-buf-fault 2023-10-08T12:02:22.896 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] xfsctl 2023-10-08T12:02:23.128 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] bstat 2023-10-08T12:02:23.381 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] t_mtab 2023-10-08T12:02:23.533 INFO:teuthology.orchestra.run.smithi156.stderr:t_mtab.c: In function 'update_mtab': 2023-10-08T12:02:23.533 INFO:teuthology.orchestra.run.smithi156.stderr:t_mtab.c:256:17: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:23.533 INFO:teuthology.orchestra.run.smithi156.stderr: 256 | chown (mounted_temp, sbuf.st_uid, sbuf.st_gid); 2023-10-08T12:02:23.533 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:23.613 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] getdevicesize 2023-10-08T12:02:23.797 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] preallo_rw_pattern_reader 2023-10-08T12:02:23.952 INFO:teuthology.orchestra.run.smithi156.stderr:In file included from preallo_rw_pattern_reader.c:2: 2023-10-08T12:02:23.952 INFO:teuthology.orchestra.run.smithi156.stderr:iopat.c: In function 'main': 2023-10-08T12:02:23.952 INFO:teuthology.orchestra.run.smithi156.stderr:iopat.c:38:4: warning: ignoring return value of 'read' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:23.952 INFO:teuthology.orchestra.run.smithi156.stderr: 38 | read(fd, &x, 1048576); 2023-10-08T12:02:23.952 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:23.995 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] preallo_rw_pattern_writer 2023-10-08T12:02:24.152 INFO:teuthology.orchestra.run.smithi156.stderr:In file included from preallo_rw_pattern_writer.c:2: 2023-10-08T12:02:24.153 INFO:teuthology.orchestra.run.smithi156.stderr:iopat.c: In function 'main': 2023-10-08T12:02:24.153 INFO:teuthology.orchestra.run.smithi156.stderr:iopat.c:34:4: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:24.153 INFO:teuthology.orchestra.run.smithi156.stderr: 34 | write(fd, &x, 1048576); 2023-10-08T12:02:24.153 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:24.194 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] ftrunc 2023-10-08T12:02:24.382 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] trunc 2023-10-08T12:02:24.587 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] fs_perms 2023-10-08T12:02:24.736 INFO:teuthology.orchestra.run.smithi156.stderr:fs_perms.c: In function 'main': 2023-10-08T12:02:24.736 INFO:teuthology.orchestra.run.smithi156.stderr:fs_perms.c:54:4: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:24.736 INFO:teuthology.orchestra.run.smithi156.stderr: 54 | system("rm -f test.file"); 2023-10-08T12:02:24.736 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:24.736 INFO:teuthology.orchestra.run.smithi156.stderr:fs_perms.c: In function 'testsetup': 2023-10-08T12:02:24.736 INFO:teuthology.orchestra.run.smithi156.stderr:fs_perms.c:67:4: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:24.736 INFO:teuthology.orchestra.run.smithi156.stderr: 67 | system("cp testx.file test.file"); 2023-10-08T12:02:24.736 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:24.736 INFO:teuthology.orchestra.run.smithi156.stderr:fs_perms.c:69:4: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:24.737 INFO:teuthology.orchestra.run.smithi156.stderr: 69 | chown("test.file",cuserId,cgroupId); 2023-10-08T12:02:24.737 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:24.737 INFO:teuthology.orchestra.run.smithi156.stderr:fs_perms.c: In function 'testfperm': 2023-10-08T12:02:24.737 INFO:teuthology.orchestra.run.smithi156.stderr:fs_perms.c:123:5: warning: ignoring return value of 'seteuid' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:24.737 INFO:teuthology.orchestra.run.smithi156.stderr: 123 | seteuid(0); 2023-10-08T12:02:24.737 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~ 2023-10-08T12:02:24.737 INFO:teuthology.orchestra.run.smithi156.stderr:fs_perms.c:124:5: warning: ignoring return value of 'setegid' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:24.737 INFO:teuthology.orchestra.run.smithi156.stderr: 124 | setegid(0); 2023-10-08T12:02:24.737 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~ 2023-10-08T12:02:24.790 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] testx 2023-10-08T12:02:24.955 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] looptest 2023-10-08T12:02:25.191 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] locktest 2023-10-08T12:02:25.542 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] unwritten_mmap 2023-10-08T12:02:25.748 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] bulkstat_unlink_test 2023-10-08T12:02:25.908 INFO:teuthology.orchestra.run.smithi156.stderr:bulkstat_unlink_test.c: In function 'main': 2023-10-08T12:02:25.908 INFO:teuthology.orchestra.run.smithi156.stderr:bulkstat_unlink_test.c:106:25: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:25.908 INFO:teuthology.orchestra.run.smithi156.stderr: 106 | write(fd[i], fname, sizeof(fname)); 2023-10-08T12:02:25.909 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:25.909 INFO:teuthology.orchestra.run.smithi156.stderr:bulkstat_unlink_test.c:178:17: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:25.909 INFO:teuthology.orchestra.run.smithi156.stderr: 178 | system(fname); 2023-10-08T12:02:25.909 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~ 2023-10-08T12:02:25.997 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] deduperace 2023-10-08T12:02:26.237 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] bulkstat_unlink_test_modified 2023-10-08T12:02:26.394 INFO:teuthology.orchestra.run.smithi156.stderr:bulkstat_unlink_test_modified.c: In function 'main': 2023-10-08T12:02:26.394 INFO:teuthology.orchestra.run.smithi156.stderr:bulkstat_unlink_test_modified.c:83:13: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:26.395 INFO:teuthology.orchestra.run.smithi156.stderr: 83 | write(fd, fname, sizeof(fname)); 2023-10-08T12:02:26.395 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:26.395 INFO:teuthology.orchestra.run.smithi156.stderr:bulkstat_unlink_test_modified.c:139:13: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:26.395 INFO:teuthology.orchestra.run.smithi156.stderr: 139 | write(fd, fname, sizeof(fname)); 2023-10-08T12:02:26.395 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:26.395 INFO:teuthology.orchestra.run.smithi156.stderr:bulkstat_unlink_test_modified.c:185:9: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:26.395 INFO:teuthology.orchestra.run.smithi156.stderr: 185 | system(fname); 2023-10-08T12:02:26.395 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~ 2023-10-08T12:02:26.477 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] t_dir_offset 2023-10-08T12:02:26.666 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] t_futimens 2023-10-08T12:02:26.844 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] t_immutable 2023-10-08T12:02:27.018 INFO:teuthology.orchestra.run.smithi156.stderr:t_immutable.c: In function 'create_test_area': 2023-10-08T12:02:27.018 INFO:teuthology.orchestra.run.smithi156.stderr:t_immutable.c:2061:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:27.018 INFO:teuthology.orchestra.run.smithi156.stderr: 2061 | asprintf(&path, "%s/immutable.d", dir); 2023-10-08T12:02:27.018 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:27.018 INFO:teuthology.orchestra.run.smithi156.stderr:t_immutable.c:2096:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:27.018 INFO:teuthology.orchestra.run.smithi156.stderr: 2096 | asprintf(&path, "%s/append-only.d", dir); 2023-10-08T12:02:27.018 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:27.019 INFO:teuthology.orchestra.run.smithi156.stderr:t_immutable.c: In function 'remove_test_area': 2023-10-08T12:02:27.019 INFO:teuthology.orchestra.run.smithi156.stderr:t_immutable.c:2152:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:27.019 INFO:teuthology.orchestra.run.smithi156.stderr: 2152 | asprintf(&path, "%s/immutable.d", dir); 2023-10-08T12:02:27.020 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:27.020 INFO:teuthology.orchestra.run.smithi156.stderr:t_immutable.c:2163:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:27.020 INFO:teuthology.orchestra.run.smithi156.stderr: 2163 | asprintf(&path, "%s/empty-immutable.d", dir); 2023-10-08T12:02:27.020 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:27.020 INFO:teuthology.orchestra.run.smithi156.stderr:t_immutable.c:2175:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:27.020 INFO:teuthology.orchestra.run.smithi156.stderr: 2175 | asprintf(&path, "%s/append-only.d", dir); 2023-10-08T12:02:27.020 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:27.020 INFO:teuthology.orchestra.run.smithi156.stderr:t_immutable.c:2186:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:27.020 INFO:teuthology.orchestra.run.smithi156.stderr: 2186 | asprintf(&path, "%s/empty-append-only.d", dir); 2023-10-08T12:02:27.020 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:27.020 INFO:teuthology.orchestra.run.smithi156.stderr:t_immutable.c:2197:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:27.020 INFO:teuthology.orchestra.run.smithi156.stderr: 2197 | asprintf(&path, "%s/append-only.f", dir); 2023-10-08T12:02:27.021 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:27.022 INFO:teuthology.orchestra.run.smithi156.stderr:t_immutable.c:2209:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:27.022 INFO:teuthology.orchestra.run.smithi156.stderr: 2209 | asprintf(&path, "%s/immutable.f", dir); 2023-10-08T12:02:27.022 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:27.022 INFO:teuthology.orchestra.run.smithi156.stderr:t_immutable.c: In function 'check_test_area': 2023-10-08T12:02:27.022 INFO:teuthology.orchestra.run.smithi156.stderr:t_immutable.c:1788:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:27.022 INFO:teuthology.orchestra.run.smithi156.stderr: 1788 | asprintf(&path, "%s/", dir); 2023-10-08T12:02:27.022 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:27.022 INFO:teuthology.orchestra.run.smithi156.stderr:t_immutable.c:1800:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:27.023 INFO:teuthology.orchestra.run.smithi156.stderr: 1800 | asprintf(&path, "%s/immutable.f", dir); 2023-10-08T12:02:27.023 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:27.023 INFO:teuthology.orchestra.run.smithi156.stderr:t_immutable.c:1812:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:27.023 INFO:teuthology.orchestra.run.smithi156.stderr: 1812 | asprintf(&path, "%s/append-only.f", dir); 2023-10-08T12:02:27.023 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:27.023 INFO:teuthology.orchestra.run.smithi156.stderr:t_immutable.c:1824:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:27.023 INFO:teuthology.orchestra.run.smithi156.stderr: 1824 | asprintf(&path, "%s/immutable.d", dir); 2023-10-08T12:02:27.023 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:27.023 INFO:teuthology.orchestra.run.smithi156.stderr:t_immutable.c:1837:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:27.023 INFO:teuthology.orchestra.run.smithi156.stderr: 1837 | asprintf(&path, "%s/append-only.d", dir); 2023-10-08T12:02:27.023 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:27.023 INFO:teuthology.orchestra.run.smithi156.stderr:t_immutable.c:1850:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:27.024 INFO:teuthology.orchestra.run.smithi156.stderr: 1850 | asprintf(&path, "%s/immutable.d/file", dir); 2023-10-08T12:02:27.024 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:27.024 INFO:teuthology.orchestra.run.smithi156.stderr:t_immutable.c:1862:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:27.024 INFO:teuthology.orchestra.run.smithi156.stderr: 1862 | asprintf(&path, "%s/append-only.d/file", dir); 2023-10-08T12:02:27.024 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:27.024 INFO:teuthology.orchestra.run.smithi156.stderr:t_immutable.c:1874:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:27.024 INFO:teuthology.orchestra.run.smithi156.stderr: 1874 | asprintf(&path, "%s/immutable.d/dir", dir); 2023-10-08T12:02:27.024 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:27.024 INFO:teuthology.orchestra.run.smithi156.stderr:t_immutable.c:1887:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:27.024 INFO:teuthology.orchestra.run.smithi156.stderr: 1887 | asprintf(&path, "%s/append-only.d/dir", dir); 2023-10-08T12:02:27.024 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:27.026 INFO:teuthology.orchestra.run.smithi156.stderr:t_immutable.c: In function 'test_immutable': 2023-10-08T12:02:27.026 INFO:teuthology.orchestra.run.smithi156.stderr:t_immutable.c:151:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:27.026 INFO:teuthology.orchestra.run.smithi156.stderr: 151 | asprintf(&path, "%s/immutable.f", dir); 2023-10-08T12:02:27.026 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:27.027 INFO:teuthology.orchestra.run.smithi156.stderr:t_immutable.c:381:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:27.027 INFO:teuthology.orchestra.run.smithi156.stderr: 381 | asprintf(&linkpath, "%s/immutable.f.hardlink", dir); 2023-10-08T12:02:27.027 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:27.027 INFO:teuthology.orchestra.run.smithi156.stderr:t_immutable.c:408:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:27.027 INFO:teuthology.orchestra.run.smithi156.stderr: 408 | chown(path, 0, 0); 2023-10-08T12:02:27.027 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~ 2023-10-08T12:02:27.027 INFO:teuthology.orchestra.run.smithi156.stderr:t_immutable.c:485:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:27.027 INFO:teuthology.orchestra.run.smithi156.stderr: 485 | asprintf(&linkpath, "%s/immutable.f.newname", dir); 2023-10-08T12:02:27.027 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:27.027 INFO:teuthology.orchestra.run.smithi156.stderr:t_immutable.c:532:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:27.027 INFO:teuthology.orchestra.run.smithi156.stderr: 532 | asprintf(&path, "%s/immutable.d/file", dir); 2023-10-08T12:02:27.027 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:27.028 INFO:teuthology.orchestra.run.smithi156.stderr:t_immutable.c:553:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:27.028 INFO:teuthology.orchestra.run.smithi156.stderr: 553 | chown(path, 0, 0); 2023-10-08T12:02:27.028 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~ 2023-10-08T12:02:27.028 INFO:teuthology.orchestra.run.smithi156.stderr:t_immutable.c:556:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:27.028 INFO:teuthology.orchestra.run.smithi156.stderr: 556 | asprintf(&linkpath, "%s/immutable.d/file.link", dir); 2023-10-08T12:02:27.028 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:27.028 INFO:teuthology.orchestra.run.smithi156.stderr:t_immutable.c:575:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:27.028 INFO:teuthology.orchestra.run.smithi156.stderr: 575 | asprintf(&linkpath, "%s/immutable.d/file.newname", dir); 2023-10-08T12:02:27.028 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:27.028 INFO:teuthology.orchestra.run.smithi156.stderr:t_immutable.c:595:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:27.028 INFO:teuthology.orchestra.run.smithi156.stderr: 595 | asprintf(&path, "%s/immutable.d/newfile", dir); 2023-10-08T12:02:27.028 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:27.029 INFO:teuthology.orchestra.run.smithi156.stderr:t_immutable.c:619:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:27.029 INFO:teuthology.orchestra.run.smithi156.stderr: 619 | asprintf(&path, "%s/immutable.d/newdir", dir); 2023-10-08T12:02:27.029 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:27.029 INFO:teuthology.orchestra.run.smithi156.stderr:t_immutable.c:631:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:27.029 INFO:teuthology.orchestra.run.smithi156.stderr: 631 | asprintf(&path, "%s/immutable.d/dir/newfile-%d", dir, getuid()); 2023-10-08T12:02:27.029 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:27.029 INFO:teuthology.orchestra.run.smithi156.stderr:t_immutable.c:653:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:27.029 INFO:teuthology.orchestra.run.smithi156.stderr: 653 | chown(path, 0, 0); 2023-10-08T12:02:27.029 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~ 2023-10-08T12:02:27.029 INFO:teuthology.orchestra.run.smithi156.stderr:t_immutable.c:657:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:27.029 INFO:teuthology.orchestra.run.smithi156.stderr: 657 | asprintf(&path, "%s/immutable.d/dir", dir); 2023-10-08T12:02:27.029 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:27.029 INFO:teuthology.orchestra.run.smithi156.stderr:t_immutable.c:668:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:27.030 INFO:teuthology.orchestra.run.smithi156.stderr: 668 | asprintf(&path, "%s/immutable.d", dir); 2023-10-08T12:02:27.030 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:27.030 INFO:teuthology.orchestra.run.smithi156.stderr:t_immutable.c:705:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:27.030 INFO:teuthology.orchestra.run.smithi156.stderr: 705 | chown(path, 0, 0); 2023-10-08T12:02:27.030 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~ 2023-10-08T12:02:27.030 INFO:teuthology.orchestra.run.smithi156.stderr:t_immutable.c:782:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:27.030 INFO:teuthology.orchestra.run.smithi156.stderr: 782 | asprintf(&path, "%s/empty-immutable.d", dir); 2023-10-08T12:02:27.030 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:27.032 INFO:teuthology.orchestra.run.smithi156.stderr:t_immutable.c: In function 'test_append': 2023-10-08T12:02:27.032 INFO:teuthology.orchestra.run.smithi156.stderr:t_immutable.c:822:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:27.032 INFO:teuthology.orchestra.run.smithi156.stderr: 822 | asprintf(&path, "%s/append-only.f", dir); 2023-10-08T12:02:27.033 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:27.033 INFO:teuthology.orchestra.run.smithi156.stderr:t_immutable.c:1024:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:27.033 INFO:teuthology.orchestra.run.smithi156.stderr: 1024 | asprintf(&linkpath, "%s/append-only.f.hardlink", dir); 2023-10-08T12:02:27.033 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:27.033 INFO:teuthology.orchestra.run.smithi156.stderr:t_immutable.c:1051:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:27.033 INFO:teuthology.orchestra.run.smithi156.stderr: 1051 | chown(path, 0, 0); 2023-10-08T12:02:27.033 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~ 2023-10-08T12:02:27.033 INFO:teuthology.orchestra.run.smithi156.stderr:t_immutable.c:1126:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:27.033 INFO:teuthology.orchestra.run.smithi156.stderr: 1126 | asprintf(&linkpath, "%s/append-only.f.newname", dir); 2023-10-08T12:02:27.033 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:27.034 INFO:teuthology.orchestra.run.smithi156.stderr:t_immutable.c:1495:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:27.034 INFO:teuthology.orchestra.run.smithi156.stderr: 1495 | asprintf(&path, "%s/append-only.d/file", dir); 2023-10-08T12:02:27.034 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:27.034 INFO:teuthology.orchestra.run.smithi156.stderr:t_immutable.c:1516:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:27.034 INFO:teuthology.orchestra.run.smithi156.stderr: 1516 | chown(path, 0, 0); 2023-10-08T12:02:27.034 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~ 2023-10-08T12:02:27.034 INFO:teuthology.orchestra.run.smithi156.stderr:t_immutable.c:1519:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:27.034 INFO:teuthology.orchestra.run.smithi156.stderr: 1519 | asprintf(&linkpath, "%s/append-only.d/file.link-%d", dir, getuid()); 2023-10-08T12:02:27.034 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:27.034 INFO:teuthology.orchestra.run.smithi156.stderr:t_immutable.c:1529:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:27.034 INFO:teuthology.orchestra.run.smithi156.stderr: 1529 | asprintf(&linkpath, "%s/append-only.d/file.symlink-%d", dir, getuid()); 2023-10-08T12:02:27.035 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:27.035 INFO:teuthology.orchestra.run.smithi156.stderr:t_immutable.c:1539:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:27.035 INFO:teuthology.orchestra.run.smithi156.stderr: 1539 | asprintf(&linkpath, "%s/append-only.d/file.newname", dir); 2023-10-08T12:02:27.035 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:27.035 INFO:teuthology.orchestra.run.smithi156.stderr:t_immutable.c:1559:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:27.035 INFO:teuthology.orchestra.run.smithi156.stderr: 1559 | asprintf(&path, "%s/append-only.d/newfile-%d", dir, getuid()); 2023-10-08T12:02:27.035 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:27.035 INFO:teuthology.orchestra.run.smithi156.stderr:t_immutable.c:1573:11: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:27.035 INFO:teuthology.orchestra.run.smithi156.stderr: 1573 | asprintf(&path, "%s/append-only.d/newdev-%d", dir, getuid()); 2023-10-08T12:02:27.035 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:27.035 INFO:teuthology.orchestra.run.smithi156.stderr:t_immutable.c:1586:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:27.035 INFO:teuthology.orchestra.run.smithi156.stderr: 1586 | asprintf(&path, "%s/append-only.d/newdir-%d", dir, getuid()); 2023-10-08T12:02:27.036 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:27.036 INFO:teuthology.orchestra.run.smithi156.stderr:t_immutable.c:1596:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:27.036 INFO:teuthology.orchestra.run.smithi156.stderr: 1596 | asprintf(&path, "%s/append-only.d/newdir-%d/newfile-%d", dir, getuid(), getuid()); 2023-10-08T12:02:27.036 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:27.036 INFO:teuthology.orchestra.run.smithi156.stderr:t_immutable.c:1618:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:27.036 INFO:teuthology.orchestra.run.smithi156.stderr: 1618 | chown(path, 0, 0); 2023-10-08T12:02:27.036 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~ 2023-10-08T12:02:27.036 INFO:teuthology.orchestra.run.smithi156.stderr:t_immutable.c:1622:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:27.036 INFO:teuthology.orchestra.run.smithi156.stderr: 1622 | asprintf(&path, "%s/append-only.d/dir/newfile-%d", dir, getuid()); 2023-10-08T12:02:27.036 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:27.036 INFO:teuthology.orchestra.run.smithi156.stderr:t_immutable.c:1644:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:27.036 INFO:teuthology.orchestra.run.smithi156.stderr: 1644 | chown(path, 0, 0); 2023-10-08T12:02:27.036 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~ 2023-10-08T12:02:27.037 INFO:teuthology.orchestra.run.smithi156.stderr:t_immutable.c:1648:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:27.037 INFO:teuthology.orchestra.run.smithi156.stderr: 1648 | asprintf(&path, "%s/append-only.d/dir", dir); 2023-10-08T12:02:27.037 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:27.037 INFO:teuthology.orchestra.run.smithi156.stderr:t_immutable.c:1659:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:27.037 INFO:teuthology.orchestra.run.smithi156.stderr: 1659 | asprintf(&path, "%s/append-only.d", dir); 2023-10-08T12:02:27.037 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:27.037 INFO:teuthology.orchestra.run.smithi156.stderr:t_immutable.c:1692:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:27.037 INFO:teuthology.orchestra.run.smithi156.stderr: 1692 | chown(path, 0, 0); 2023-10-08T12:02:27.037 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~ 2023-10-08T12:02:27.037 INFO:teuthology.orchestra.run.smithi156.stderr:t_immutable.c:1769:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:27.037 INFO:teuthology.orchestra.run.smithi156.stderr: 1769 | asprintf(&path, "%s/empty-append-only.d", dir); 2023-10-08T12:02:27.037 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:27.582 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] stale_handle 2023-10-08T12:02:27.739 INFO:teuthology.orchestra.run.smithi156.stderr:stale_handle.c: In function 'main': 2023-10-08T12:02:27.739 INFO:teuthology.orchestra.run.smithi156.stderr:stale_handle.c:102:9: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:27.739 INFO:teuthology.orchestra.run.smithi156.stderr: 102 | system("echo 3 > /proc/sys/vm/drop_caches"); 2023-10-08T12:02:27.739 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:27.796 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] pwrite_mmap_blocked 2023-10-08T12:02:27.990 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] t_dir_offset2 2023-10-08T12:02:28.225 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] seek_sanity_test 2023-10-08T12:02:28.391 INFO:teuthology.orchestra.run.smithi156.stderr:seek_sanity_test.c: In function 'test18': 2023-10-08T12:02:28.391 INFO:teuthology.orchestra.run.smithi156.stderr:seek_sanity_test.c:460:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:28.391 INFO:teuthology.orchestra.run.smithi156.stderr: 460 | ftruncate(fd, 0); 2023-10-08T12:02:28.391 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~ 2023-10-08T12:02:28.393 INFO:teuthology.orchestra.run.smithi156.stderr:seek_sanity_test.c: In function 'test_basic_support': 2023-10-08T12:02:28.394 INFO:teuthology.orchestra.run.smithi156.stderr:seek_sanity_test.c:1207:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:28.394 INFO:teuthology.orchestra.run.smithi156.stderr: 1207 | ftruncate(fd, 0); 2023-10-08T12:02:28.394 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~ 2023-10-08T12:02:28.394 INFO:teuthology.orchestra.run.smithi156.stderr:seek_sanity_test.c:1256:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:28.394 INFO:teuthology.orchestra.run.smithi156.stderr: 1256 | ftruncate(fd, 0); 2023-10-08T12:02:28.394 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~ 2023-10-08T12:02:28.395 INFO:teuthology.orchestra.run.smithi156.stderr:seek_sanity_test.c: In function 'get_io_sizes': 2023-10-08T12:02:28.395 INFO:teuthology.orchestra.run.smithi156.stderr:seek_sanity_test.c:88:17: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:28.395 INFO:teuthology.orchestra.run.smithi156.stderr: 88 | ftruncate(fd, 0); 2023-10-08T12:02:28.395 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~ 2023-10-08T12:02:28.395 INFO:teuthology.orchestra.run.smithi156.stderr:seek_sanity_test.c:89:17: warning: ignoring return value of 'pwrite' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:28.395 INFO:teuthology.orchestra.run.smithi156.stderr: 89 | pwrite(fd, "a", 1, offset); 2023-10-08T12:02:28.395 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:28.395 INFO:teuthology.orchestra.run.smithi156.stderr:seek_sanity_test.c:98:17: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:28.395 INFO:teuthology.orchestra.run.smithi156.stderr: 98 | ftruncate(fd, 0); 2023-10-08T12:02:28.396 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~ 2023-10-08T12:02:28.396 INFO:teuthology.orchestra.run.smithi156.stderr:seek_sanity_test.c:99:17: warning: ignoring return value of 'pwrite' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:28.396 INFO:teuthology.orchestra.run.smithi156.stderr: 99 | pwrite(fd, "a", 1, offset); 2023-10-08T12:02:28.396 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:28.715 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] seek_copy_test 2023-10-08T12:02:28.934 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] t_readdir_1 2023-10-08T12:02:29.081 INFO:teuthology.orchestra.run.smithi156.stderr:t_readdir_1.c: In function 'main': 2023-10-08T12:02:29.081 INFO:teuthology.orchestra.run.smithi156.stderr:t_readdir_1.c:30:25: warning: ignoring return value of 'read' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:29.082 INFO:teuthology.orchestra.run.smithi156.stderr: 30 | read(fd, buf, 100); 2023-10-08T12:02:29.082 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:29.123 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] t_readdir_2 2023-10-08T12:02:29.314 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] fsync-tester 2023-10-08T12:02:29.463 INFO:teuthology.orchestra.run.smithi156.stderr:fsync-tester.c: In function 'main': 2023-10-08T12:02:29.463 INFO:teuthology.orchestra.run.smithi156.stderr:fsync-tester.c:391:17: warning: ignoring return value of 'read' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:29.463 INFO:teuthology.orchestra.run.smithi156.stderr: 391 | read(fd, &seed, sizeof(seed)); 2023-10-08T12:02:29.463 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:29.463 INFO:teuthology.orchestra.run.smithi156.stderr:fsync-tester.c:541:17: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:29.463 INFO:teuthology.orchestra.run.smithi156.stderr: 541 | system("reboot -fn"); 2023-10-08T12:02:29.463 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:29.464 INFO:teuthology.orchestra.run.smithi156.stderr:fsync-tester.c: In function 'drop_all_caches': 2023-10-08T12:02:29.464 INFO:teuthology.orchestra.run.smithi156.stderr:fsync-tester.c:90:9: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:29.464 INFO:teuthology.orchestra.run.smithi156.stderr: 90 | write(fd, value, sizeof(value)-1); 2023-10-08T12:02:29.464 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:29.617 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] nsexec 2023-10-08T12:02:29.838 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] cloner 2023-10-08T12:02:30.056 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] renameat2 2023-10-08T12:02:30.264 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] t_getcwd 2023-10-08T12:02:30.412 INFO:teuthology.orchestra.run.smithi156.stderr:t_getcwd.c: In function 'test_getcwd': 2023-10-08T12:02:30.412 INFO:teuthology.orchestra.run.smithi156.stderr:t_getcwd.c:21:17: warning: ignoring return value of 'getcwd' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:30.412 INFO:teuthology.orchestra.run.smithi156.stderr: 21 | getcwd(cur_cwd, BUF_SIZE); 2023-10-08T12:02:30.412 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:30.466 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] e4compact 2023-10-08T12:02:30.712 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] test-nextquota 2023-10-08T12:02:30.928 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] punch-alternating 2023-10-08T12:02:31.142 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] attr-list-by-handle-cursor-test 2023-10-08T12:02:31.352 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] listxattr 2023-10-08T12:02:31.536 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] dio-interleaved 2023-10-08T12:02:31.739 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] t_dir_type 2023-10-08T12:02:31.936 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] dio-invalidate-cache 2023-10-08T12:02:32.085 INFO:teuthology.orchestra.run.smithi156.stderr:dio-invalidate-cache.c: In function 'main': 2023-10-08T12:02:32.085 INFO:teuthology.orchestra.run.smithi156.stderr:dio-invalidate-cache.c:286:17: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:32.085 INFO:teuthology.orchestra.run.smithi156.stderr: 286 | write(fd, buf, blksz * nr_child); 2023-10-08T12:02:32.085 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:32.182 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] stat_test 2023-10-08T12:02:32.516 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] t_encrypted_d_revalidate 2023-10-08T12:02:32.723 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] attr_replace_test 2023-10-08T12:02:32.927 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] swapon 2023-10-08T12:02:33.136 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] mkswap 2023-10-08T12:02:33.328 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] t_attr_corruption 2023-10-08T12:02:33.518 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] t_open_tmpfiles 2023-10-08T12:02:33.741 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] fscrypt-crypt-util 2023-10-08T12:02:34.456 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] bulkstat_null_ocount 2023-10-08T12:02:34.655 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] splice-test 2023-10-08T12:02:34.879 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] chprojid_fail 2023-10-08T12:02:35.084 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] detached_mounts_propagation 2023-10-08T12:02:35.313 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] ext4_resize 2023-10-08T12:02:35.502 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] t_readdir_3 2023-10-08T12:02:35.739 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] splice2pipe 2023-10-08T12:02:35.886 INFO:teuthology.orchestra.run.smithi156.stderr:splice2pipe.c: In function 'prepare_pipe': 2023-10-08T12:02:35.886 INFO:teuthology.orchestra.run.smithi156.stderr:splice2pipe.c:57:17: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:35.886 INFO:teuthology.orchestra.run.smithi156.stderr: 57 | write(p[1], buffer, n); 2023-10-08T12:02:35.886 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:35.886 INFO:teuthology.orchestra.run.smithi156.stderr:splice2pipe.c:65:17: warning: ignoring return value of 'read' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:35.886 INFO:teuthology.orchestra.run.smithi156.stderr: 65 | read(p[0], buffer, n); 2023-10-08T12:02:35.886 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:35.943 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] uuid_ioctl 2023-10-08T12:02:36.141 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] fiemap-tester 2023-10-08T12:02:36.448 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] t_stripealign 2023-10-08T12:02:36.643 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] open_by_handle 2023-10-08T12:02:36.933 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] t_mmap_dio 2023-10-08T12:02:37.137 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] xfsfind 2023-10-08T12:02:37.377 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] fssum 2023-10-08T12:02:37.867 INFO:teuthology.orchestra.run.smithi156.stdout:Building log-writes 2023-10-08T12:02:37.876 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] replay-log 2023-10-08T12:02:38.256 INFO:teuthology.orchestra.run.smithi156.stdout:Building perf 2023-10-08T12:02:38.262 INFO:teuthology.orchestra.run.smithi156.stdout:Building aio-dio-regress 2023-10-08T12:02:38.272 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] aiocp 2023-10-08T12:02:38.550 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] aio-dio-append-write-fallocate-race 2023-10-08T12:02:38.770 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] aio-dio-append-write-read-race 2023-10-08T12:02:38.997 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] aio-dio-cow-race 2023-10-08T12:02:39.201 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] aio-dio-cycle-write 2023-10-08T12:02:39.349 INFO:teuthology.orchestra.run.smithi156.stderr:aio-dio-cycle-write.c: In function 'init_test': 2023-10-08T12:02:39.349 INFO:teuthology.orchestra.run.smithi156.stderr:aio-dio-cycle-write.c:83:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:39.349 INFO:teuthology.orchestra.run.smithi156.stderr: 83 | ftruncate(fd, buf_size); 2023-10-08T12:02:39.349 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:39.439 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] aio-dio-eof-race 2023-10-08T12:02:39.676 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] aio-dio-extend-stat 2023-10-08T12:02:39.889 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] aio-dio-fcntl-race 2023-10-08T12:02:40.100 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] aio-dio-hole-filling-race 2023-10-08T12:02:40.298 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] aio-dio-invalidate-failure 2023-10-08T12:02:40.508 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] aio-dio-invalidate-readahead 2023-10-08T12:02:40.727 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] aiodio_sparse2 2023-10-08T12:02:40.875 INFO:teuthology.orchestra.run.smithi156.stderr:aiodio_sparse2.c: In function 'aiodio_sparse': 2023-10-08T12:02:40.875 INFO:teuthology.orchestra.run.smithi156.stderr:aiodio_sparse2.c:111:17: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:40.875 INFO:teuthology.orchestra.run.smithi156.stderr: 111 | ftruncate(fd, filesize); 2023-10-08T12:02:40.876 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:40.876 INFO:teuthology.orchestra.run.smithi156.stderr:aiodio_sparse2.c: In function 'dirty_freeblocks': 2023-10-08T12:02:40.876 INFO:teuthology.orchestra.run.smithi156.stderr:aiodio_sparse2.c:274:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-10-08T12:02:40.876 INFO:teuthology.orchestra.run.smithi156.stderr: 274 | ftruncate(fd, size); 2023-10-08T12:02:40.876 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~~~~~~~~~~ 2023-10-08T12:02:40.997 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] aio-dio-subblock-eof-read 2023-10-08T12:02:41.191 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] aio-dio-write-verify 2023-10-08T12:02:41.440 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2023-10-08T12:02:41.620 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2023-10-08T12:02:41.799 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] aio-last-ref-held-by-io 2023-10-08T12:02:42.027 INFO:teuthology.orchestra.run.smithi156.stdout:Building vfs 2023-10-08T12:02:42.036 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] vfstest 2023-10-08T12:02:44.444 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] mount-idmapped 2023-10-08T12:02:44.884 INFO:teuthology.orchestra.run.smithi156.stdout:Building m4 2023-10-08T12:02:44.891 INFO:teuthology.orchestra.run.smithi156.stdout:Building common 2023-10-08T12:02:44.897 INFO:teuthology.orchestra.run.smithi156.stdout:Building tests 2023-10-08T12:02:44.906 INFO:teuthology.orchestra.run.smithi156.stdout:Building btrfs 2023-10-08T12:02:44.916 INFO:teuthology.orchestra.run.smithi156.stdout: [GROUP] /tmp/tmp.3RpD2mKkbxxfstests-dev/tests/btrfs/group.list 2023-10-08T12:02:45.050 INFO:teuthology.orchestra.run.smithi156.stdout:Building ceph 2023-10-08T12:02:45.058 INFO:teuthology.orchestra.run.smithi156.stdout: [GROUP] /tmp/tmp.3RpD2mKkbxxfstests-dev/tests/ceph/group.list 2023-10-08T12:02:45.091 INFO:teuthology.orchestra.run.smithi156.stdout:Building cifs 2023-10-08T12:02:45.099 INFO:teuthology.orchestra.run.smithi156.stdout: [GROUP] /tmp/tmp.3RpD2mKkbxxfstests-dev/tests/cifs/group.list 2023-10-08T12:02:45.128 INFO:teuthology.orchestra.run.smithi156.stdout:Building ext4 2023-10-08T12:02:45.137 INFO:teuthology.orchestra.run.smithi156.stdout: [GROUP] /tmp/tmp.3RpD2mKkbxxfstests-dev/tests/ext4/group.list 2023-10-08T12:02:45.223 INFO:teuthology.orchestra.run.smithi156.stdout:Building f2fs 2023-10-08T12:02:45.231 INFO:teuthology.orchestra.run.smithi156.stdout: [GROUP] /tmp/tmp.3RpD2mKkbxxfstests-dev/tests/f2fs/group.list 2023-10-08T12:02:45.270 INFO:teuthology.orchestra.run.smithi156.stdout:Building generic 2023-10-08T12:02:45.282 INFO:teuthology.orchestra.run.smithi156.stdout: [GROUP] /tmp/tmp.3RpD2mKkbxxfstests-dev/tests/generic/group.list 2023-10-08T12:02:45.502 INFO:teuthology.orchestra.run.smithi156.stdout:Building nfs 2023-10-08T12:02:45.511 INFO:teuthology.orchestra.run.smithi156.stdout: [GROUP] /tmp/tmp.3RpD2mKkbxxfstests-dev/tests/nfs/group.list 2023-10-08T12:02:45.544 INFO:teuthology.orchestra.run.smithi156.stdout:Building ocfs2 2023-10-08T12:02:45.552 INFO:teuthology.orchestra.run.smithi156.stdout: [GROUP] /tmp/tmp.3RpD2mKkbxxfstests-dev/tests/ocfs2/group.list 2023-10-08T12:02:45.582 INFO:teuthology.orchestra.run.smithi156.stdout:Building overlay 2023-10-08T12:02:45.591 INFO:teuthology.orchestra.run.smithi156.stdout: [GROUP] /tmp/tmp.3RpD2mKkbxxfstests-dev/tests/overlay/group.list 2023-10-08T12:02:45.681 INFO:teuthology.orchestra.run.smithi156.stdout:Building perf 2023-10-08T12:02:45.689 INFO:teuthology.orchestra.run.smithi156.stdout: [GROUP] /tmp/tmp.3RpD2mKkbxxfstests-dev/tests/perf/group.list 2023-10-08T12:02:45.715 INFO:teuthology.orchestra.run.smithi156.stdout:Building selftest 2023-10-08T12:02:45.725 INFO:teuthology.orchestra.run.smithi156.stdout: [GROUP] /tmp/tmp.3RpD2mKkbxxfstests-dev/tests/selftest/group.list 2023-10-08T12:02:45.752 INFO:teuthology.orchestra.run.smithi156.stdout:Building shared 2023-10-08T12:02:45.761 INFO:teuthology.orchestra.run.smithi156.stdout: [GROUP] /tmp/tmp.3RpD2mKkbxxfstests-dev/tests/shared/group.list 2023-10-08T12:02:45.800 INFO:teuthology.orchestra.run.smithi156.stdout:Building tmpfs 2023-10-08T12:02:45.809 INFO:teuthology.orchestra.run.smithi156.stdout: [GROUP] /tmp/tmp.3RpD2mKkbxxfstests-dev/tests/tmpfs/group.list 2023-10-08T12:02:45.840 INFO:teuthology.orchestra.run.smithi156.stdout:Building udf 2023-10-08T12:02:45.848 INFO:teuthology.orchestra.run.smithi156.stdout: [GROUP] /tmp/tmp.3RpD2mKkbxxfstests-dev/tests/udf/group.list 2023-10-08T12:02:45.874 INFO:teuthology.orchestra.run.smithi156.stdout:Building xfs 2023-10-08T12:02:45.885 INFO:teuthology.orchestra.run.smithi156.stdout: [GROUP] /tmp/tmp.3RpD2mKkbxxfstests-dev/tests/xfs/group.list 2023-10-08T12:02:46.108 DEBUG:teuthology.orchestra.run.smithi156:> (cd /tmp/tmp.3RpD2mKkbxxfstests-dev && exec sudo make install) 2023-10-08T12:02:46.150 INFO:teuthology.orchestra.run.smithi156.stdout:Building include 2023-10-08T12:02:46.157 INFO:teuthology.orchestra.run.smithi156.stdout:Building lib 2023-10-08T12:02:46.164 INFO:teuthology.orchestra.run.smithi156.stdout:Building ltp 2023-10-08T12:02:46.171 INFO:teuthology.orchestra.run.smithi156.stdout:Building src 2023-10-08T12:02:46.226 INFO:teuthology.orchestra.run.smithi156.stdout:Building log-writes 2023-10-08T12:02:46.232 INFO:teuthology.orchestra.run.smithi156.stdout:Building perf 2023-10-08T12:02:46.238 INFO:teuthology.orchestra.run.smithi156.stdout:Building aio-dio-regress 2023-10-08T12:02:46.246 INFO:teuthology.orchestra.run.smithi156.stdout:Building vfs 2023-10-08T12:02:46.252 INFO:teuthology.orchestra.run.smithi156.stdout:Building m4 2023-10-08T12:02:46.259 INFO:teuthology.orchestra.run.smithi156.stdout:Building common 2023-10-08T12:02:46.265 INFO:teuthology.orchestra.run.smithi156.stdout:Building tests 2023-10-08T12:02:46.274 INFO:teuthology.orchestra.run.smithi156.stdout:Building btrfs 2023-10-08T12:02:46.284 INFO:teuthology.orchestra.run.smithi156.stdout: [GROUP] /tmp/tmp.3RpD2mKkbxxfstests-dev/tests/btrfs/group.list 2023-10-08T12:02:46.415 INFO:teuthology.orchestra.run.smithi156.stdout:Building ceph 2023-10-08T12:02:46.424 INFO:teuthology.orchestra.run.smithi156.stdout: [GROUP] /tmp/tmp.3RpD2mKkbxxfstests-dev/tests/ceph/group.list 2023-10-08T12:02:46.457 INFO:teuthology.orchestra.run.smithi156.stdout:Building cifs 2023-10-08T12:02:46.465 INFO:teuthology.orchestra.run.smithi156.stdout: [GROUP] /tmp/tmp.3RpD2mKkbxxfstests-dev/tests/cifs/group.list 2023-10-08T12:02:46.494 INFO:teuthology.orchestra.run.smithi156.stdout:Building ext4 2023-10-08T12:02:46.503 INFO:teuthology.orchestra.run.smithi156.stdout: [GROUP] /tmp/tmp.3RpD2mKkbxxfstests-dev/tests/ext4/group.list 2023-10-08T12:02:46.587 INFO:teuthology.orchestra.run.smithi156.stdout:Building f2fs 2023-10-08T12:02:46.595 INFO:teuthology.orchestra.run.smithi156.stdout: [GROUP] /tmp/tmp.3RpD2mKkbxxfstests-dev/tests/f2fs/group.list 2023-10-08T12:02:46.636 INFO:teuthology.orchestra.run.smithi156.stdout:Building generic 2023-10-08T12:02:46.646 INFO:teuthology.orchestra.run.smithi156.stdout: [GROUP] /tmp/tmp.3RpD2mKkbxxfstests-dev/tests/generic/group.list 2023-10-08T12:02:46.859 INFO:teuthology.orchestra.run.smithi156.stdout:Building nfs 2023-10-08T12:02:46.867 INFO:teuthology.orchestra.run.smithi156.stdout: [GROUP] /tmp/tmp.3RpD2mKkbxxfstests-dev/tests/nfs/group.list 2023-10-08T12:02:46.900 INFO:teuthology.orchestra.run.smithi156.stdout:Building ocfs2 2023-10-08T12:02:46.908 INFO:teuthology.orchestra.run.smithi156.stdout: [GROUP] /tmp/tmp.3RpD2mKkbxxfstests-dev/tests/ocfs2/group.list 2023-10-08T12:02:46.939 INFO:teuthology.orchestra.run.smithi156.stdout:Building overlay 2023-10-08T12:02:46.950 INFO:teuthology.orchestra.run.smithi156.stdout: [GROUP] /tmp/tmp.3RpD2mKkbxxfstests-dev/tests/overlay/group.list 2023-10-08T12:02:47.038 INFO:teuthology.orchestra.run.smithi156.stdout:Building perf 2023-10-08T12:02:47.046 INFO:teuthology.orchestra.run.smithi156.stdout: [GROUP] /tmp/tmp.3RpD2mKkbxxfstests-dev/tests/perf/group.list 2023-10-08T12:02:47.072 INFO:teuthology.orchestra.run.smithi156.stdout:Building selftest 2023-10-08T12:02:47.081 INFO:teuthology.orchestra.run.smithi156.stdout: [GROUP] /tmp/tmp.3RpD2mKkbxxfstests-dev/tests/selftest/group.list 2023-10-08T12:02:47.110 INFO:teuthology.orchestra.run.smithi156.stdout:Building shared 2023-10-08T12:02:47.118 INFO:teuthology.orchestra.run.smithi156.stdout: [GROUP] /tmp/tmp.3RpD2mKkbxxfstests-dev/tests/shared/group.list 2023-10-08T12:02:47.158 INFO:teuthology.orchestra.run.smithi156.stdout:Building tmpfs 2023-10-08T12:02:47.167 INFO:teuthology.orchestra.run.smithi156.stdout: [GROUP] /tmp/tmp.3RpD2mKkbxxfstests-dev/tests/tmpfs/group.list 2023-10-08T12:02:47.197 INFO:teuthology.orchestra.run.smithi156.stdout:Building udf 2023-10-08T12:02:47.206 INFO:teuthology.orchestra.run.smithi156.stdout: [GROUP] /tmp/tmp.3RpD2mKkbxxfstests-dev/tests/udf/group.list 2023-10-08T12:02:47.232 INFO:teuthology.orchestra.run.smithi156.stdout:Building xfs 2023-10-08T12:02:47.243 INFO:teuthology.orchestra.run.smithi156.stdout: [GROUP] /tmp/tmp.3RpD2mKkbxxfstests-dev/tests/xfs/group.list 2023-10-08T12:02:47.458 INFO:teuthology.orchestra.run.smithi156.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2023-10-08T12:02:47.462 INFO:teuthology.orchestra.run.smithi156.stdout:gmake[1]: Nothing to be done for 'install'. 2023-10-08T12:02:47.462 INFO:teuthology.orchestra.run.smithi156.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2023-10-08T12:02:47.467 INFO:teuthology.orchestra.run.smithi156.stdout:gmake[1]: Nothing to be done for 'install'. 2023-10-08T12:02:47.467 INFO:teuthology.orchestra.run.smithi156.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2023-10-08T12:02:47.471 INFO:teuthology.orchestra.run.smithi156.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2023-10-08T12:02:47.491 INFO:teuthology.orchestra.run.smithi156.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2023-10-08T12:02:47.650 INFO:teuthology.orchestra.run.smithi156.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2023-10-08T12:02:47.670 INFO:teuthology.orchestra.run.smithi156.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2023-10-08T12:02:47.699 INFO:teuthology.orchestra.run.smithi156.stdout:Building log-writes 2023-10-08T12:02:47.705 INFO:teuthology.orchestra.run.smithi156.stdout:Building perf 2023-10-08T12:02:47.712 INFO:teuthology.orchestra.run.smithi156.stdout:Building aio-dio-regress 2023-10-08T12:02:47.719 INFO:teuthology.orchestra.run.smithi156.stdout:Building vfs 2023-10-08T12:02:47.724 INFO:teuthology.orchestra.run.smithi156.stdout:/usr/bin/gmake -C log-writes install 2023-10-08T12:02:47.728 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2023-10-08T12:02:47.748 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2023-10-08T12:02:47.769 INFO:teuthology.orchestra.run.smithi156.stdout:/usr/bin/gmake -C perf install 2023-10-08T12:02:47.773 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2023-10-08T12:02:47.793 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 755 FioCompare.py fio-insert-and-compare.py FioResultDecoder.py generate-schema.py ResultData.py fio-results.sql /var/lib/xfstests/src/perf 2023-10-08T12:02:47.842 INFO:teuthology.orchestra.run.smithi156.stdout:/usr/bin/gmake -C aio-dio-regress install 2023-10-08T12:02:47.846 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2023-10-08T12:02:47.866 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 755 aiocp aio-dio-append-write-fallocate-race aio-dio-append-write-read-race aio-dio-cow-race aio-dio-cycle-write aio-dio-eof-race aio-dio-extend-stat aio-dio-fcntl-race aio-dio-hole-filling-race aio-dio-invalidate-failure aio-dio-invalidate-readahead aiodio_sparse2 aio-dio-subblock-eof-read aio-dio-write-verify aio-free-ring-with-bogus-nr-pages aio-io-setup-with-nonwritable-context-pointer aio-last-ref-held-by-io /var/lib/xfstests/src/aio-dio-regress 2023-10-08T12:02:47.980 INFO:teuthology.orchestra.run.smithi156.stdout:/usr/bin/gmake -C vfs install 2023-10-08T12:02:47.984 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2023-10-08T12:02:48.004 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2023-10-08T12:02:48.032 INFO:teuthology.orchestra.run.smithi156.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2023-10-08T12:02:48.052 INFO:teuthology.orchestra.run.smithi156.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl fiemap-tester t_stripealign open_by_handle t_mmap_dio xfsfind fssum /var/lib/xfstests/src 2023-10-08T12:02:48.912 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:02:48.915 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:02:48.917 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:02:50.783 INFO:teuthology.orchestra.run.smithi156.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py soak_duration.awk /var/lib/xfstests/src 2023-10-08T12:02:51.004 INFO:teuthology.orchestra.run.smithi156.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2023-10-08T12:02:51.051 INFO:teuthology.orchestra.run.smithi156.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2023-10-08T12:02:51.055 INFO:teuthology.orchestra.run.smithi156.stdout:gmake[1]: Nothing to be done for 'install'. 2023-10-08T12:02:51.055 INFO:teuthology.orchestra.run.smithi156.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2023-10-08T12:02:51.058 INFO:teuthology.orchestra.run.smithi156.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2023-10-08T12:02:51.079 INFO:teuthology.orchestra.run.smithi156.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2023-10-08T12:02:51.364 INFO:teuthology.orchestra.run.smithi156.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2023-10-08T12:02:51.367 INFO:teuthology.orchestra.run.smithi156.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.3RpD2mKkbxxfstests-dev/tests/btrfs/ install 2023-10-08T12:02:51.373 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2023-10-08T12:02:51.393 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 299 300 /var/lib/xfstests/tests/btrfs 2023-10-08T12:02:53.113 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2023-10-08T12:02:53.133 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 299.out 300.out /var/lib/xfstests/tests/btrfs 2023-10-08T12:02:54.874 INFO:teuthology.orchestra.run.smithi156.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.3RpD2mKkbxxfstests-dev/tests/ceph/ install 2023-10-08T12:02:54.878 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2023-10-08T12:02:54.898 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2023-10-08T12:02:54.942 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2023-10-08T12:02:54.962 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out /var/lib/xfstests/tests/ceph 2023-10-08T12:02:55.005 INFO:teuthology.orchestra.run.smithi156.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.3RpD2mKkbxxfstests-dev/tests/cifs/ install 2023-10-08T12:02:55.010 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2023-10-08T12:02:55.029 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2023-10-08T12:02:55.050 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2023-10-08T12:02:55.070 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2023-10-08T12:02:55.091 INFO:teuthology.orchestra.run.smithi156.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.3RpD2mKkbxxfstests-dev/tests/ext4/ install 2023-10-08T12:02:55.096 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2023-10-08T12:02:55.115 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2023-10-08T12:02:55.517 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2023-10-08T12:02:55.537 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 644 001.out.default 001.out.nodelalloc 001.out.nozero 001.cfg 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 271.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out /var/lib/xfstests/tests/ext4 2023-10-08T12:02:55.961 INFO:teuthology.orchestra.run.smithi156.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.3RpD2mKkbxxfstests-dev/tests/f2fs/ install 2023-10-08T12:02:55.965 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2023-10-08T12:02:55.985 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2023-10-08T12:02:56.011 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2023-10-08T12:02:56.031 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2023-10-08T12:02:56.057 INFO:teuthology.orchestra.run.smithi156.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.3RpD2mKkbxxfstests-dev/tests/generic/ install 2023-10-08T12:02:56.065 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2023-10-08T12:02:56.085 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 /var/lib/xfstests/tests/generic 2023-10-08T12:03:00.282 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2023-10-08T12:03:00.302 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 644 035.out.default 035.out.nfs 050.out.default 050.out.nojournal 050.out.xfsquota 035.cfg 050.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 607.out 608.out 609.out 610.out 611.out 612.out 613.out 614.out 615.out 616.out 617.out 618.out 619.out 620.out 621.out 622.out 623.out 624.out 625.out 626.out 627.out 628.out 629.out 630.out 631.out 632.out 633.out 634.out 635.out 636.out 637.out 638.out 639.out 640.out 641.out 642.out 643.out 644.out 645.out 646.out 647.out 648.out 649.out 650.out 651.out 652.out 653.out 654.out 655.out 656.out 657.out 658.out 659.out 660.out 661.out 662.out 663.out 664.out 665.out 666.out 667.out 668.out 669.out 670.out 671.out 672.out 673.out 674.out 675.out 676.out 677.out 678.out 679.out 680.out 681.out 682.out 683.out 684.out 685.out 686.out 687.out 688.out 689.out 690.out 691.out 692.out 693.out 694.out 695.out 696.out 697.out 698.out 699.out 700.out 701.out 702.out 703.out 704.out 705.out 706.out 707.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out /var/lib/xfstests/tests/generic 2023-10-08T12:03:04.565 INFO:teuthology.orchestra.run.smithi156.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.3RpD2mKkbxxfstests-dev/tests/nfs/ install 2023-10-08T12:03:04.569 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2023-10-08T12:03:04.589 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2023-10-08T12:03:04.609 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2023-10-08T12:03:04.629 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2023-10-08T12:03:04.650 INFO:teuthology.orchestra.run.smithi156.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.3RpD2mKkbxxfstests-dev/tests/ocfs2/ install 2023-10-08T12:03:04.654 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2023-10-08T12:03:04.674 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2023-10-08T12:03:04.694 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2023-10-08T12:03:04.714 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2023-10-08T12:03:04.735 INFO:teuthology.orchestra.run.smithi156.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.3RpD2mKkbxxfstests-dev/tests/overlay/ install 2023-10-08T12:03:04.739 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2023-10-08T12:03:04.759 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2023-10-08T12:03:05.336 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2023-10-08T12:03:05.357 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out /var/lib/xfstests/tests/overlay 2023-10-08T12:03:05.933 INFO:teuthology.orchestra.run.smithi156.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.3RpD2mKkbxxfstests-dev/tests/perf/ install 2023-10-08T12:03:05.937 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2023-10-08T12:03:05.957 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2023-10-08T12:03:05.978 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2023-10-08T12:03:05.997 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2023-10-08T12:03:06.018 INFO:teuthology.orchestra.run.smithi156.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.3RpD2mKkbxxfstests-dev/tests/selftest/ install 2023-10-08T12:03:06.022 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2023-10-08T12:03:06.042 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2023-10-08T12:03:06.090 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2023-10-08T12:03:06.111 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out /var/lib/xfstests/tests/selftest 2023-10-08T12:03:06.159 INFO:teuthology.orchestra.run.smithi156.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.3RpD2mKkbxxfstests-dev/tests/shared/ install 2023-10-08T12:03:06.163 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2023-10-08T12:03:06.184 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2023-10-08T12:03:06.216 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2023-10-08T12:03:06.236 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 644 002.out 032.out 298.out /var/lib/xfstests/tests/shared 2023-10-08T12:03:06.268 INFO:teuthology.orchestra.run.smithi156.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.3RpD2mKkbxxfstests-dev/tests/tmpfs/ install 2023-10-08T12:03:06.271 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2023-10-08T12:03:06.292 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2023-10-08T12:03:06.313 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2023-10-08T12:03:06.333 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2023-10-08T12:03:06.354 INFO:teuthology.orchestra.run.smithi156.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.3RpD2mKkbxxfstests-dev/tests/udf/ install 2023-10-08T12:03:06.358 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2023-10-08T12:03:06.378 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2023-10-08T12:03:06.398 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2023-10-08T12:03:06.418 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2023-10-08T12:03:06.439 INFO:teuthology.orchestra.run.smithi156.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.3RpD2mKkbxxfstests-dev/tests/xfs/ install 2023-10-08T12:03:06.446 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2023-10-08T12:03:06.467 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2023-10-08T12:03:10.460 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2023-10-08T12:03:10.481 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 644 033.out.crc 033.out.default 071.out.32 071.out.64 096.out.external 096.out.internal 216.out.64mblog 216.out.classic 033.cfg 216.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out 740.out 741.out 742.out 743.out 744.out 745.out 746.out 747.out 748.out 749.out 750.out 751.out 752.out 753.out 754.out 755.out 756.out 757.out 758.out 759.out 760.out 761.out 762.out 763.out 764.out 765.out 766.out 767.out 768.out 769.out 770.out 771.out 772.out 773.out 774.out 775.out 776.out 777.out 778.out 779.out 780.out 781.out 782.out 783.out 784.out 785.out 786.out 787.out 788.out 789.out 790.out 791.out 792.out 793.out 794.out 795.out 796.out 797.out 798.out 799.out 800.out /var/lib/xfstests/tests/xfs 2023-10-08T12:03:14.538 INFO:teuthology.orchestra.run.smithi156.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2023-10-08T12:03:14.558 INFO:teuthology.orchestra.run.smithi156.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2023-10-08T12:03:14.578 INFO:teuthology.orchestra.run.smithi156.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2023-10-08T12:03:14.598 INFO:teuthology.orchestra.run.smithi156.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2023-10-08T12:03:14.622 DEBUG:teuthology.orchestra.run.smithi156:> (cd /tmp/tmp.yqkYNsO2b0xfsprogs-dev && exec sudo make) 2023-10-08T12:03:14.648 INFO:teuthology.orchestra.run.smithi156.stdout:libtoolize -c -i -f 2023-10-08T12:03:14.862 INFO:teuthology.orchestra.run.smithi156.stdout:libtoolize: putting auxiliary files in AC_CONFIG_AUX_DIR, '.'. 2023-10-08T12:03:14.862 INFO:teuthology.orchestra.run.smithi156.stdout:libtoolize: copying file './config.guess' 2023-10-08T12:03:14.871 INFO:teuthology.orchestra.run.smithi156.stdout:libtoolize: copying file './config.sub' 2023-10-08T12:03:14.881 INFO:teuthology.orchestra.run.smithi156.stdout:libtoolize: copying file './install-sh' 2023-10-08T12:03:14.891 INFO:teuthology.orchestra.run.smithi156.stdout:libtoolize: copying file './ltmain.sh' 2023-10-08T12:03:14.934 INFO:teuthology.orchestra.run.smithi156.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-10-08T12:03:14.934 INFO:teuthology.orchestra.run.smithi156.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-10-08T12:03:14.944 INFO:teuthology.orchestra.run.smithi156.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-10-08T12:03:14.954 INFO:teuthology.orchestra.run.smithi156.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-10-08T12:03:14.965 INFO:teuthology.orchestra.run.smithi156.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-10-08T12:03:14.975 INFO:teuthology.orchestra.run.smithi156.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-10-08T12:03:14.986 INFO:teuthology.orchestra.run.smithi156.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-10-08T12:03:14.988 INFO:teuthology.orchestra.run.smithi156.stdout:cp include/install-sh . 2023-10-08T12:03:14.990 INFO:teuthology.orchestra.run.smithi156.stdout:aclocal -I m4 2023-10-08T12:03:16.001 INFO:teuthology.orchestra.run.smithi156.stdout:autoconf 2023-10-08T12:03:16.435 INFO:teuthology.orchestra.run.smithi156.stdout:./configure $LOCAL_CONFIGURE_OPTIONS 2023-10-08T12:03:16.587 INFO:teuthology.orchestra.run.smithi156.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2023-10-08T12:03:16.659 INFO:teuthology.orchestra.run.smithi156.stdout:checking build system type... x86_64-pc-linux-gnu 2023-10-08T12:03:16.659 INFO:teuthology.orchestra.run.smithi156.stdout:checking host system type... x86_64-pc-linux-gnu 2023-10-08T12:03:16.688 INFO:teuthology.orchestra.run.smithi156.stdout:checking how to print strings... printf 2023-10-08T12:03:16.689 INFO:teuthology.orchestra.run.smithi156.stdout:checking for gcc... gcc 2023-10-08T12:03:16.775 INFO:teuthology.orchestra.run.smithi156.stdout:checking whether the C compiler works... yes 2023-10-08T12:03:16.775 INFO:teuthology.orchestra.run.smithi156.stdout:checking for C compiler default output file name... a.out 2023-10-08T12:03:16.817 INFO:teuthology.orchestra.run.smithi156.stdout:checking for suffix of executables... 2023-10-08T12:03:16.864 INFO:teuthology.orchestra.run.smithi156.stdout:checking whether we are cross compiling... no 2023-10-08T12:03:16.891 INFO:teuthology.orchestra.run.smithi156.stdout:checking for suffix of object files... o 2023-10-08T12:03:16.914 INFO:teuthology.orchestra.run.smithi156.stdout:checking whether the compiler supports GNU C... yes 2023-10-08T12:03:16.937 INFO:teuthology.orchestra.run.smithi156.stdout:checking whether gcc accepts -g... yes 2023-10-08T12:03:16.989 INFO:teuthology.orchestra.run.smithi156.stdout:checking for gcc option to enable C11 features... none needed 2023-10-08T12:03:16.995 INFO:teuthology.orchestra.run.smithi156.stdout:checking for a sed that does not truncate output... /usr/bin/sed 2023-10-08T12:03:17.000 INFO:teuthology.orchestra.run.smithi156.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2023-10-08T12:03:17.003 INFO:teuthology.orchestra.run.smithi156.stdout:checking for egrep... /usr/bin/grep -E 2023-10-08T12:03:17.006 INFO:teuthology.orchestra.run.smithi156.stdout:checking for fgrep... /usr/bin/grep -F 2023-10-08T12:03:17.013 INFO:teuthology.orchestra.run.smithi156.stdout:checking for ld used by gcc... /usr/bin/ld 2023-10-08T12:03:17.017 INFO:teuthology.orchestra.run.smithi156.stdout:checking if the linker (/usr/bin/ld) is GNU ld... yes 2023-10-08T12:03:17.021 INFO:teuthology.orchestra.run.smithi156.stdout:checking for BSD- or MS-compatible name lister (nm)... /usr/bin/nm -B 2023-10-08T12:03:17.052 INFO:teuthology.orchestra.run.smithi156.stdout:checking the name lister (/usr/bin/nm -B) interface... BSD nm 2023-10-08T12:03:17.052 INFO:teuthology.orchestra.run.smithi156.stdout:checking whether ln -s works... yes 2023-10-08T12:03:17.057 INFO:teuthology.orchestra.run.smithi156.stdout:checking the maximum length of command line arguments... 1572864 2023-10-08T12:03:17.063 INFO:teuthology.orchestra.run.smithi156.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-10-08T12:03:17.063 INFO:teuthology.orchestra.run.smithi156.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-10-08T12:03:17.063 INFO:teuthology.orchestra.run.smithi156.stdout:checking for /usr/bin/ld option to reload object files... -r 2023-10-08T12:03:17.067 INFO:teuthology.orchestra.run.smithi156.stdout:checking for objdump... objdump 2023-10-08T12:03:17.067 INFO:teuthology.orchestra.run.smithi156.stdout:checking how to recognize dependent libraries... pass_all 2023-10-08T12:03:17.067 INFO:teuthology.orchestra.run.smithi156.stdout:checking for dlltool... no 2023-10-08T12:03:17.067 INFO:teuthology.orchestra.run.smithi156.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-10-08T12:03:17.067 INFO:teuthology.orchestra.run.smithi156.stdout:checking for ar... ar 2023-10-08T12:03:17.101 INFO:teuthology.orchestra.run.smithi156.stdout:checking for archiver @FILE support... @ 2023-10-08T12:03:17.101 INFO:teuthology.orchestra.run.smithi156.stdout:checking for strip... strip 2023-10-08T12:03:17.101 INFO:teuthology.orchestra.run.smithi156.stdout:checking for ranlib... ranlib 2023-10-08T12:03:17.101 INFO:teuthology.orchestra.run.smithi156.stdout:checking for gawk... gawk 2023-10-08T12:03:17.191 INFO:teuthology.orchestra.run.smithi156.stdout:checking command to parse /usr/bin/nm -B output from gcc object... ok 2023-10-08T12:03:17.193 INFO:teuthology.orchestra.run.smithi156.stdout:checking for sysroot... no 2023-10-08T12:03:17.201 INFO:teuthology.orchestra.run.smithi156.stdout:checking for a working dd... /usr/bin/dd 2023-10-08T12:03:17.208 INFO:teuthology.orchestra.run.smithi156.stdout:checking how to truncate binary pipes... /usr/bin/dd bs=4096 count=1 2023-10-08T12:03:17.227 INFO:teuthology.orchestra.run.smithi156.stdout:checking for mt... mt 2023-10-08T12:03:17.234 INFO:teuthology.orchestra.run.smithi156.stdout:checking if mt is a manifest tool... no 2023-10-08T12:03:17.260 INFO:teuthology.orchestra.run.smithi156.stdout:checking for stdio.h... yes 2023-10-08T12:03:17.290 INFO:teuthology.orchestra.run.smithi156.stdout:checking for stdlib.h... yes 2023-10-08T12:03:17.322 INFO:teuthology.orchestra.run.smithi156.stdout:checking for string.h... yes 2023-10-08T12:03:17.354 INFO:teuthology.orchestra.run.smithi156.stdout:checking for inttypes.h... yes 2023-10-08T12:03:17.387 INFO:teuthology.orchestra.run.smithi156.stdout:checking for stdint.h... yes 2023-10-08T12:03:17.419 INFO:teuthology.orchestra.run.smithi156.stdout:checking for strings.h... yes 2023-10-08T12:03:17.453 INFO:teuthology.orchestra.run.smithi156.stdout:checking for sys/stat.h... yes 2023-10-08T12:03:17.486 INFO:teuthology.orchestra.run.smithi156.stdout:checking for sys/types.h... yes 2023-10-08T12:03:17.523 INFO:teuthology.orchestra.run.smithi156.stdout:checking for unistd.h... yes 2023-10-08T12:03:17.560 INFO:teuthology.orchestra.run.smithi156.stdout:checking for dlfcn.h... yes 2023-10-08T12:03:17.566 INFO:teuthology.orchestra.run.smithi156.stdout:checking for objdir... .libs 2023-10-08T12:03:17.665 INFO:teuthology.orchestra.run.smithi156.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-10-08T12:03:17.665 INFO:teuthology.orchestra.run.smithi156.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-10-08T12:03:17.693 INFO:teuthology.orchestra.run.smithi156.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-10-08T12:03:17.795 INFO:teuthology.orchestra.run.smithi156.stdout:checking if gcc static flag -static works... yes 2023-10-08T12:03:17.836 INFO:teuthology.orchestra.run.smithi156.stdout:checking if gcc supports -c -o file.o... yes 2023-10-08T12:03:17.836 INFO:teuthology.orchestra.run.smithi156.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-10-08T12:03:17.850 INFO:teuthology.orchestra.run.smithi156.stdout:checking whether the gcc linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-10-08T12:03:17.886 INFO:teuthology.orchestra.run.smithi156.stdout:checking whether -lc should be explicitly linked in... no 2023-10-08T12:03:17.968 INFO:teuthology.orchestra.run.smithi156.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-10-08T12:03:17.968 INFO:teuthology.orchestra.run.smithi156.stdout:checking how to hardcode library paths into programs... immediate 2023-10-08T12:03:17.971 INFO:teuthology.orchestra.run.smithi156.stdout:checking whether stripping libraries is possible... yes 2023-10-08T12:03:17.971 INFO:teuthology.orchestra.run.smithi156.stdout:checking if libtool supports shared libraries... yes 2023-10-08T12:03:17.971 INFO:teuthology.orchestra.run.smithi156.stdout:checking whether to build shared libraries... yes 2023-10-08T12:03:17.971 INFO:teuthology.orchestra.run.smithi156.stdout:checking whether to build static libraries... yes 2023-10-08T12:03:17.972 INFO:teuthology.orchestra.run.smithi156.stdout:checking for gcc... (cached) gcc 2023-10-08T12:03:18.014 INFO:teuthology.orchestra.run.smithi156.stdout:checking whether the compiler supports GNU C... (cached) yes 2023-10-08T12:03:18.014 INFO:teuthology.orchestra.run.smithi156.stdout:checking whether gcc accepts -g... (cached) yes 2023-10-08T12:03:18.015 INFO:teuthology.orchestra.run.smithi156.stdout:checking for gcc option to enable C11 features... (cached) none needed 2023-10-08T12:03:18.028 INFO:teuthology.orchestra.run.smithi156.stdout:checking for gcc... (cached) gcc 2023-10-08T12:03:18.070 INFO:teuthology.orchestra.run.smithi156.stdout:checking whether the compiler supports GNU C... (cached) yes 2023-10-08T12:03:18.071 INFO:teuthology.orchestra.run.smithi156.stdout:checking whether gcc accepts -g... (cached) yes 2023-10-08T12:03:18.071 INFO:teuthology.orchestra.run.smithi156.stdout:checking for gcc option to enable C11 features... (cached) none needed 2023-10-08T12:03:18.078 INFO:teuthology.orchestra.run.smithi156.stdout:checking for gcc... (cached) gcc 2023-10-08T12:03:18.122 INFO:teuthology.orchestra.run.smithi156.stdout:checking whether the compiler supports GNU C... (cached) yes 2023-10-08T12:03:18.122 INFO:teuthology.orchestra.run.smithi156.stdout:checking whether gcc accepts -g... (cached) yes 2023-10-08T12:03:18.122 INFO:teuthology.orchestra.run.smithi156.stdout:checking for gcc option to enable C11 features... (cached) none needed 2023-10-08T12:03:18.122 INFO:teuthology.orchestra.run.smithi156.stdout:checking for gmake... /usr/bin/gmake 2023-10-08T12:03:18.122 INFO:teuthology.orchestra.run.smithi156.stdout:checking for tar... /usr/bin/tar 2023-10-08T12:03:18.122 INFO:teuthology.orchestra.run.smithi156.stdout:checking for gzip... /usr/bin/gzip 2023-10-08T12:03:18.136 INFO:teuthology.orchestra.run.smithi156.stdout:checking whether gcc -MM is supported... yes 2023-10-08T12:03:18.137 INFO:teuthology.orchestra.run.smithi156.stdout:checking for sort... /bin/sort 2023-10-08T12:03:18.137 INFO:teuthology.orchestra.run.smithi156.stdout:checking whether ln -s works... yes 2023-10-08T12:03:18.138 INFO:teuthology.orchestra.run.smithi156.stdout:checking for msgfmt... /usr/bin/msgfmt 2023-10-08T12:03:18.138 INFO:teuthology.orchestra.run.smithi156.stdout:checking for msgmerge... /usr/bin/msgmerge 2023-10-08T12:03:18.138 INFO:teuthology.orchestra.run.smithi156.stdout:checking for xgettext... /usr/bin/xgettext 2023-10-08T12:03:18.138 INFO:teuthology.orchestra.run.smithi156.stdout:checking for rpm... no 2023-10-08T12:03:18.191 INFO:teuthology.orchestra.run.smithi156.stdout:checking for ini.h... yes 2023-10-08T12:03:18.239 INFO:teuthology.orchestra.run.smithi156.stdout:checking for ini_parse in -linih... yes 2023-10-08T12:03:18.282 INFO:teuthology.orchestra.run.smithi156.stdout:checking for uuid.h... no 2023-10-08T12:03:18.323 INFO:teuthology.orchestra.run.smithi156.stdout:checking for sys/uuid.h... no 2023-10-08T12:03:18.362 INFO:teuthology.orchestra.run.smithi156.stdout:checking for uuid/uuid.h... yes 2023-10-08T12:03:18.419 INFO:teuthology.orchestra.run.smithi156.stdout:checking for uuid_compare... no 2023-10-08T12:03:18.468 INFO:teuthology.orchestra.run.smithi156.stdout:checking for uuid_compare in -luuid... yes 2023-10-08T12:03:18.508 INFO:teuthology.orchestra.run.smithi156.stdout:checking for pthread.h... yes 2023-10-08T12:03:18.556 INFO:teuthology.orchestra.run.smithi156.stdout:checking for pthread_mutex_init in -lpthread... yes 2023-10-08T12:03:18.600 INFO:teuthology.orchestra.run.smithi156.stdout:checking for urcu.h... yes 2023-10-08T12:03:18.639 INFO:teuthology.orchestra.run.smithi156.stdout:checking for liburcu... yes 2023-10-08T12:03:18.668 INFO:teuthology.orchestra.run.smithi156.stdout:checking for fadvise ... yes 2023-10-08T12:03:18.695 INFO:teuthology.orchestra.run.smithi156.stdout:checking for madvise ... yes 2023-10-08T12:03:18.723 INFO:teuthology.orchestra.run.smithi156.stdout:checking for mincore ... yes 2023-10-08T12:03:18.763 INFO:teuthology.orchestra.run.smithi156.stdout:checking for sendfile ... yes 2023-10-08T12:03:18.794 INFO:teuthology.orchestra.run.smithi156.stdout:checking for getmntent ... yes 2023-10-08T12:03:18.846 INFO:teuthology.orchestra.run.smithi156.stdout:checking for fallocate... yes 2023-10-08T12:03:18.897 INFO:teuthology.orchestra.run.smithi156.stdout:checking for fiemap... yes 2023-10-08T12:03:18.956 INFO:teuthology.orchestra.run.smithi156.stdout:checking for pwritev2... yes 2023-10-08T12:03:19.021 INFO:teuthology.orchestra.run.smithi156.stdout:checking for preadv... yes 2023-10-08T12:03:19.069 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:03:19.072 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:03:19.075 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:03:19.079 INFO:teuthology.orchestra.run.smithi156.stdout:checking for copy_file_range... yes 2023-10-08T12:03:19.129 INFO:teuthology.orchestra.run.smithi156.stdout:checking for sync_file_range... yes 2023-10-08T12:03:19.184 INFO:teuthology.orchestra.run.smithi156.stdout:checking for syncfs... yes 2023-10-08T12:03:19.224 INFO:teuthology.orchestra.run.smithi156.stdout:checking for mntent.h... yes 2023-10-08T12:03:19.272 INFO:teuthology.orchestra.run.smithi156.stdout:checking for gcc options needed to detect all undeclared functions... none needed 2023-10-08T12:03:19.307 INFO:teuthology.orchestra.run.smithi156.stdout:checking whether fls is declared... no 2023-10-08T12:03:19.362 INFO:teuthology.orchestra.run.smithi156.stdout:checking for readdir... yes 2023-10-08T12:03:19.401 INFO:teuthology.orchestra.run.smithi156.stdout:checking whether fsetxattr is declared... yes 2023-10-08T12:03:19.437 INFO:teuthology.orchestra.run.smithi156.stdout:checking whether mremap is declared... yes 2023-10-08T12:03:19.488 INFO:teuthology.orchestra.run.smithi156.stdout:checking for struct fsxattr... yes 2023-10-08T12:03:19.515 INFO:teuthology.orchestra.run.smithi156.stdout:checking for struct fsxattr.fsx_cowextsize... yes 2023-10-08T12:03:19.567 INFO:teuthology.orchestra.run.smithi156.stdout:checking for struct fscrypt_add_key_arg... yes 2023-10-08T12:03:19.593 INFO:teuthology.orchestra.run.smithi156.stdout:checking for struct fscrypt_add_key_arg.key_id... yes 2023-10-08T12:03:19.662 INFO:teuthology.orchestra.run.smithi156.stdout:checking for GETFSMAP... yes 2023-10-08T12:03:19.716 INFO:teuthology.orchestra.run.smithi156.stdout:checking for struct statfs... yes 2023-10-08T12:03:19.743 INFO:teuthology.orchestra.run.smithi156.stdout:checking for struct statfs.f_flags... yes 2023-10-08T12:03:19.768 INFO:teuthology.orchestra.run.smithi156.stdout:checking for MAP_SYNC... yes 2023-10-08T12:03:19.881 INFO:teuthology.orchestra.run.smithi156.stdout:checking for library containing dm_task_create... -ldevmapper 2023-10-08T12:03:19.918 INFO:teuthology.orchestra.run.smithi156.stdout:checking for mallinfo ... yes 2023-10-08T12:03:19.950 INFO:teuthology.orchestra.run.smithi156.stdout:checking for mallinfo2 ... yes 2023-10-08T12:03:19.989 INFO:teuthology.orchestra.run.smithi156.stdout:checking for attr/attributes.h... yes 2023-10-08T12:03:20.017 INFO:teuthology.orchestra.run.smithi156.stdout:checking for struct attrlist_cursor... yes 2023-10-08T12:03:20.019 INFO:teuthology.orchestra.run.smithi156.stdout:checking for pkg-config... /usr/bin/pkg-config 2023-10-08T12:03:20.021 INFO:teuthology.orchestra.run.smithi156.stdout:checking pkg-config is at least version 0.9.0... yes 2023-10-08T12:03:20.033 INFO:teuthology.orchestra.run.smithi156.stdout:checking for icu-i18n... yes 2023-10-08T12:03:20.071 INFO:teuthology.orchestra.run.smithi156.stdout:checking whether openat is declared... yes 2023-10-08T12:03:20.116 INFO:teuthology.orchestra.run.smithi156.stdout:checking whether fstatat is declared... yes 2023-10-08T12:03:20.161 INFO:teuthology.orchestra.run.smithi156.stdout:checking for struct sg_io_hdr ... yes 2023-10-08T12:03:20.191 INFO:teuthology.orchestra.run.smithi156.stdout:checking for struct hd_geometry ... yes 2023-10-08T12:03:20.205 INFO:teuthology.orchestra.run.smithi156.stdout:checking for systemd... yes 2023-10-08T12:03:20.208 INFO:teuthology.orchestra.run.smithi156.stdout:checking for systemd system unit dir... /lib/systemd/system 2023-10-08T12:03:20.209 INFO:teuthology.orchestra.run.smithi156.stdout:checking for system crontab dir... /etc/cron.d 2023-10-08T12:03:20.316 INFO:teuthology.orchestra.run.smithi156.stdout:checking for library containing blkid_probe_all... -lblkid 2023-10-08T12:03:20.368 INFO:teuthology.orchestra.run.smithi156.stdout:checking for blkid_probe_get_topology... yes 2023-10-08T12:03:20.442 INFO:teuthology.orchestra.run.smithi156.stdout:checking size of long... 8 2023-10-08T12:03:20.516 INFO:teuthology.orchestra.run.smithi156.stdout:checking size of char *... 8 2023-10-08T12:03:20.538 INFO:teuthology.orchestra.run.smithi156.stdout:checking for umode_t... no 2023-10-08T12:03:20.603 INFO:teuthology.orchestra.run.smithi156.stdout:checking for atomic64_t support in liburcu... yes 2023-10-08T12:03:20.633 INFO:teuthology.orchestra.run.smithi156.stdout:configure: creating ./config.status 2023-10-08T12:03:21.469 INFO:teuthology.orchestra.run.smithi156.stdout:config.status: creating include/builddefs 2023-10-08T12:03:21.495 INFO:teuthology.orchestra.run.smithi156.stdout:config.status: creating include/platform_defs.h 2023-10-08T12:03:21.516 INFO:teuthology.orchestra.run.smithi156.stdout:config.status: executing libtool commands 2023-10-08T12:03:21.597 INFO:teuthology.orchestra.run.smithi156.stdout: [HEADERS] include 2023-10-08T12:03:21.622 INFO:teuthology.orchestra.run.smithi156.stdout: [HEADERS] libxfs 2023-10-08T12:03:21.657 INFO:teuthology.orchestra.run.smithi156.stdout:Building include 2023-10-08T12:03:21.665 INFO:teuthology.orchestra.run.smithi156.stdout: [LN] disk 2023-10-08T12:03:21.670 INFO:teuthology.orchestra.run.smithi156.stdout:Building libfrog 2023-10-08T12:03:21.676 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] gen_crc32table 2023-10-08T12:03:21.744 INFO:teuthology.orchestra.run.smithi156.stdout: [GENERATE] crc32table.h 2023-10-08T12:03:22.224 INFO:teuthology.orchestra.run.smithi156.stdout: [TEST] CRC32 2023-10-08T12:03:22.377 INFO:teuthology.orchestra.run.smithi156.stdout:CRC_LE_BITS = 64 2023-10-08T12:03:22.377 INFO:teuthology.orchestra.run.smithi156.stdout:crc32c: tests passed, 225944 bytes in 55 usec 2023-10-08T12:03:22.381 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] avl64.lo 2023-10-08T12:03:22.845 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] bitmap.lo 2023-10-08T12:03:23.185 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] bulkstat.lo 2023-10-08T12:03:23.574 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] convert.lo 2023-10-08T12:03:23.939 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] crc32.lo 2023-10-08T12:03:24.171 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] fsgeom.lo 2023-10-08T12:03:24.501 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] list_sort.lo 2023-10-08T12:03:24.723 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] linux.lo 2023-10-08T12:03:25.064 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] logging.lo 2023-10-08T12:03:25.231 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] paths.lo 2023-10-08T12:03:25.674 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] projects.lo 2023-10-08T12:03:25.990 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] ptvar.lo 2023-10-08T12:03:26.256 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] radix-tree.lo 2023-10-08T12:03:26.775 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] randbytes.lo 2023-10-08T12:03:27.001 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] scrub.lo 2023-10-08T12:03:27.215 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] util.lo 2023-10-08T12:03:27.450 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] workqueue.lo 2023-10-08T12:03:27.739 INFO:teuthology.orchestra.run.smithi156.stdout: [LD] libfrog.la 2023-10-08T12:03:27.862 INFO:teuthology.orchestra.run.smithi156.stdout:Building libxfs 2023-10-08T12:03:29.547 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] cache.lo 2023-10-08T12:03:30.093 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] defer_item.lo 2023-10-08T12:03:30.539 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] init.lo 2023-10-08T12:03:31.256 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] kmem.lo 2023-10-08T12:03:31.570 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] logitem.lo 2023-10-08T12:03:31.908 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] rdwr.lo 2023-10-08T12:03:32.767 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] topology.lo 2023-10-08T12:03:33.150 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] trans.lo 2023-10-08T12:03:33.679 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] util.lo 2023-10-08T12:03:34.200 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] xfs_ag.lo 2023-10-08T12:03:35.004 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] xfs_ag_resv.lo 2023-10-08T12:03:35.375 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] xfs_alloc.lo 2023-10-08T12:03:36.891 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] xfs_alloc_btree.lo 2023-10-08T12:03:37.384 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] xfs_attr.lo 2023-10-08T12:03:38.002 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] xfs_attr_leaf.lo 2023-10-08T12:03:39.425 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] xfs_attr_remote.lo 2023-10-08T12:03:39.978 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] xfs_bit.lo 2023-10-08T12:03:40.274 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] xfs_bmap.lo 2023-10-08T12:03:43.101 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] xfs_bmap_btree.lo 2023-10-08T12:03:43.651 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] xfs_btree.lo 2023-10-08T12:03:45.844 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] xfs_btree_staging.lo 2023-10-08T12:03:46.324 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] xfs_da_btree.lo 2023-10-08T12:03:47.620 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] xfs_defer.lo 2023-10-08T12:03:48.148 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] xfs_dir2.lo 2023-10-08T12:03:48.684 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] xfs_dir2_block.lo 2023-10-08T12:03:49.198 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:03:49.201 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:03:49.204 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:03:49.541 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] xfs_dir2_data.lo 2023-10-08T12:03:50.319 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] xfs_dir2_leaf.lo 2023-10-08T12:03:51.247 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] xfs_dir2_node.lo 2023-10-08T12:03:52.308 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] xfs_dir2_sf.lo 2023-10-08T12:03:53.092 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] xfs_dquot_buf.lo 2023-10-08T12:03:53.503 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] xfs_ialloc.lo 2023-10-08T12:03:54.814 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] xfs_iext_tree.lo 2023-10-08T12:03:55.553 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] xfs_inode_buf.lo 2023-10-08T12:03:56.209 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] xfs_inode_fork.lo 2023-10-08T12:03:56.851 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] xfs_ialloc_btree.lo 2023-10-08T12:03:57.393 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] xfs_log_rlimit.lo 2023-10-08T12:03:57.718 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] xfs_refcount.lo 2023-10-08T12:03:58.556 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] xfs_refcount_btree.lo 2023-10-08T12:03:59.030 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] xfs_rmap.lo 2023-10-08T12:04:00.230 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] xfs_rmap_btree.lo 2023-10-08T12:04:00.780 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] xfs_rtbitmap.lo 2023-10-08T12:04:01.422 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] xfs_sb.lo 2023-10-08T12:04:02.233 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] xfs_symlink_remote.lo 2023-10-08T12:04:02.616 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] xfs_trans_inode.lo 2023-10-08T12:04:02.927 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] xfs_trans_resv.lo 2023-10-08T12:04:03.515 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] xfs_types.lo 2023-10-08T12:04:03.886 INFO:teuthology.orchestra.run.smithi156.stdout: [LD] libxfs.la 2023-10-08T12:04:04.118 INFO:teuthology.orchestra.run.smithi156.stdout:Building libxlog 2023-10-08T12:04:04.212 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] xfs_log_recover.lo 2023-10-08T12:04:05.042 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] util.lo 2023-10-08T12:04:05.424 INFO:teuthology.orchestra.run.smithi156.stdout: [LD] libxlog.la 2023-10-08T12:04:05.526 INFO:teuthology.orchestra.run.smithi156.stdout:Building libxcmd 2023-10-08T12:04:05.664 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] command.lo 2023-10-08T12:04:06.014 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] input.lo 2023-10-08T12:04:06.332 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] help.lo 2023-10-08T12:04:06.591 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] quit.lo 2023-10-08T12:04:06.828 INFO:teuthology.orchestra.run.smithi156.stdout: [LD] libxcmd.la 2023-10-08T12:04:06.931 INFO:teuthology.orchestra.run.smithi156.stdout:Building libhandle 2023-10-08T12:04:07.012 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] handle.lo 2023-10-08T12:04:07.392 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] jdm.lo 2023-10-08T12:04:07.687 INFO:teuthology.orchestra.run.smithi156.stdout: [LD] libhandle.la 2023-10-08T12:04:07.828 INFO:teuthology.orchestra.run.smithi156.stdout:Building copy 2023-10-08T12:04:07.886 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] xfs_copy.o 2023-10-08T12:04:08.336 INFO:teuthology.orchestra.run.smithi156.stdout: [LD] xfs_copy 2023-10-08T12:04:08.521 INFO:teuthology.orchestra.run.smithi156.stdout:Building db 2023-10-08T12:04:10.568 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] addr.o 2023-10-08T12:04:10.686 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] agf.o 2023-10-08T12:04:10.799 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] agfl.o 2023-10-08T12:04:10.913 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] agi.o 2023-10-08T12:04:11.025 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] attr.o 2023-10-08T12:04:11.238 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] attrshort.o 2023-10-08T12:04:11.370 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] bit.o 2023-10-08T12:04:11.508 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] block.o 2023-10-08T12:04:11.666 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] bmap.o 2023-10-08T12:04:11.871 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] btblock.o 2023-10-08T12:04:12.014 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] bmroot.o 2023-10-08T12:04:12.187 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] check.o 2023-10-08T12:04:14.004 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] command.o 2023-10-08T12:04:14.127 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] crc.o 2023-10-08T12:04:14.258 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] debug.o 2023-10-08T12:04:14.363 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] dir2.o 2023-10-08T12:04:14.661 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] dir2sf.o 2023-10-08T12:04:14.814 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] dquot.o 2023-10-08T12:04:14.941 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] echo.o 2023-10-08T12:04:15.041 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] faddr.o 2023-10-08T12:04:15.234 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] field.o 2023-10-08T12:04:15.361 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] flist.o 2023-10-08T12:04:15.601 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] fprint.o 2023-10-08T12:04:15.776 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] frag.o 2023-10-08T12:04:16.025 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] freesp.o 2023-10-08T12:04:16.229 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] hash.o 2023-10-08T12:04:16.316 INFO:teuthology.orchestra.run.smithi156.stderr:hash.c: In function 'hash_f': 2023-10-08T12:04:16.316 INFO:teuthology.orchestra.run.smithi156.stderr:hash.c:76:58: warning: pointer targets in passing argument 1 of 'libxfs_da_hashname' differ in signedness [-Wpointer-sign] 2023-10-08T12:04:16.316 INFO:teuthology.orchestra.run.smithi156.stderr: 76 | hashval = libxfs_da_hashname(argv[c], strlen(argv[c])); 2023-10-08T12:04:16.316 INFO:teuthology.orchestra.run.smithi156.stderr: | ~~~~^~~ 2023-10-08T12:04:16.316 INFO:teuthology.orchestra.run.smithi156.stderr: | | 2023-10-08T12:04:16.316 INFO:teuthology.orchestra.run.smithi156.stderr: | char * 2023-10-08T12:04:16.316 INFO:teuthology.orchestra.run.smithi156.stderr:In file included from ../include/libxfs.h:59, 2023-10-08T12:04:16.316 INFO:teuthology.orchestra.run.smithi156.stderr: from hash.c:7: 2023-10-08T12:04:16.317 INFO:teuthology.orchestra.run.smithi156.stderr:../libxfs/xfs_da_btree.h:223:37: note: expected 'const uint8_t *' {aka 'const unsigned char *'} but argument is of type 'char *' 2023-10-08T12:04:16.317 INFO:teuthology.orchestra.run.smithi156.stderr: 223 | uint xfs_da_hashname(const uint8_t *name_string, int name_length); 2023-10-08T12:04:16.317 INFO:teuthology.orchestra.run.smithi156.stderr: | ~~~~~~~~~~~~~~~^~~~~~~~~~~ 2023-10-08T12:04:16.320 INFO:teuthology.orchestra.run.smithi156.stderr:hash.c: In function 'collide_dirents': 2023-10-08T12:04:16.320 INFO:teuthology.orchestra.run.smithi156.stderr:hash.c:258:36: warning: pointer targets in passing argument 2 of 'openat' differ in signedness [-Wpointer-sign] 2023-10-08T12:04:16.320 INFO:teuthology.orchestra.run.smithi156.stderr: 258 | newfd = openat(fd, name, O_CREAT, 0600); 2023-10-08T12:04:16.320 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~ 2023-10-08T12:04:16.320 INFO:teuthology.orchestra.run.smithi156.stderr: | | 2023-10-08T12:04:16.320 INFO:teuthology.orchestra.run.smithi156.stderr: | const unsigned char * 2023-10-08T12:04:16.320 INFO:teuthology.orchestra.run.smithi156.stderr:In file included from /usr/include/fcntl.h:314, 2023-10-08T12:04:16.320 INFO:teuthology.orchestra.run.smithi156.stderr: from ../include/platform_defs.h:12, 2023-10-08T12:04:16.321 INFO:teuthology.orchestra.run.smithi156.stderr: from ../include/libxfs.h:11, 2023-10-08T12:04:16.321 INFO:teuthology.orchestra.run.smithi156.stderr: from hash.c:7: 2023-10-08T12:04:16.321 INFO:teuthology.orchestra.run.smithi156.stderr:/usr/include/x86_64-linux-gnu/bits/fcntl2.h:117:31: note: expected 'const char *' but argument is of type 'const unsigned char *' 2023-10-08T12:04:16.321 INFO:teuthology.orchestra.run.smithi156.stderr: 117 | openat (int __fd, const char *__path, int __oflag, ...) 2023-10-08T12:04:16.321 INFO:teuthology.orchestra.run.smithi156.stderr: | ~~~~~~~~~~~~^~~~~~ 2023-10-08T12:04:16.321 INFO:teuthology.orchestra.run.smithi156.stderr:hash.c:273:25: warning: pointer targets in passing argument 1 of 'strncpy' differ in signedness [-Wpointer-sign] 2023-10-08T12:04:16.321 INFO:teuthology.orchestra.run.smithi156.stderr: 273 | strncpy(direntname, name, MAXNAMELEN); 2023-10-08T12:04:16.321 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~ 2023-10-08T12:04:16.321 INFO:teuthology.orchestra.run.smithi156.stderr: | | 2023-10-08T12:04:16.321 INFO:teuthology.orchestra.run.smithi156.stderr: | unsigned char * 2023-10-08T12:04:16.321 INFO:teuthology.orchestra.run.smithi156.stderr:In file included from /usr/include/features.h:486, 2023-10-08T12:04:16.321 INFO:teuthology.orchestra.run.smithi156.stderr: from /usr/include/x86_64-linux-gnu/bits/libc-header-start.h:33, 2023-10-08T12:04:16.322 INFO:teuthology.orchestra.run.smithi156.stderr: from /usr/include/stdio.h:27, 2023-10-08T12:04:16.322 INFO:teuthology.orchestra.run.smithi156.stderr: from ../include/platform_defs.h:10, 2023-10-08T12:04:16.322 INFO:teuthology.orchestra.run.smithi156.stderr: from ../include/libxfs.h:11, 2023-10-08T12:04:16.322 INFO:teuthology.orchestra.run.smithi156.stderr: from hash.c:7: 2023-10-08T12:04:16.322 INFO:teuthology.orchestra.run.smithi156.stderr:/usr/include/x86_64-linux-gnu/bits/string_fortified.h:92:1: note: expected 'char * restrict' but argument is of type 'unsigned char *' 2023-10-08T12:04:16.322 INFO:teuthology.orchestra.run.smithi156.stderr: 92 | __NTH (strncpy (char *__restrict __dest, const char *__restrict __src, 2023-10-08T12:04:16.322 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~ 2023-10-08T12:04:16.322 INFO:teuthology.orchestra.run.smithi156.stderr:hash.c:273:37: warning: pointer targets in passing argument 2 of 'strncpy' differ in signedness [-Wpointer-sign] 2023-10-08T12:04:16.322 INFO:teuthology.orchestra.run.smithi156.stderr: 273 | strncpy(direntname, name, MAXNAMELEN); 2023-10-08T12:04:16.322 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~ 2023-10-08T12:04:16.322 INFO:teuthology.orchestra.run.smithi156.stderr: | | 2023-10-08T12:04:16.322 INFO:teuthology.orchestra.run.smithi156.stderr: | const unsigned char * 2023-10-08T12:04:16.323 INFO:teuthology.orchestra.run.smithi156.stderr:In file included from /usr/include/features.h:486, 2023-10-08T12:04:16.323 INFO:teuthology.orchestra.run.smithi156.stderr: from /usr/include/x86_64-linux-gnu/bits/libc-header-start.h:33, 2023-10-08T12:04:16.323 INFO:teuthology.orchestra.run.smithi156.stderr: from /usr/include/stdio.h:27, 2023-10-08T12:04:16.323 INFO:teuthology.orchestra.run.smithi156.stderr: from ../include/platform_defs.h:10, 2023-10-08T12:04:16.323 INFO:teuthology.orchestra.run.smithi156.stderr: from ../include/libxfs.h:11, 2023-10-08T12:04:16.323 INFO:teuthology.orchestra.run.smithi156.stderr: from hash.c:7: 2023-10-08T12:04:16.323 INFO:teuthology.orchestra.run.smithi156.stderr:/usr/include/x86_64-linux-gnu/bits/string_fortified.h:92:1: note: expected 'const char * restrict' but argument is of type 'const unsigned char *' 2023-10-08T12:04:16.323 INFO:teuthology.orchestra.run.smithi156.stderr: 92 | __NTH (strncpy (char *__restrict __dest, const char *__restrict __src, 2023-10-08T12:04:16.323 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~ 2023-10-08T12:04:16.323 INFO:teuthology.orchestra.run.smithi156.stderr:hash.c:278:44: warning: pointer targets in passing argument 2 of 'linkat' differ in signedness [-Wpointer-sign] 2023-10-08T12:04:16.323 INFO:teuthology.orchestra.run.smithi156.stderr: 278 | error = linkat(fd, name, fd, direntname, 0); 2023-10-08T12:04:16.323 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~ 2023-10-08T12:04:16.324 INFO:teuthology.orchestra.run.smithi156.stderr: | | 2023-10-08T12:04:16.324 INFO:teuthology.orchestra.run.smithi156.stderr: | const unsigned char * 2023-10-08T12:04:16.324 INFO:teuthology.orchestra.run.smithi156.stderr:In file included from ../include/platform_defs.h:19, 2023-10-08T12:04:16.324 INFO:teuthology.orchestra.run.smithi156.stderr: from ../include/libxfs.h:11, 2023-10-08T12:04:16.324 INFO:teuthology.orchestra.run.smithi156.stderr: from hash.c:7: 2023-10-08T12:04:16.324 INFO:teuthology.orchestra.run.smithi156.stderr:/usr/include/unistd.h:825:46: note: expected 'const char *' but argument is of type 'const unsigned char *' 2023-10-08T12:04:16.324 INFO:teuthology.orchestra.run.smithi156.stderr: 825 | extern int linkat (int __fromfd, const char *__from, int __tofd, 2023-10-08T12:04:16.324 INFO:teuthology.orchestra.run.smithi156.stderr: | ~~~~~~~~~~~~^~~~~~ 2023-10-08T12:04:16.324 INFO:teuthology.orchestra.run.smithi156.stderr:hash.c:278:54: warning: pointer targets in passing argument 4 of 'linkat' differ in signedness [-Wpointer-sign] 2023-10-08T12:04:16.324 INFO:teuthology.orchestra.run.smithi156.stderr: 278 | error = linkat(fd, name, fd, direntname, 0); 2023-10-08T12:04:16.324 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~~ 2023-10-08T12:04:16.324 INFO:teuthology.orchestra.run.smithi156.stderr: | | 2023-10-08T12:04:16.325 INFO:teuthology.orchestra.run.smithi156.stderr: | unsigned char * 2023-10-08T12:04:16.325 INFO:teuthology.orchestra.run.smithi156.stderr:In file included from ../include/platform_defs.h:19, 2023-10-08T12:04:16.325 INFO:teuthology.orchestra.run.smithi156.stderr: from ../include/libxfs.h:11, 2023-10-08T12:04:16.325 INFO:teuthology.orchestra.run.smithi156.stderr: from hash.c:7: 2023-10-08T12:04:16.325 INFO:teuthology.orchestra.run.smithi156.stderr:/usr/include/unistd.h:826:32: note: expected 'const char *' but argument is of type 'unsigned char *' 2023-10-08T12:04:16.325 INFO:teuthology.orchestra.run.smithi156.stderr: 826 | const char *__to, int __flags) 2023-10-08T12:04:16.325 INFO:teuthology.orchestra.run.smithi156.stderr: | ~~~~~~~~~~~~^~~~ 2023-10-08T12:04:16.325 INFO:teuthology.orchestra.run.smithi156.stderr:hash.c: In function 'collide_xattrs': 2023-10-08T12:04:16.325 INFO:teuthology.orchestra.run.smithi156.stderr:hash.c:318:26: warning: pointer targets in passing argument 1 of 'snprintf' differ in signedness [-Wpointer-sign] 2023-10-08T12:04:16.325 INFO:teuthology.orchestra.run.smithi156.stderr: 318 | snprintf(xattrname, MAXNAMELEN + 5, "user.%s", name); 2023-10-08T12:04:16.325 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~ 2023-10-08T12:04:16.325 INFO:teuthology.orchestra.run.smithi156.stderr: | | 2023-10-08T12:04:16.326 INFO:teuthology.orchestra.run.smithi156.stderr: | unsigned char * 2023-10-08T12:04:16.326 INFO:teuthology.orchestra.run.smithi156.stderr:In file included from /usr/include/features.h:486, 2023-10-08T12:04:16.326 INFO:teuthology.orchestra.run.smithi156.stderr: from /usr/include/x86_64-linux-gnu/bits/libc-header-start.h:33, 2023-10-08T12:04:16.326 INFO:teuthology.orchestra.run.smithi156.stderr: from /usr/include/stdio.h:27, 2023-10-08T12:04:16.326 INFO:teuthology.orchestra.run.smithi156.stderr: from ../include/platform_defs.h:10, 2023-10-08T12:04:16.326 INFO:teuthology.orchestra.run.smithi156.stderr: from ../include/libxfs.h:11, 2023-10-08T12:04:16.326 INFO:teuthology.orchestra.run.smithi156.stderr: from hash.c:7: 2023-10-08T12:04:16.326 INFO:teuthology.orchestra.run.smithi156.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:68:1: note: expected 'char * restrict' but argument is of type 'unsigned char *' 2023-10-08T12:04:16.326 INFO:teuthology.orchestra.run.smithi156.stderr: 68 | __NTH (snprintf (char *__restrict __s, size_t __n, 2023-10-08T12:04:16.326 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~ 2023-10-08T12:04:16.326 INFO:teuthology.orchestra.run.smithi156.stderr:hash.c:319:39: warning: pointer targets in passing argument 2 of 'fsetxattr' differ in signedness [-Wpointer-sign] 2023-10-08T12:04:16.326 INFO:teuthology.orchestra.run.smithi156.stderr: 319 | error = fsetxattr(fd, xattrname, "1", 1, 0); 2023-10-08T12:04:16.327 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~ 2023-10-08T12:04:16.327 INFO:teuthology.orchestra.run.smithi156.stderr: | | 2023-10-08T12:04:16.327 INFO:teuthology.orchestra.run.smithi156.stderr: | unsigned char * 2023-10-08T12:04:16.327 INFO:teuthology.orchestra.run.smithi156.stderr:In file included from hash.c:16: 2023-10-08T12:04:16.327 INFO:teuthology.orchestra.run.smithi156.stderr:/usr/include/x86_64-linux-gnu/sys/xattr.h:54:45: note: expected 'const char *' but argument is of type 'unsigned char *' 2023-10-08T12:04:16.327 INFO:teuthology.orchestra.run.smithi156.stderr: 54 | extern int fsetxattr (int __fd, const char *__name, const void *__value, 2023-10-08T12:04:16.327 INFO:teuthology.orchestra.run.smithi156.stderr: | ~~~~~~~~~~~~^~~~~~ 2023-10-08T12:04:16.327 INFO:teuthology.orchestra.run.smithi156.stderr:hash.c:332:26: warning: pointer targets in passing argument 1 of 'snprintf' differ in signedness [-Wpointer-sign] 2023-10-08T12:04:16.327 INFO:teuthology.orchestra.run.smithi156.stderr: 332 | snprintf(xattrname, MAXNAMELEN + 5, "user.%s", name); 2023-10-08T12:04:16.327 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~ 2023-10-08T12:04:16.327 INFO:teuthology.orchestra.run.smithi156.stderr: | | 2023-10-08T12:04:16.327 INFO:teuthology.orchestra.run.smithi156.stderr: | unsigned char * 2023-10-08T12:04:16.328 INFO:teuthology.orchestra.run.smithi156.stderr:In file included from /usr/include/features.h:486, 2023-10-08T12:04:16.328 INFO:teuthology.orchestra.run.smithi156.stderr: from /usr/include/x86_64-linux-gnu/bits/libc-header-start.h:33, 2023-10-08T12:04:16.328 INFO:teuthology.orchestra.run.smithi156.stderr: from /usr/include/stdio.h:27, 2023-10-08T12:04:16.328 INFO:teuthology.orchestra.run.smithi156.stderr: from ../include/platform_defs.h:10, 2023-10-08T12:04:16.328 INFO:teuthology.orchestra.run.smithi156.stderr: from ../include/libxfs.h:11, 2023-10-08T12:04:16.328 INFO:teuthology.orchestra.run.smithi156.stderr: from hash.c:7: 2023-10-08T12:04:16.328 INFO:teuthology.orchestra.run.smithi156.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:68:1: note: expected 'char * restrict' but argument is of type 'unsigned char *' 2023-10-08T12:04:16.328 INFO:teuthology.orchestra.run.smithi156.stderr: 68 | __NTH (snprintf (char *__restrict __s, size_t __n, 2023-10-08T12:04:16.328 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~ 2023-10-08T12:04:16.328 INFO:teuthology.orchestra.run.smithi156.stderr:hash.c:337:47: warning: pointer targets in passing argument 2 of 'fsetxattr' differ in signedness [-Wpointer-sign] 2023-10-08T12:04:16.328 INFO:teuthology.orchestra.run.smithi156.stderr: 337 | error = fsetxattr(fd, xattrname, "1", 1, 0); 2023-10-08T12:04:16.328 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~~~~~~~ 2023-10-08T12:04:16.329 INFO:teuthology.orchestra.run.smithi156.stderr: | | 2023-10-08T12:04:16.329 INFO:teuthology.orchestra.run.smithi156.stderr: | unsigned char * 2023-10-08T12:04:16.329 INFO:teuthology.orchestra.run.smithi156.stderr:In file included from hash.c:16: 2023-10-08T12:04:16.329 INFO:teuthology.orchestra.run.smithi156.stderr:/usr/include/x86_64-linux-gnu/sys/xattr.h:54:45: note: expected 'const char *' but argument is of type 'unsigned char *' 2023-10-08T12:04:16.329 INFO:teuthology.orchestra.run.smithi156.stderr: 54 | extern int fsetxattr (int __fd, const char *__name, const void *__value, 2023-10-08T12:04:16.329 INFO:teuthology.orchestra.run.smithi156.stderr: | ~~~~~~~~~~~~^~~~~~ 2023-10-08T12:04:16.329 INFO:teuthology.orchestra.run.smithi156.stderr:hash.c: In function 'hashcoll_f': 2023-10-08T12:04:16.329 INFO:teuthology.orchestra.run.smithi156.stderr:hash.c:417:52: warning: pointer targets in passing argument 2 of 'collide_xattrs' differ in signedness [-Wpointer-sign] 2023-10-08T12:04:16.329 INFO:teuthology.orchestra.run.smithi156.stderr: 417 | error = collide_xattrs(nr, buf, len, fd); 2023-10-08T12:04:16.329 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~ 2023-10-08T12:04:16.329 INFO:teuthology.orchestra.run.smithi156.stderr: | | 2023-10-08T12:04:16.329 INFO:teuthology.orchestra.run.smithi156.stderr: | char * 2023-10-08T12:04:16.330 INFO:teuthology.orchestra.run.smithi156.stderr:hash.c:300:34: note: expected 'const unsigned char *' but argument is of type 'char *' 2023-10-08T12:04:16.330 INFO:teuthology.orchestra.run.smithi156.stderr: 300 | const unsigned char *name, 2023-10-08T12:04:16.330 INFO:teuthology.orchestra.run.smithi156.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~^~~~ 2023-10-08T12:04:16.330 INFO:teuthology.orchestra.run.smithi156.stderr:hash.c:419:53: warning: pointer targets in passing argument 2 of 'collide_dirents' differ in signedness [-Wpointer-sign] 2023-10-08T12:04:16.330 INFO:teuthology.orchestra.run.smithi156.stderr: 419 | error = collide_dirents(nr, buf, len, fd); 2023-10-08T12:04:16.330 INFO:teuthology.orchestra.run.smithi156.stderr: | ^~~ 2023-10-08T12:04:16.330 INFO:teuthology.orchestra.run.smithi156.stderr: | | 2023-10-08T12:04:16.330 INFO:teuthology.orchestra.run.smithi156.stderr: | char * 2023-10-08T12:04:16.330 INFO:teuthology.orchestra.run.smithi156.stderr:hash.c:234:34: note: expected 'const unsigned char *' but argument is of type 'char *' 2023-10-08T12:04:16.330 INFO:teuthology.orchestra.run.smithi156.stderr: 234 | const unsigned char *name, 2023-10-08T12:04:16.330 INFO:teuthology.orchestra.run.smithi156.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~^~~~ 2023-10-08T12:04:16.331 INFO:teuthology.orchestra.run.smithi156.stderr:hash.c:431:56: warning: pointer targets in passing argument 2 of 'collide_xattrs' differ in signedness [-Wpointer-sign] 2023-10-08T12:04:16.331 INFO:teuthology.orchestra.run.smithi156.stderr: 431 | error = collide_xattrs(nr, argv[c], len, fd); 2023-10-08T12:04:16.331 INFO:teuthology.orchestra.run.smithi156.stderr: | ~~~~^~~ 2023-10-08T12:04:16.331 INFO:teuthology.orchestra.run.smithi156.stderr: | | 2023-10-08T12:04:16.331 INFO:teuthology.orchestra.run.smithi156.stderr: | char * 2023-10-08T12:04:16.331 INFO:teuthology.orchestra.run.smithi156.stderr:hash.c:300:34: note: expected 'const unsigned char *' but argument is of type 'char *' 2023-10-08T12:04:16.331 INFO:teuthology.orchestra.run.smithi156.stderr: 300 | const unsigned char *name, 2023-10-08T12:04:16.331 INFO:teuthology.orchestra.run.smithi156.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~^~~~ 2023-10-08T12:04:16.331 INFO:teuthology.orchestra.run.smithi156.stderr:hash.c:433:57: warning: pointer targets in passing argument 2 of 'collide_dirents' differ in signedness [-Wpointer-sign] 2023-10-08T12:04:16.331 INFO:teuthology.orchestra.run.smithi156.stderr: 433 | error = collide_dirents(nr, argv[c], len, fd); 2023-10-08T12:04:16.331 INFO:teuthology.orchestra.run.smithi156.stderr: | ~~~~^~~ 2023-10-08T12:04:16.331 INFO:teuthology.orchestra.run.smithi156.stderr: | | 2023-10-08T12:04:16.332 INFO:teuthology.orchestra.run.smithi156.stderr: | char * 2023-10-08T12:04:16.332 INFO:teuthology.orchestra.run.smithi156.stderr:hash.c:234:34: note: expected 'const unsigned char *' but argument is of type 'char *' 2023-10-08T12:04:16.332 INFO:teuthology.orchestra.run.smithi156.stderr: 234 | const unsigned char *name, 2023-10-08T12:04:16.332 INFO:teuthology.orchestra.run.smithi156.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~^~~~ 2023-10-08T12:04:16.421 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] help.o 2023-10-08T12:04:16.532 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] init.o 2023-10-08T12:04:16.674 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] inode.o 2023-10-08T12:04:16.960 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] input.o 2023-10-08T12:04:17.109 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] io.o 2023-10-08T12:04:17.328 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] logformat.o 2023-10-08T12:04:17.460 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] malloc.o 2023-10-08T12:04:17.564 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] metadump.o 2023-10-08T12:04:18.385 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] output.o 2023-10-08T12:04:18.503 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] print.o 2023-10-08T12:04:18.671 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] quit.o 2023-10-08T12:04:18.768 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] sb.o 2023-10-08T12:04:19.030 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] sig.o 2023-10-08T12:04:19.134 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] strvec.o 2023-10-08T12:04:19.252 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] text.o 2023-10-08T12:04:19.285 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:04:19.288 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:04:19.291 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:04:19.369 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] type.o 2023-10-08T12:04:19.501 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] write.o 2023-10-08T12:04:19.743 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] attrset.o 2023-10-08T12:04:19.882 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] symlink.o 2023-10-08T12:04:19.991 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] fsmap.o 2023-10-08T12:04:20.125 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] fuzz.o 2023-10-08T12:04:20.300 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] obfuscate.o 2023-10-08T12:04:20.453 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] btdump.o 2023-10-08T12:04:20.645 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] btheight.o 2023-10-08T12:04:20.828 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] convert.o 2023-10-08T12:04:20.983 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] info.o 2023-10-08T12:04:21.117 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] namei.o 2023-10-08T12:04:21.336 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] timelimit.o 2023-10-08T12:04:21.462 INFO:teuthology.orchestra.run.smithi156.stdout: [LD] xfs_db 2023-10-08T12:04:21.708 INFO:teuthology.orchestra.run.smithi156.stdout:Building estimate 2023-10-08T12:04:21.765 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] xfs_estimate.o 2023-10-08T12:04:21.912 INFO:teuthology.orchestra.run.smithi156.stdout: [LD] xfs_estimate 2023-10-08T12:04:21.999 INFO:teuthology.orchestra.run.smithi156.stdout:Building fsck 2023-10-08T12:04:22.005 INFO:teuthology.orchestra.run.smithi156.stdout:Building fsr 2023-10-08T12:04:22.064 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] xfs_fsr.o 2023-10-08T12:04:22.493 INFO:teuthology.orchestra.run.smithi156.stdout: [LD] xfs_fsr 2023-10-08T12:04:22.618 INFO:teuthology.orchestra.run.smithi156.stdout:Building growfs 2023-10-08T12:04:22.674 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] xfs_growfs.o 2023-10-08T12:04:22.860 INFO:teuthology.orchestra.run.smithi156.stdout: [LD] xfs_growfs 2023-10-08T12:04:23.044 INFO:teuthology.orchestra.run.smithi156.stdout:Building io 2023-10-08T12:04:24.447 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] init.o 2023-10-08T12:04:24.564 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] attr.o 2023-10-08T12:04:24.707 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] bmap.o 2023-10-08T12:04:24.889 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] bulkstat.o 2023-10-08T12:04:25.050 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] crc32cselftest.o 2023-10-08T12:04:25.136 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] cowextsize.o 2023-10-08T12:04:25.249 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] encrypt.o 2023-10-08T12:04:25.477 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] file.o 2023-10-08T12:04:25.583 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] freeze.o 2023-10-08T12:04:25.672 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] fsuuid.o 2023-10-08T12:04:25.771 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] fsync.o 2023-10-08T12:04:25.850 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] getrusage.o 2023-10-08T12:04:25.942 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] imap.o 2023-10-08T12:04:26.030 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] inject.o 2023-10-08T12:04:26.129 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] label.o 2023-10-08T12:04:26.244 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] link.o 2023-10-08T12:04:26.323 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] mmap.o 2023-10-08T12:04:26.533 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] open.o 2023-10-08T12:04:26.816 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] parent.o 2023-10-08T12:04:26.974 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] pread.o 2023-10-08T12:04:27.153 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] prealloc.o 2023-10-08T12:04:27.294 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] pwrite.o 2023-10-08T12:04:27.447 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] reflink.o 2023-10-08T12:04:27.579 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] resblks.o 2023-10-08T12:04:27.664 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] scrub.o 2023-10-08T12:04:27.794 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] seek.o 2023-10-08T12:04:27.900 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] shutdown.o 2023-10-08T12:04:27.983 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] stat.o 2023-10-08T12:04:28.188 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] swapext.o 2023-10-08T12:04:28.276 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] sync.o 2023-10-08T12:04:28.354 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] truncate.o 2023-10-08T12:04:28.434 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] utimes.o 2023-10-08T12:04:28.517 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] fadvise.o 2023-10-08T12:04:28.607 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] madvise.o 2023-10-08T12:04:28.699 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] mincore.o 2023-10-08T12:04:28.793 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] sendfile.o 2023-10-08T12:04:28.896 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] fiemap.o 2023-10-08T12:04:29.047 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] copy_file_range.o 2023-10-08T12:04:29.148 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] sync_file_range.o 2023-10-08T12:04:29.239 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] readdir.o 2023-10-08T12:04:29.341 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] log_writes.o 2023-10-08T12:04:29.468 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] fsmap.o 2023-10-08T12:04:29.702 INFO:teuthology.orchestra.run.smithi156.stdout: [LD] xfs_io 2023-10-08T12:04:29.889 INFO:teuthology.orchestra.run.smithi156.stdout:Building logprint 2023-10-08T12:04:30.169 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] logprint.o 2023-10-08T12:04:30.312 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] log_copy.o 2023-10-08T12:04:30.429 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] log_dump.o 2023-10-08T12:04:30.552 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] log_misc.o 2023-10-08T12:04:31.074 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] log_print_all.o 2023-10-08T12:04:31.338 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] log_print_trans.o 2023-10-08T12:04:31.453 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] log_redo.o 2023-10-08T12:04:31.710 INFO:teuthology.orchestra.run.smithi156.stdout: [LD] xfs_logprint 2023-10-08T12:04:31.900 INFO:teuthology.orchestra.run.smithi156.stdout:Building mkfs 2023-10-08T12:04:31.996 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] proto.o 2023-10-08T12:04:32.283 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] xfs_mkfs.o 2023-10-08T12:04:33.010 INFO:teuthology.orchestra.run.smithi156.stdout: [LD] mkfs.xfs 2023-10-08T12:04:33.202 INFO:teuthology.orchestra.run.smithi156.stdout:Building quota 2023-10-08T12:04:33.592 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] init.o 2023-10-08T12:04:33.694 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] util.o 2023-10-08T12:04:33.852 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] edit.o 2023-10-08T12:04:34.053 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] free.o 2023-10-08T12:04:34.202 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] linux.o 2023-10-08T12:04:34.279 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] path.o 2023-10-08T12:04:34.389 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] project.o 2023-10-08T12:04:34.535 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] quot.o 2023-10-08T12:04:34.689 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] quota.o 2023-10-08T12:04:34.860 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] report.o 2023-10-08T12:04:35.089 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] state.o 2023-10-08T12:04:35.266 INFO:teuthology.orchestra.run.smithi156.stdout: [LD] xfs_quota 2023-10-08T12:04:35.397 INFO:teuthology.orchestra.run.smithi156.stdout:Building mdrestore 2023-10-08T12:04:35.453 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] xfs_mdrestore.o 2023-10-08T12:04:35.624 INFO:teuthology.orchestra.run.smithi156.stdout: [LD] xfs_mdrestore 2023-10-08T12:04:35.789 INFO:teuthology.orchestra.run.smithi156.stdout:Building repair 2023-10-08T12:04:37.132 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] agheader.o 2023-10-08T12:04:37.350 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] agbtree.o 2023-10-08T12:04:37.593 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] attr_repair.o 2023-10-08T12:04:37.948 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] avl.o 2023-10-08T12:04:38.160 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] bulkload.o 2023-10-08T12:04:38.284 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] bmap.o 2023-10-08T12:04:38.438 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] btree.o 2023-10-08T12:04:38.779 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] da_util.o 2023-10-08T12:04:39.004 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] dino_chunks.o 2023-10-08T12:04:39.383 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] dinode.o 2023-10-08T12:04:40.115 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] dir2.o 2023-10-08T12:04:40.531 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] globals.o 2023-10-08T12:04:40.626 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] incore_bmc.o 2023-10-08T12:04:40.733 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] incore.o 2023-10-08T12:04:40.884 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] incore_ext.o 2023-10-08T12:04:41.107 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] incore_ino.o 2023-10-08T12:04:41.376 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] init.o 2023-10-08T12:04:41.516 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] phase1.o 2023-10-08T12:04:41.644 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] phase2.o 2023-10-08T12:04:41.839 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] phase3.o 2023-10-08T12:04:41.978 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] phase4.o 2023-10-08T12:04:42.168 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] phase5.o 2023-10-08T12:04:42.426 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] phase6.o 2023-10-08T12:04:43.286 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] phase7.o 2023-10-08T12:04:43.423 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] prefetch.o 2023-10-08T12:04:43.767 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] progress.o 2023-10-08T12:04:43.971 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] quotacheck.o 2023-10-08T12:04:44.183 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] rmap.o 2023-10-08T12:04:44.576 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] rt.o 2023-10-08T12:04:44.740 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] sb.o 2023-10-08T12:04:44.965 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] scan.o 2023-10-08T12:04:45.743 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] slab.o 2023-10-08T12:04:45.906 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] threads.o 2023-10-08T12:04:46.015 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] versions.o 2023-10-08T12:04:46.143 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] xfs_repair.o 2023-10-08T12:04:46.460 INFO:teuthology.orchestra.run.smithi156.stdout: [LD] xfs_repair 2023-10-08T12:04:46.707 INFO:teuthology.orchestra.run.smithi156.stdout:Building rtcp 2023-10-08T12:04:46.764 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] xfs_rtcp.o 2023-10-08T12:04:46.942 INFO:teuthology.orchestra.run.smithi156.stdout: [LD] xfs_rtcp 2023-10-08T12:04:47.045 INFO:teuthology.orchestra.run.smithi156.stdout:Building m4 2023-10-08T12:04:47.052 INFO:teuthology.orchestra.run.smithi156.stdout:Building man 2023-10-08T12:04:47.061 INFO:teuthology.orchestra.run.smithi156.stdout:Building man2 2023-10-08T12:04:47.071 INFO:teuthology.orchestra.run.smithi156.stdout:Building man3 2023-10-08T12:04:47.081 INFO:teuthology.orchestra.run.smithi156.stdout:Building man5 2023-10-08T12:04:47.089 INFO:teuthology.orchestra.run.smithi156.stdout:Building man8 2023-10-08T12:04:47.106 INFO:teuthology.orchestra.run.smithi156.stdout: [SED] mkfs.xfs.8 2023-10-08T12:04:47.113 INFO:teuthology.orchestra.run.smithi156.stdout:Building doc 2023-10-08T12:04:47.122 INFO:teuthology.orchestra.run.smithi156.stdout: [ZIP] CHANGES.gz 2023-10-08T12:04:47.134 INFO:teuthology.orchestra.run.smithi156.stdout:Building debian 2023-10-08T12:04:47.141 INFO:teuthology.orchestra.run.smithi156.stdout:Building spaceman 2023-10-08T12:04:47.427 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] info.o 2023-10-08T12:04:47.531 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] init.o 2023-10-08T12:04:47.655 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] file.o 2023-10-08T12:04:47.778 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] health.o 2023-10-08T12:04:47.944 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] prealloc.o 2023-10-08T12:04:48.062 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] trim.o 2023-10-08T12:04:48.190 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] freesp.o 2023-10-08T12:04:48.378 INFO:teuthology.orchestra.run.smithi156.stdout: [LD] xfs_spaceman 2023-10-08T12:04:48.505 INFO:teuthology.orchestra.run.smithi156.stdout:Building scrub 2023-10-08T12:04:49.234 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] common.o 2023-10-08T12:04:49.382 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] counter.o 2023-10-08T12:04:49.415 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:04:49.418 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:04:49.421 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:04:49.457 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] descr.o 2023-10-08T12:04:49.544 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] disk.o 2023-10-08T12:04:49.668 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] filemap.o 2023-10-08T12:04:49.762 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] fscounters.o 2023-10-08T12:04:49.865 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] inodes.o 2023-10-08T12:04:50.014 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] phase1.o 2023-10-08T12:04:50.127 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] phase2.o 2023-10-08T12:04:50.232 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] phase3.o 2023-10-08T12:04:50.352 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] phase4.o 2023-10-08T12:04:50.453 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] phase5.o 2023-10-08T12:04:50.604 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] phase6.o 2023-10-08T12:04:50.790 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] phase7.o 2023-10-08T12:04:50.911 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] progress.o 2023-10-08T12:04:51.024 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] read_verify.o 2023-10-08T12:04:51.154 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] repair.o 2023-10-08T12:04:51.277 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] scrub.o 2023-10-08T12:04:51.492 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] spacemap.o 2023-10-08T12:04:51.610 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] vfs.o 2023-10-08T12:04:51.735 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] xfs_scrub.o 2023-10-08T12:04:51.941 INFO:teuthology.orchestra.run.smithi156.stdout: [CC] unicrash.o 2023-10-08T12:04:52.119 INFO:teuthology.orchestra.run.smithi156.stdout: [LD] xfs_scrub 2023-10-08T12:04:52.312 INFO:teuthology.orchestra.run.smithi156.stdout: [SED] xfs_scrub_all 2023-10-08T12:04:52.321 INFO:teuthology.orchestra.run.smithi156.stdout: [SED] xfs_scrub@.service 2023-10-08T12:04:52.327 INFO:teuthology.orchestra.run.smithi156.stdout: [SED] xfs_scrub_all.service 2023-10-08T12:04:52.334 INFO:teuthology.orchestra.run.smithi156.stdout: [SED] xfs_scrub_fail@.service 2023-10-08T12:04:52.340 INFO:teuthology.orchestra.run.smithi156.stdout: [SED] xfs_scrub_all.cron 2023-10-08T12:04:52.346 INFO:teuthology.orchestra.run.smithi156.stdout:Building po 2023-10-08T12:04:52.373 INFO:teuthology.orchestra.run.smithi156.stdout: [GETTXT] xfsprogs.pot 2023-10-08T12:04:52.616 INFO:teuthology.orchestra.run.smithi156.stdout: [MSGFMT] de.mo 2023-10-08T12:04:52.660 INFO:teuthology.orchestra.run.smithi156.stderr:2345 translated messages. 2023-10-08T12:04:52.662 INFO:teuthology.orchestra.run.smithi156.stdout: [MSGFMT] pl.mo 2023-10-08T12:04:52.708 INFO:teuthology.orchestra.run.smithi156.stderr:3104 translated messages. 2023-10-08T12:04:52.708 INFO:teuthology.orchestra.run.smithi156.stdout:gmake[2]: Nothing to be done for 'include'. 2023-10-08T12:04:52.712 DEBUG:teuthology.orchestra.run.smithi156:> (cd /tmp/tmp.yqkYNsO2b0xfsprogs-dev && exec sudo make install) 2023-10-08T12:04:52.744 INFO:teuthology.orchestra.run.smithi156.stdout:Installing libfrog-install 2023-10-08T12:04:53.191 INFO:teuthology.orchestra.run.smithi156.stdout:Installing libxfs-install 2023-10-08T12:04:54.869 INFO:teuthology.orchestra.run.smithi156.stdout:../install-sh -o root -g root -m 755 -d /usr/include/xfs 2023-10-08T12:04:54.891 INFO:teuthology.orchestra.run.smithi156.stdout:Installing libxlog-install 2023-10-08T12:04:54.982 INFO:teuthology.orchestra.run.smithi156.stdout:Installing libxcmd-install 2023-10-08T12:04:55.118 INFO:teuthology.orchestra.run.smithi156.stdout:Installing libhandle-install 2023-10-08T12:04:55.195 INFO:teuthology.orchestra.run.smithi156.stdout:cd ../libhandle/.libs; ../../install-sh -o root -g root -m 755 -d /lib; ../../install-sh -o root -g root -m 755 -T so_dot_version libhandle.lai /lib; ../../install-sh -o root -g root -T so_dot_current libhandle.lai /lib 2023-10-08T12:04:55.261 INFO:teuthology.orchestra.run.smithi156.stdout:Installing copy-install 2023-10-08T12:04:55.313 INFO:teuthology.orchestra.run.smithi156.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-10-08T12:04:55.333 INFO:teuthology.orchestra.run.smithi156.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_copy /usr/sbin 2023-10-08T12:04:55.388 INFO:teuthology.orchestra.run.smithi156.stdout:Installing db-install 2023-10-08T12:04:57.423 INFO:teuthology.orchestra.run.smithi156.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-10-08T12:04:57.443 INFO:teuthology.orchestra.run.smithi156.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_db /usr/sbin 2023-10-08T12:04:57.500 INFO:teuthology.orchestra.run.smithi156.stdout:../install-sh -o root -g root -m 755 xfs_admin.sh /usr/sbin/xfs_admin 2023-10-08T12:04:57.521 INFO:teuthology.orchestra.run.smithi156.stdout:../install-sh -o root -g root -m 755 xfs_ncheck.sh /usr/sbin/xfs_ncheck 2023-10-08T12:04:57.541 INFO:teuthology.orchestra.run.smithi156.stdout:../install-sh -o root -g root -m 755 xfs_metadump.sh /usr/sbin/xfs_metadump 2023-10-08T12:04:57.564 INFO:teuthology.orchestra.run.smithi156.stdout:Installing estimate-install 2023-10-08T12:04:57.615 INFO:teuthology.orchestra.run.smithi156.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-10-08T12:04:57.635 INFO:teuthology.orchestra.run.smithi156.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_estimate /usr/sbin 2023-10-08T12:04:57.684 INFO:teuthology.orchestra.run.smithi156.stdout:Installing fsck-install 2023-10-08T12:04:57.688 INFO:teuthology.orchestra.run.smithi156.stdout:../install-sh -o root -g root -m 755 -d /sbin 2023-10-08T12:04:57.708 INFO:teuthology.orchestra.run.smithi156.stdout:../install-sh -o root -g root -m 755 xfs_fsck.sh /sbin/fsck.xfs 2023-10-08T12:04:57.730 INFO:teuthology.orchestra.run.smithi156.stdout:Installing fsr-install 2023-10-08T12:04:57.783 INFO:teuthology.orchestra.run.smithi156.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-10-08T12:04:57.803 INFO:teuthology.orchestra.run.smithi156.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_fsr /usr/sbin 2023-10-08T12:04:57.852 INFO:teuthology.orchestra.run.smithi156.stdout:Installing growfs-install 2023-10-08T12:04:57.905 INFO:teuthology.orchestra.run.smithi156.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-10-08T12:04:57.924 INFO:teuthology.orchestra.run.smithi156.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_growfs /usr/sbin 2023-10-08T12:04:57.979 INFO:teuthology.orchestra.run.smithi156.stdout:Installing io-install 2023-10-08T12:04:59.373 INFO:teuthology.orchestra.run.smithi156.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-10-08T12:04:59.393 INFO:teuthology.orchestra.run.smithi156.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_io /usr/sbin 2023-10-08T12:04:59.442 INFO:teuthology.orchestra.run.smithi156.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_bmap.sh /usr/sbin/xfs_bmap 2023-10-08T12:04:59.488 INFO:teuthology.orchestra.run.smithi156.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_freeze.sh /usr/sbin/xfs_freeze 2023-10-08T12:04:59.535 INFO:teuthology.orchestra.run.smithi156.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_mkfile.sh /usr/sbin/xfs_mkfile 2023-10-08T12:04:59.583 INFO:teuthology.orchestra.run.smithi156.stdout:Installing logprint-install 2023-10-08T12:04:59.859 INFO:teuthology.orchestra.run.smithi156.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-10-08T12:04:59.879 INFO:teuthology.orchestra.run.smithi156.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_logprint /usr/sbin 2023-10-08T12:04:59.935 INFO:teuthology.orchestra.run.smithi156.stdout:Installing mkfs-install 2023-10-08T12:05:00.027 INFO:teuthology.orchestra.run.smithi156.stdout:../install-sh -o root -g root -m 755 -d /sbin 2023-10-08T12:05:00.047 INFO:teuthology.orchestra.run.smithi156.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 mkfs.xfs /sbin 2023-10-08T12:05:00.101 INFO:teuthology.orchestra.run.smithi156.stdout:../install-sh -o root -g root -m 755 -d /usr/share/xfsprogs/mkfs 2023-10-08T12:05:00.122 INFO:teuthology.orchestra.run.smithi156.stdout:../install-sh -o root -g root -m 644 dax_x86_64.conf lts_4.19.conf lts_5.4.conf lts_5.10.conf lts_5.15.conf lts_6.1.conf /usr/share/xfsprogs/mkfs 2023-10-08T12:05:00.173 INFO:teuthology.orchestra.run.smithi156.stdout:Installing quota-install 2023-10-08T12:05:00.542 INFO:teuthology.orchestra.run.smithi156.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-10-08T12:05:00.562 INFO:teuthology.orchestra.run.smithi156.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_quota /usr/sbin 2023-10-08T12:05:00.612 INFO:teuthology.orchestra.run.smithi156.stdout:Installing mdrestore-install 2023-10-08T12:05:00.663 INFO:teuthology.orchestra.run.smithi156.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-10-08T12:05:00.684 INFO:teuthology.orchestra.run.smithi156.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_mdrestore /usr/sbin 2023-10-08T12:05:00.738 INFO:teuthology.orchestra.run.smithi156.stdout:Installing repair-install 2023-10-08T12:05:02.074 INFO:teuthology.orchestra.run.smithi156.stdout:../install-sh -o root -g root -m 755 -d /sbin 2023-10-08T12:05:02.095 INFO:teuthology.orchestra.run.smithi156.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_repair /sbin 2023-10-08T12:05:02.154 INFO:teuthology.orchestra.run.smithi156.stdout:Installing rtcp-install 2023-10-08T12:05:02.206 INFO:teuthology.orchestra.run.smithi156.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-10-08T12:05:02.226 INFO:teuthology.orchestra.run.smithi156.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_rtcp /usr/sbin 2023-10-08T12:05:02.274 INFO:teuthology.orchestra.run.smithi156.stdout:Installing m4-install 2023-10-08T12:05:02.278 INFO:teuthology.orchestra.run.smithi156.stdout:gmake[1]: Nothing to be done for 'install'. 2023-10-08T12:05:02.280 INFO:teuthology.orchestra.run.smithi156.stdout:Installing man-install 2023-10-08T12:05:02.290 INFO:teuthology.orchestra.run.smithi156.stdout:gmake[2]: Nothing to be done for 'install'. 2023-10-08T12:05:02.296 INFO:teuthology.orchestra.run.smithi156.stdout:gmake[2]: Nothing to be done for 'install'. 2023-10-08T12:05:02.304 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 755 -d /usr/share/man/man5 2023-10-08T12:05:02.331 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 644 projects.5 /usr/share/man/man5/projects.5 2023-10-08T12:05:02.354 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 644 projid.5 /usr/share/man/man5/projid.5 2023-10-08T12:05:02.378 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 644 xfs.5 /usr/share/man/man5/xfs.5 2023-10-08T12:05:02.408 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 755 -d /usr/share/man/man8 2023-10-08T12:05:02.435 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 644 fsck.xfs.8 /usr/share/man/man8/fsck.xfs.8 2023-10-08T12:05:02.458 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 644 mkfs.xfs.8 /usr/share/man/man8/mkfs.xfs.8 2023-10-08T12:05:02.482 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 644 xfs_admin.8 /usr/share/man/man8/xfs_admin.8 2023-10-08T12:05:02.506 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 644 xfs_bmap.8 /usr/share/man/man8/xfs_bmap.8 2023-10-08T12:05:02.530 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 644 xfs_copy.8 /usr/share/man/man8/xfs_copy.8 2023-10-08T12:05:02.554 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 644 xfs_db.8 /usr/share/man/man8/xfs_db.8 2023-10-08T12:05:02.578 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 644 xfs_estimate.8 /usr/share/man/man8/xfs_estimate.8 2023-10-08T12:05:02.602 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 644 xfs_freeze.8 /usr/share/man/man8/xfs_freeze.8 2023-10-08T12:05:02.626 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 644 xfs_fsr.8 /usr/share/man/man8/xfs_fsr.8 2023-10-08T12:05:02.649 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 644 xfs_growfs.8 /usr/share/man/man8/xfs_growfs.8 2023-10-08T12:05:02.673 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 644 xfs_info.8 /usr/share/man/man8/xfs_info.8 2023-10-08T12:05:02.697 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 644 xfs_io.8 /usr/share/man/man8/xfs_io.8 2023-10-08T12:05:02.721 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 644 xfs_logprint.8 /usr/share/man/man8/xfs_logprint.8 2023-10-08T12:05:02.745 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 644 xfs_mdrestore.8 /usr/share/man/man8/xfs_mdrestore.8 2023-10-08T12:05:02.768 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 644 xfs_metadump.8 /usr/share/man/man8/xfs_metadump.8 2023-10-08T12:05:02.792 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 644 xfs_mkfile.8 /usr/share/man/man8/xfs_mkfile.8 2023-10-08T12:05:02.815 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 644 xfs_ncheck.8 /usr/share/man/man8/xfs_ncheck.8 2023-10-08T12:05:02.839 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 644 xfs_quota.8 /usr/share/man/man8/xfs_quota.8 2023-10-08T12:05:02.863 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 644 xfs_repair.8 /usr/share/man/man8/xfs_repair.8 2023-10-08T12:05:02.886 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 644 xfs_rtcp.8 /usr/share/man/man8/xfs_rtcp.8 2023-10-08T12:05:02.910 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 644 xfs_scrub.8 /usr/share/man/man8/xfs_scrub.8 2023-10-08T12:05:02.934 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 644 xfs_scrub_all.8 /usr/share/man/man8/xfs_scrub_all.8 2023-10-08T12:05:02.958 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 644 xfs_spaceman.8 /usr/share/man/man8/xfs_spaceman.8 2023-10-08T12:05:02.981 INFO:teuthology.orchestra.run.smithi156.stdout:../../install-sh -o root -g root -m 644 mkfs.xfs.8 /usr/share/man/man8/mkfs.xfs.8 2023-10-08T12:05:03.003 INFO:teuthology.orchestra.run.smithi156.stdout:Installing doc-install 2023-10-08T12:05:03.007 INFO:teuthology.orchestra.run.smithi156.stdout:../install-sh -o root -g root -m 755 -d /usr/share/doc/xfsprogs 2023-10-08T12:05:03.028 INFO:teuthology.orchestra.run.smithi156.stdout:../install-sh -o root -g root -m 644 CHANGES.gz CREDITS /usr/share/doc/xfsprogs 2023-10-08T12:05:03.059 INFO:teuthology.orchestra.run.smithi156.stdout:Installing debian-install 2023-10-08T12:05:03.063 INFO:teuthology.orchestra.run.smithi156.stdout:gmake[1]: Nothing to be done for 'install'. 2023-10-08T12:05:03.065 INFO:teuthology.orchestra.run.smithi156.stdout:Installing spaceman-install 2023-10-08T12:05:03.346 INFO:teuthology.orchestra.run.smithi156.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-10-08T12:05:03.366 INFO:teuthology.orchestra.run.smithi156.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_spaceman /usr/sbin 2023-10-08T12:05:03.413 INFO:teuthology.orchestra.run.smithi156.stdout:../install-sh -o root -g root -m 755 xfs_info.sh /usr/sbin/xfs_info 2023-10-08T12:05:03.436 INFO:teuthology.orchestra.run.smithi156.stdout:Installing scrub-install 2023-10-08T12:05:04.163 INFO:teuthology.orchestra.run.smithi156.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-10-08T12:05:04.182 INFO:teuthology.orchestra.run.smithi156.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_scrub /usr/sbin 2023-10-08T12:05:04.231 INFO:teuthology.orchestra.run.smithi156.stdout:../install-sh -o root -g root -m 755 xfs_scrub_all /usr/sbin 2023-10-08T12:05:04.251 INFO:teuthology.orchestra.run.smithi156.stdout:../install-sh -o root -g root -m 755 -d /lib/systemd/system 2023-10-08T12:05:04.271 INFO:teuthology.orchestra.run.smithi156.stdout:../install-sh -o root -g root -m 644 xfs_scrub@.service xfs_scrub_all.service xfs_scrub_all.timer xfs_scrub_fail@.service /lib/systemd/system 2023-10-08T12:05:04.309 INFO:teuthology.orchestra.run.smithi156.stdout:../install-sh -o root -g root -m 755 -d /usr/lib/xfsprogs 2023-10-08T12:05:04.328 INFO:teuthology.orchestra.run.smithi156.stdout:../install-sh -o root -g root -m 755 xfs_scrub_fail /usr/lib/xfsprogs 2023-10-08T12:05:04.359 INFO:teuthology.orchestra.run.smithi156.stdout:../install-sh -o root -g root -m 755 -d /usr/lib/xfsprogs 2023-10-08T12:05:04.379 INFO:teuthology.orchestra.run.smithi156.stdout:../install-sh -o root -g root -m 644 xfs_scrub_all.cron /usr/lib/xfsprogs 2023-10-08T12:05:04.401 INFO:teuthology.orchestra.run.smithi156.stdout:Installing po-install 2023-10-08T12:05:04.496 INFO:teuthology.orchestra.run.smithi156.stdout:Installing include-install 2023-10-08T12:05:04.500 INFO:teuthology.orchestra.run.smithi156.stdout:../install-sh -o root -g root -m 755 -d /usr/include/xfs 2023-10-08T12:05:04.520 INFO:teuthology.orchestra.run.smithi156.stdout:./install-sh -o root -g root -m 755 -d /usr/share/doc/xfsprogs 2023-10-08T12:05:04.540 INFO:teuthology.orchestra.run.smithi156.stdout:./install-sh -o root -g root -m 644 README /usr/share/doc/xfsprogs 2023-10-08T12:05:04.564 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-10-08T12:05:04.705 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:04.699+0000 7fc61d827640 1 -- 172.21.15.62:0/1848430344 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc61806a930 msgr2=0x7fc61806ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:05:04.706 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:04.699+0000 7fc61d827640 1 --2- 172.21.15.62:0/1848430344 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc61806a930 0x7fc61806ad80 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fc618073460 tx=0x7fc61001f560 comp rx=0 tx=0).stop 2023-10-08T12:05:04.706 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:04.699+0000 7fc61d827640 1 -- 172.21.15.62:0/1848430344 shutdown_connections 2023-10-08T12:05:04.706 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:04.699+0000 7fc61d827640 1 --2- 172.21.15.62:0/1848430344 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc61806a930 0x7fc61806ad80 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:05:04.706 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:04.699+0000 7fc61d827640 1 --2- 172.21.15.62:0/1848430344 >> v2:172.21.15.130:3300/0 conn(0x7fc6180b5b00 0x7fc6180b9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:05:04.706 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:04.703+0000 7fc61d827640 1 -- 172.21.15.62:0/1848430344 >> 172.21.15.62:0/1848430344 conn(0x7fc61809c520 msgr2=0x7fc61809c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:05:04.706 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:04.703+0000 7fc61d827640 1 -- 172.21.15.62:0/1848430344 shutdown_connections 2023-10-08T12:05:04.706 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:04.703+0000 7fc61d827640 1 -- 172.21.15.62:0/1848430344 wait complete. 2023-10-08T12:05:04.708 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:04.703+0000 7fc61d827640 1 Processor -- start 2023-10-08T12:05:04.709 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:04.703+0000 7fc61d827640 1 -- start start 2023-10-08T12:05:04.709 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:04.703+0000 7fc61d827640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc61806a930 0x7fc61806e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:05:04.709 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:04.703+0000 7fc61d827640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc6180b09e0 0x7fc61809db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:05:04.709 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:04.703+0000 7fc61d827640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6180b5b00 0x7fc618140dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:05:04.709 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:04.703+0000 7fc61d827640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc61806e6b0 con 0x7fc6180b5b00 2023-10-08T12:05:04.709 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:04.703+0000 7fc61d827640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6181e3030 con 0x7fc61806a930 2023-10-08T12:05:04.709 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:04.703+0000 7fc61d827640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6180a05e0 con 0x7fc6180b09e0 2023-10-08T12:05:04.709 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:04.703+0000 7fc6177fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6180b5b00 0x7fc618140dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:05:04.709 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:04.703+0000 7fc6177fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6180b5b00 0x7fc618140dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58284/0 (socket says 172.21.15.62:58284) 2023-10-08T12:05:04.709 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:04.703+0000 7fc6177fe640 1 -- 172.21.15.62:0/2934279015 learned_addr learned my addr 172.21.15.62:0/2934279015 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:05:04.709 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:04.703+0000 7fc616ffd640 1 --2- 172.21.15.62:0/2934279015 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc61806a930 0x7fc61806e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:05:04.710 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:04.703+0000 7fc6167fc640 1 --2- 172.21.15.62:0/2934279015 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc6180b09e0 0x7fc61809db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:05:04.710 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:04.703+0000 7fc6177fe640 1 -- 172.21.15.62:0/2934279015 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc6180b09e0 msgr2=0x7fc61809db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:05:04.710 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:04.703+0000 7fc6177fe640 1 --2- 172.21.15.62:0/2934279015 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc6180b09e0 0x7fc61809db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:05:04.710 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:04.703+0000 7fc6177fe640 1 -- 172.21.15.62:0/2934279015 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc61806a930 msgr2=0x7fc61806e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:05:04.710 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:04.703+0000 7fc6177fe640 1 --2- 172.21.15.62:0/2934279015 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc61806a930 0x7fc61806e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:05:04.710 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:04.703+0000 7fc6177fe640 1 -- 172.21.15.62:0/2934279015 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6100098e0 con 0x7fc6180b5b00 2023-10-08T12:05:04.710 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:04.703+0000 7fc616ffd640 1 --2- 172.21.15.62:0/2934279015 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc61806a930 0x7fc61806e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:05:04.710 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:04.703+0000 7fc6177fe640 1 --2- 172.21.15.62:0/2934279015 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6180b5b00 0x7fc618140dd0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fc61001c170 tx=0x7fc610009390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:05:04.710 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:04.703+0000 7fc5fffff640 1 -- 172.21.15.62:0/2934279015 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc610004e60 con 0x7fc6180b5b00 2023-10-08T12:05:04.710 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:04.703+0000 7fc5fffff640 1 -- 172.21.15.62:0/2934279015 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc610003980 con 0x7fc6180b5b00 2023-10-08T12:05:04.710 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:04.703+0000 7fc61d827640 1 -- 172.21.15.62:0/2934279015 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6181e2700 con 0x7fc6180b5b00 2023-10-08T12:05:04.711 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:04.703+0000 7fc5fffff640 1 -- 172.21.15.62:0/2934279015 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc610003d30 con 0x7fc6180b5b00 2023-10-08T12:05:04.711 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:04.703+0000 7fc61d827640 1 -- 172.21.15.62:0/2934279015 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6181e2cc0 con 0x7fc6180b5b00 2023-10-08T12:05:04.711 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:04.703+0000 7fc61d827640 1 -- 172.21.15.62:0/2934279015 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6181e31c0 con 0x7fc6180b5b00 2023-10-08T12:05:04.711 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:04.707+0000 7fc5fffff640 1 -- 172.21.15.62:0/2934279015 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc6100b7070 con 0x7fc6180b5b00 2023-10-08T12:05:04.712 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:04.707+0000 7fc5fffff640 1 --2- 172.21.15.62:0/2934279015 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fc604066470 0x7fc604068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:05:04.712 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:04.707+0000 7fc5fffff640 1 -- 172.21.15.62:0/2934279015 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc6101224c0 con 0x7fc6180b5b00 2023-10-08T12:05:04.712 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:04.707+0000 7fc616ffd640 1 --2- 172.21.15.62:0/2934279015 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fc604066470 0x7fc604068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:05:04.712 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:04.707+0000 7fc616ffd640 1 --2- 172.21.15.62:0/2934279015 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fc604066470 0x7fc604068930 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc608005fd0 tx=0x7fc608005dc0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:05:04.714 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:04.711+0000 7fc5fffff640 1 -- 172.21.15.62:0/2934279015 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc6100ef9d0 con 0x7fc6180b5b00 2023-10-08T12:05:04.932 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:04.927+0000 7fc61d827640 1 -- 172.21.15.62:0/2934279015 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fc61804da80 con 0x7fc6180b5b00 2023-10-08T12:05:04.932 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:04.927+0000 7fc5fffff640 1 -- 172.21.15.62:0/2934279015 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1276 (secure 0 0 0) 0x7fc6100b5090 con 0x7fc6180b5b00 2023-10-08T12:05:04.932 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-10-08T12:05:04.933 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":1,"fsid":"3e777930-c2c1-4f2b-a903-c07ee4ca2c52","modified":"2023-10-08T11:59:19.870927Z","created":"2023-10-08T11:59:19.870927Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:3300","nonce":0},{"type":"v1","addr":"172.21.15.62:6789","nonce":0}]},"addr":"172.21.15.62:6789/0","public_addr":"172.21.15.62:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:3300","nonce":0},{"type":"v1","addr":"172.21.15.130:6789","nonce":0}]},"addr":"172.21.15.130:6789/0","public_addr":"172.21.15.130:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:3301","nonce":0},{"type":"v1","addr":"172.21.15.130:6790","nonce":0}]},"addr":"172.21.15.130:6790/0","public_addr":"172.21.15.130:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-10-08T12:05:04.933 INFO:teuthology.orchestra.run.smithi062.stderr:dumped monmap epoch 1 2023-10-08T12:05:04.935 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:04.931+0000 7fc61d827640 1 -- 172.21.15.62:0/2934279015 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fc604066470 msgr2=0x7fc604068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:05:04.935 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:04.931+0000 7fc61d827640 1 --2- 172.21.15.62:0/2934279015 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fc604066470 0x7fc604068930 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc608005fd0 tx=0x7fc608005dc0 comp rx=0 tx=0).stop 2023-10-08T12:05:04.935 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:04.931+0000 7fc61d827640 1 -- 172.21.15.62:0/2934279015 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6180b5b00 msgr2=0x7fc618140dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:05:04.935 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:04.931+0000 7fc61d827640 1 --2- 172.21.15.62:0/2934279015 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6180b5b00 0x7fc618140dd0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fc61001c170 tx=0x7fc610009390 comp rx=0 tx=0).stop 2023-10-08T12:05:04.935 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:04.931+0000 7fc61d827640 1 -- 172.21.15.62:0/2934279015 shutdown_connections 2023-10-08T12:05:04.935 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:04.931+0000 7fc61d827640 1 --2- 172.21.15.62:0/2934279015 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fc604066470 0x7fc604068930 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:05:04.935 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:04.931+0000 7fc61d827640 1 --2- 172.21.15.62:0/2934279015 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc6180b09e0 0x7fc61809db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:05:04.935 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:04.931+0000 7fc61d827640 1 --2- 172.21.15.62:0/2934279015 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6180b5b00 0x7fc618140dd0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:05:04.935 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:04.931+0000 7fc61d827640 1 --2- 172.21.15.62:0/2934279015 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc61806a930 0x7fc61806e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:05:04.935 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:04.931+0000 7fc61d827640 1 -- 172.21.15.62:0/2934279015 >> 172.21.15.62:0/2934279015 conn(0x7fc61809c520 msgr2=0x7fc618098300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:05:04.936 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:04.931+0000 7fc61d827640 1 -- 172.21.15.62:0/2934279015 shutdown_connections 2023-10-08T12:05:04.936 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:04.931+0000 7fc61d827640 1 -- 172.21.15.62:0/2934279015 wait complete. 2023-10-08T12:05:04.952 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2023-10-08T12:05:05.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:05.071+0000 7fc8e077c640 1 -- 172.21.15.62:0/684690241 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8d80b79d0 msgr2=0x7fc8d8071710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:05:05.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:05.071+0000 7fc8e077c640 1 --2- 172.21.15.62:0/684690241 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8d80b79d0 0x7fc8d8071710 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fc8d0009bc0 tx=0x7fc8d001f390 comp rx=0 tx=0).stop 2023-10-08T12:05:05.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:05.071+0000 7fc8e077c640 1 -- 172.21.15.62:0/684690241 shutdown_connections 2023-10-08T12:05:05.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:05.071+0000 7fc8e077c640 1 --2- 172.21.15.62:0/684690241 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc8d80b6990 0x7fc8d80b6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:05:05.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:05.071+0000 7fc8e077c640 1 --2- 172.21.15.62:0/684690241 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8d80b79d0 0x7fc8d8071710 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:05:05.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:05.071+0000 7fc8e077c640 1 -- 172.21.15.62:0/684690241 >> 172.21.15.62:0/684690241 conn(0x7fc8d809d610 msgr2=0x7fc8d809da20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:05:05.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:05.071+0000 7fc8e077c640 1 -- 172.21.15.62:0/684690241 shutdown_connections 2023-10-08T12:05:05.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:05.071+0000 7fc8e077c640 1 -- 172.21.15.62:0/684690241 wait complete. 2023-10-08T12:05:05.077 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:05.071+0000 7fc8e077c640 1 Processor -- start 2023-10-08T12:05:05.077 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:05.071+0000 7fc8e077c640 1 -- start start 2023-10-08T12:05:05.077 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:05.071+0000 7fc8e077c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8d806d830 0x7fc8d8142b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:05:05.077 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:05.071+0000 7fc8e077c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc8d80b6990 0x7fc8d81df870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:05:05.078 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:05.071+0000 7fc8e077c640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc8d80b79d0 0x7fc8d813f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:05:05.078 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:05.071+0000 7fc8e077c640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d809ecf0 con 0x7fc8d806d830 2023-10-08T12:05:05.078 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:05.071+0000 7fc8e077c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d809a940 con 0x7fc8d80b6990 2023-10-08T12:05:05.078 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:05.071+0000 7fc8e077c640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d8143070 con 0x7fc8d80b79d0 2023-10-08T12:05:05.078 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:05.071+0000 7fc8de518640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8d806d830 0x7fc8d8142b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:05:05.078 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:05.071+0000 7fc8de518640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8d806d830 0x7fc8d8142b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58294/0 (socket says 172.21.15.62:58294) 2023-10-08T12:05:05.078 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:05.071+0000 7fc8de518640 1 -- 172.21.15.62:0/4053985248 learned_addr learned my addr 172.21.15.62:0/4053985248 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-10-08T12:05:05.078 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:05.071+0000 7fc8de518640 1 -- 172.21.15.62:0/4053985248 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc8d80b79d0 msgr2=0x7fc8d813f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:05:05.078 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:05.071+0000 7fc8de518640 1 --2- 172.21.15.62:0/4053985248 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc8d80b79d0 0x7fc8d813f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:05:05.078 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:05.071+0000 7fc8de518640 1 -- 172.21.15.62:0/4053985248 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc8d80b6990 msgr2=0x7fc8d81df870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:05:05.078 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:05.071+0000 7fc8de518640 1 --2- 172.21.15.62:0/4053985248 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc8d80b6990 0x7fc8d81df870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:05:05.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:05.071+0000 7fc8de518640 1 -- 172.21.15.62:0/4053985248 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8d0009820 con 0x7fc8d806d830 2023-10-08T12:05:05.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:05.071+0000 7fc8de518640 1 --2- 172.21.15.62:0/4053985248 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8d806d830 0x7fc8d8142b30 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fc8d0009b10 tx=0x7fc8d00092a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:05:05.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:05.071+0000 7fc8d6ffd640 1 -- 172.21.15.62:0/4053985248 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d00be070 con 0x7fc8d806d830 2023-10-08T12:05:05.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:05.071+0000 7fc8d6ffd640 1 -- 172.21.15.62:0/4053985248 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc8d00a8e90 con 0x7fc8d806d830 2023-10-08T12:05:05.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:05.071+0000 7fc8e077c640 1 -- 172.21.15.62:0/4053985248 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8d809ea10 con 0x7fc8d806d830 2023-10-08T12:05:05.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:05.071+0000 7fc8d6ffd640 1 -- 172.21.15.62:0/4053985248 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d0004cb0 con 0x7fc8d806d830 2023-10-08T12:05:05.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:05.075+0000 7fc8e077c640 1 -- 172.21.15.62:0/4053985248 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8d81df350 con 0x7fc8d806d830 2023-10-08T12:05:05.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:05.075+0000 7fc8e077c640 1 -- 172.21.15.62:0/4053985248 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8d81df1b0 con 0x7fc8d806d830 2023-10-08T12:05:05.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:05.075+0000 7fc8d6ffd640 1 -- 172.21.15.62:0/4053985248 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc8d00b6070 con 0x7fc8d806d830 2023-10-08T12:05:05.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:05.075+0000 7fc8d6ffd640 1 --2- 172.21.15.62:0/4053985248 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fc8c4066470 0x7fc8c4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:05:05.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:05.075+0000 7fc8d6ffd640 1 -- 172.21.15.62:0/4053985248 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc8d01217c0 con 0x7fc8d806d830 2023-10-08T12:05:05.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:05.075+0000 7fc8ddd17640 1 --2- 172.21.15.62:0/4053985248 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fc8c4066470 0x7fc8c4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:05:05.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:05.075+0000 7fc8ddd17640 1 --2- 172.21.15.62:0/4053985248 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fc8c4066470 0x7fc8c4068930 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc8d81dcd70 tx=0x7fc8cc007930 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:05:05.083 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:05.079+0000 7fc8d6ffd640 1 -- 172.21.15.62:0/4053985248 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc8d81df1b0 con 0x7fc8d806d830 2023-10-08T12:05:05.291 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:05.287+0000 7fc8e077c640 1 -- 172.21.15.62:0/4053985248 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) v1 -- 0x7fc8d81df1b0 con 0x7fc8d806d830 2023-10-08T12:05:05.292 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:05.287+0000 7fc8d6ffd640 1 -- 172.21.15.62:0/4053985248 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v15) v1 ==== 92+0+63 (secure 0 0 0) 0x7fc8d81df1b0 con 0x7fc8d806d830 2023-10-08T12:05:05.292 INFO:teuthology.orchestra.run.smithi062.stdout:[client.admin] 2023-10-08T12:05:05.292 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCYmSJlZGuKBRAAwp6lQTFcdd0ZaqeY7H1U5A== 2023-10-08T12:05:05.294 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:05.291+0000 7fc8e077c640 1 -- 172.21.15.62:0/4053985248 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fc8c4066470 msgr2=0x7fc8c4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:05:05.294 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:05.291+0000 7fc8e077c640 1 --2- 172.21.15.62:0/4053985248 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fc8c4066470 0x7fc8c4068930 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc8d81dcd70 tx=0x7fc8cc007930 comp rx=0 tx=0).stop 2023-10-08T12:05:05.294 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:05.291+0000 7fc8e077c640 1 -- 172.21.15.62:0/4053985248 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8d806d830 msgr2=0x7fc8d8142b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:05:05.295 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:05.291+0000 7fc8e077c640 1 --2- 172.21.15.62:0/4053985248 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8d806d830 0x7fc8d8142b30 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fc8d0009b10 tx=0x7fc8d00092a0 comp rx=0 tx=0).stop 2023-10-08T12:05:05.295 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:05.291+0000 7fc8e077c640 1 -- 172.21.15.62:0/4053985248 shutdown_connections 2023-10-08T12:05:05.295 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:05.291+0000 7fc8e077c640 1 --2- 172.21.15.62:0/4053985248 >> [v2:172.21.15.130:6832/826384843,v1:172.21.15.130:6833/826384843] conn(0x7fc8c4066470 0x7fc8c4068930 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:05:05.295 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:05.291+0000 7fc8e077c640 1 --2- 172.21.15.62:0/4053985248 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc8d80b79d0 0x7fc8d813f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:05:05.295 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:05.291+0000 7fc8e077c640 1 --2- 172.21.15.62:0/4053985248 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc8d80b6990 0x7fc8d81df870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:05:05.295 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:05.291+0000 7fc8e077c640 1 --2- 172.21.15.62:0/4053985248 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8d806d830 0x7fc8d8142b30 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:05:05.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:05.291+0000 7fc8e077c640 1 -- 172.21.15.62:0/4053985248 >> 172.21.15.62:0/4053985248 conn(0x7fc8d809d610 msgr2=0x7fc8d80b5030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:05:05.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:05.291+0000 7fc8e077c640 1 -- 172.21.15.62:0/4053985248 shutdown_connections 2023-10-08T12:05:05.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-10-08T12:05:05.291+0000 7fc8e077c640 1 -- 172.21.15.62:0/4053985248 wait complete. 2023-10-08T12:05:05.309 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-10-08T12:05:05.309 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/tmp/tmp.3RpD2mKkbxxfstests-dev/local.config 2023-10-08T12:05:05.331 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.62:6789:/test export TEST_DIR=/tmp/tmp.ZQPbrv5NcXtest export SCRATCH_DEV=172.21.15.62:6789:/scratch export SCRATCH_MNT=/tmp/tmp.9EPeO8cn4xscratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQCYmSJlZGuKBRAAwp6lQTFcdd0ZaqeY7H1U5A==,test_dummy_encryption" 2023-10-08T12:05:05.331 INFO:teuthology.orchestra.run:Running command with timeout 10800 2023-10-08T12:05:05.331 DEBUG:teuthology.orchestra.run.smithi156:running tests for dummy_encryption from xfstests-dev> (cd /tmp/tmp.3RpD2mKkbxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check -g quick -E ./ceph.exclude) 2023-10-08T12:05:07.079 INFO:teuthology.orchestra.run.smithi156.stdout:FSTYP -- ceph 2023-10-08T12:05:07.090 INFO:teuthology.orchestra.run.smithi156.stdout:PLATFORM -- Linux/x86_64 smithi156 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:08:23 UTC 2023 2023-10-08T12:05:07.091 INFO:teuthology.orchestra.run.smithi156.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-10-08T12:05:07.093 INFO:teuthology.orchestra.run.smithi156.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCYmSJlZGuKBRAAwp6lQTFcdd0ZaqeY7H1U5A==,test_dummy_encryption 172.21.15.62:6789:/scratch /tmp/tmp.9EPeO8cn4xscratch 2023-10-08T12:05:07.093 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-10-08T12:05:07.293 INFO:teuthology.orchestra.run.smithi156.stdout:ceph/001 [expunged] 2023-10-08T12:05:07.650 INFO:teuthology.orchestra.run.smithi156.stdout:ceph/002 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-10-08T12:05:07.990 INFO:teuthology.orchestra.run.smithi156.stdout:ceph/003 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-10-08T12:05:08.415 INFO:teuthology.orchestra.run.smithi156.stdout:ceph/004 0s 2023-10-08T12:05:08.724 INFO:teuthology.orchestra.run.smithi156.stdout:ceph/005 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-10-08T12:05:19.493 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:05:19.496 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:05:19.499 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:05:22.949 INFO:teuthology.orchestra.run.smithi156.stdout:generic/001 14s 2023-10-08T12:05:23.616 INFO:teuthology.orchestra.run.smithi156.stdout:generic/002 1s 2023-10-08T12:05:23.898 INFO:teuthology.orchestra.run.smithi156.stdout:generic/003 [not run] atime not maintained by ceph 2023-10-08T12:05:24.205 INFO:teuthology.orchestra.run.smithi156.stdout:generic/004 [not run] O_TMPFILE is not supported 2023-10-08T12:05:24.909 INFO:teuthology.orchestra.run.smithi156.stdout:generic/005 0s 2023-10-08T12:05:50.086 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:05:50.089 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:05:50.110 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:06:20.184 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:06:20.187 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:06:20.190 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:06:26.691 INFO:teuthology.orchestra.run.smithi156.stdout:generic/006 62s 2023-10-08T12:06:50.682 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:06:50.686 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:06:50.688 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:07:20.769 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:07:20.772 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:07:20.775 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:07:51.024 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:07:51.028 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:07:51.030 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:08:01.740 INFO:teuthology.orchestra.run.smithi156.stdout:generic/007 95s 2023-10-08T12:08:03.932 INFO:teuthology.orchestra.run.smithi156.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-10-08T12:08:06.233 INFO:teuthology.orchestra.run.smithi156.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-10-08T12:08:21.345 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:08:21.348 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:08:21.351 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:08:51.526 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:08:51.529 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:08:51.532 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:09:04.991 INFO:teuthology.orchestra.run.smithi156.stdout:generic/011 58s 2023-10-08T12:09:07.666 INFO:teuthology.orchestra.run.smithi156.stdout:generic/012 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-10-08T12:09:21.657 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:09:21.660 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:09:21.662 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:09:52.196 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:09:52.199 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:09:52.202 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:09:59.888 INFO:teuthology.orchestra.run.smithi156.stdout:generic/013 52s 2023-10-08T12:10:22.564 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:10:22.566 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:10:22.568 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:10:53.182 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:10:53.184 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:10:53.186 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:11:23.245 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:11:23.248 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:11:23.250 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:11:53.620 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:11:53.624 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:11:53.626 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:12:21.767 INFO:teuthology.orchestra.run.smithi156.stdout:generic/014 142s 2023-10-08T12:12:22.052 INFO:teuthology.orchestra.run.smithi156.stdout:generic/015 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-10-08T12:12:23.706 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:12:23.710 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:12:23.713 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:12:23.738 INFO:tasks.ceph.mds.a.smithi062.stderr:2023-10-08T12:12:23.738+0000 7ff78b7e4640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 48575) UID: 0 2023-10-08T12:12:23.739 INFO:tasks.ceph.mds.c.smithi062.stderr:2023-10-08T12:12:23.738+0000 7ffa62d68640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 48575) UID: 0 2023-10-08T12:12:24.414 INFO:teuthology.orchestra.run.smithi156.stdout:generic/016 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-10-08T12:12:24.878 INFO:teuthology.orchestra.run.smithi156.stdout:generic/018 [not run] defragmentation not supported for fstype "ceph" 2023-10-08T12:12:30.357 INFO:teuthology.orchestra.run.smithi156.stdout:generic/020 6s 2023-10-08T12:12:36.762 INFO:teuthology.orchestra.run.smithi156.stdout:generic/021 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-10-08T12:12:42.698 INFO:teuthology.orchestra.run.smithi156.stdout:generic/022 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-10-08T12:12:44.581 INFO:teuthology.orchestra.run.smithi156.stdout:generic/023 2s 2023-10-08T12:12:44.916 INFO:teuthology.orchestra.run.smithi156.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2023-10-08T12:12:45.254 INFO:teuthology.orchestra.run.smithi156.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2023-10-08T12:12:45.612 INFO:teuthology.orchestra.run.smithi156.stdout:generic/026 [not run] ceph does not define maximum ACL count 2023-10-08T12:12:50.921 INFO:teuthology.orchestra.run.smithi156.stdout:generic/028 5s 2023-10-08T12:12:52.108 INFO:teuthology.orchestra.run.smithi156.stdout:generic/029 2s 2023-10-08T12:13:05.593 INFO:teuthology.orchestra.run.smithi156.stdout:generic/030 13s 2023-10-08T12:13:10.360 INFO:teuthology.orchestra.run.smithi156.stdout:generic/031 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-10-08T12:13:10.669 INFO:teuthology.orchestra.run.smithi156.stdout:generic/032 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-10-08T12:13:16.108 INFO:teuthology.orchestra.run.smithi156.stdout:generic/033 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-10-08T12:13:16.404 INFO:teuthology.orchestra.run.smithi156.stdout:generic/034 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-10-08T12:13:16.823 INFO:teuthology.orchestra.run.smithi156.stdout:generic/035 0s 2023-10-08T12:13:23.892 INFO:teuthology.orchestra.run.smithi156.stdout:generic/037 7s 2023-10-08T12:13:24.314 INFO:teuthology.orchestra.run.smithi156.stdout:generic/039 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-10-08T12:13:24.642 INFO:teuthology.orchestra.run.smithi156.stdout:generic/040 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-10-08T12:13:24.994 INFO:teuthology.orchestra.run.smithi156.stdout:generic/041 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-10-08T12:13:25.473 INFO:teuthology.orchestra.run.smithi156.stdout:generic/042 [not run] ceph does not support shutdown 2023-10-08T12:13:25.977 INFO:teuthology.orchestra.run.smithi156.stdout:generic/050 [not run] ceph does not support shutdown 2023-10-08T12:13:26.486 INFO:teuthology.orchestra.run.smithi156.stdout:generic/052 [not run] ceph does not support shutdown 2023-10-08T12:13:27.420 INFO:teuthology.orchestra.run.smithi156.stdout:generic/053 1s 2023-10-08T12:13:27.802 INFO:teuthology.orchestra.run.smithi156.stdout:generic/056 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-10-08T12:13:28.128 INFO:teuthology.orchestra.run.smithi156.stdout:generic/057 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-10-08T12:13:36.561 INFO:teuthology.orchestra.run.smithi156.stdout:generic/058 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-10-08T12:13:36.904 INFO:teuthology.orchestra.run.smithi156.stdout:generic/059 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-10-08T12:13:42.013 INFO:teuthology.orchestra.run.smithi156.stdout:generic/060 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-10-08T12:13:52.634 INFO:teuthology.orchestra.run.smithi156.stdout:generic/061 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-10-08T12:13:55.025 INFO:teuthology.orchestra.run.smithi156.stdout:generic/062 3s 2023-10-08T12:14:01.250 INFO:teuthology.orchestra.run.smithi156.stdout:generic/063 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-10-08T12:14:01.593 INFO:teuthology.orchestra.run.smithi156.stdout:generic/064 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-10-08T12:14:01.905 INFO:teuthology.orchestra.run.smithi156.stdout:generic/065 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-10-08T12:14:02.232 INFO:teuthology.orchestra.run.smithi156.stdout:generic/066 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-10-08T12:14:02.598 INFO:teuthology.orchestra.run.smithi156.stdout:generic/067 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-10-08T12:14:24.001 INFO:teuthology.orchestra.run.smithi156.stdout:generic/069 21s 2023-10-08T12:14:43.495 INFO:teuthology.orchestra.run.smithi156.stdout:generic/070 19s 2023-10-08T12:14:43.788 INFO:teuthology.orchestra.run.smithi156.stdout:generic/071 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-10-08T12:14:44.115 INFO:teuthology.orchestra.run.smithi156.stdout:generic/073 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-10-08T12:15:04.807 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:15:04.810 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:15:04.812 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:15:34.866 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:15:34.868 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:15:34.871 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:15:45.287 INFO:teuthology.orchestra.run.smithi156.stdout:generic/075 61s 2023-10-08T12:15:45.568 INFO:teuthology.orchestra.run.smithi156.stdout:generic/076 [not run] require 172.21.15.62:6789:/scratch to be local device 2023-10-08T12:15:45.908 INFO:teuthology.orchestra.run.smithi156.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2023-10-08T12:15:46.231 INFO:teuthology.orchestra.run.smithi156.stdout:generic/079 [not run] file system doesn't support chattr +ia 2023-10-08T12:15:48.609 INFO:teuthology.orchestra.run.smithi156.stdout:generic/080 2s 2023-10-08T12:15:49.040 INFO:teuthology.orchestra.run.smithi156.stdout:generic/081 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-10-08T12:15:49.331 INFO:teuthology.orchestra.run.smithi156.stdout:generic/082 [not run] disk quotas not supported by this filesystem type: ceph 2023-10-08T12:15:55.081 INFO:teuthology.orchestra.run.smithi156.stdout:generic/084 6s 2023-10-08T12:15:55.468 INFO:teuthology.orchestra.run.smithi156.stdout:generic/086 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-10-08T12:15:55.909 INFO:teuthology.orchestra.run.smithi156.stdout:generic/087 0s 2023-10-08T12:15:56.248 INFO:teuthology.orchestra.run.smithi156.stdout:generic/088 1s 2023-10-08T12:15:56.599 INFO:teuthology.orchestra.run.smithi156.stdout:generic/090 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-10-08T12:16:05.087 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:16:05.090 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:16:05.092 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:16:35.206 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:16:35.210 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:16:35.212 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:17:05.420 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:17:05.424 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:17:05.426 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:17:35.544 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:17:35.548 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:17:35.553 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:18:05.664 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:18:05.668 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:18:05.670 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:18:17.193 INFO:teuthology.orchestra.run.smithi156.stdout:generic/091 141s 2023-10-08T12:18:17.522 INFO:teuthology.orchestra.run.smithi156.stdout:generic/092 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-10-08T12:18:17.918 INFO:teuthology.orchestra.run.smithi156.stdout:generic/094 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-10-08T12:18:23.572 INFO:teuthology.orchestra.run.smithi156.stdout:generic/096 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-10-08T12:18:24.194 INFO:teuthology.orchestra.run.smithi156.stdout:generic/097 1s 2023-10-08T12:18:25.568 INFO:teuthology.orchestra.run.smithi156.stdout:generic/098 1s 2023-10-08T12:18:27.282 INFO:teuthology.orchestra.run.smithi156.stdout:generic/099 2s 2023-10-08T12:18:27.583 INFO:teuthology.orchestra.run.smithi156.stdout:generic/101 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-10-08T12:18:27.890 INFO:teuthology.orchestra.run.smithi156.stdout:generic/103 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-10-08T12:18:28.227 INFO:teuthology.orchestra.run.smithi156.stdout:generic/104 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-10-08T12:18:28.953 INFO:teuthology.orchestra.run.smithi156.stdout:generic/105 0s 2023-10-08T12:18:29.355 INFO:teuthology.orchestra.run.smithi156.stdout:generic/106 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-10-08T12:18:29.699 INFO:teuthology.orchestra.run.smithi156.stdout:generic/107 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-10-08T12:18:30.244 INFO:teuthology.orchestra.run.smithi156.stdout:generic/108 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-10-08T12:18:30.622 INFO:teuthology.orchestra.run.smithi156.stdout:generic/110 [not run] Reflink not supported by test filesystem type: ceph 2023-10-08T12:18:30.963 INFO:teuthology.orchestra.run.smithi156.stdout:generic/111 [not run] Reflink not supported by test filesystem type: ceph 2023-10-08T12:18:35.804 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:18:35.806 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:18:35.809 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:19:05.990 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:19:05.993 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:19:05.996 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:19:25.085 INFO:teuthology.orchestra.run.smithi156.stdout:generic/112 55s 2023-10-08T12:19:36.074 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:19:36.076 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:19:36.078 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:20:06.411 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:20:06.414 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:20:06.416 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:20:36.512 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:20:36.515 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:20:36.517 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:21:06.733 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:21:06.736 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:21:06.738 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:21:36.809 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:21:36.812 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:21:36.814 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:22:06.927 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:22:06.930 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:22:06.932 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:22:37.006 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:22:37.010 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:22:37.012 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:23:07.589 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:23:07.592 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:23:07.595 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:23:07.808 INFO:tasks.ceph.osd.4.smithi130.stderr:2023-10-08T12:23:07.810+0000 7f8ce5d4a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44447) UID: 0 2023-10-08T12:23:07.808 INFO:tasks.ceph.osd.5.smithi130.stderr:2023-10-08T12:23:07.810+0000 7f24e193c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44447) UID: 0 2023-10-08T12:23:07.808 INFO:tasks.ceph.osd.7.smithi130.stderr:2023-10-08T12:23:07.810+0000 7fbbffffa640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44447) UID: 0 2023-10-08T12:23:07.809 INFO:tasks.ceph.osd.6.smithi130.stderr:2023-10-08T12:23:07.810+0000 7f80d74e9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44447) UID: 0 2023-10-08T12:26:16.273 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:26:16.276 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:26:16.278 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:26:18.436 INFO:tasks.ceph.osd.4.smithi130.stderr:2023-10-08T12:26:18.434+0000 7f8ce5d4a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44461) UID: 0 2023-10-08T12:26:18.437 INFO:tasks.ceph.osd.7.smithi130.stderr:2023-10-08T12:26:18.434+0000 7fbbffffa640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44461) UID: 0 2023-10-08T12:26:18.437 INFO:tasks.ceph.osd.5.smithi130.stderr:2023-10-08T12:26:18.434+0000 7f24e193c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44461) UID: 0 2023-10-08T12:26:18.438 INFO:tasks.ceph.osd.6.smithi130.stderr:2023-10-08T12:26:18.438+0000 7f80d74e9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44461) UID: 0 2023-10-08T12:30:40.522 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:30:40.526 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:30:40.528 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:30:43.885 INFO:tasks.ceph.osd.4.smithi130.stderr:2023-10-08T12:30:43.686+0000 7f8ce5d4a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44471) UID: 0 2023-10-08T12:30:43.885 INFO:tasks.ceph.osd.5.smithi130.stderr:2023-10-08T12:30:43.686+0000 7f24e193c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44471) UID: 0 2023-10-08T12:30:43.886 INFO:tasks.ceph.osd.6.smithi130.stderr:2023-10-08T12:30:43.686+0000 7f80d74e9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44471) UID: 0 2023-10-08T12:30:43.886 INFO:tasks.ceph.osd.7.smithi130.stderr:2023-10-08T12:30:43.686+0000 7fbbffffa640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44471) UID: 0 2023-10-08T14:00:26.443 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:00:26.545 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:00:26.547 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T14:00:28.537 INFO:tasks.ceph.osd.4.smithi130.stderr:2023-10-08T14:00:28.532+0000 7f8ce5d4a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44629) UID: 0 2023-10-08T14:00:28.537 INFO:tasks.ceph.osd.6.smithi130.stderr:2023-10-08T14:00:28.532+0000 7f80d74e9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44629) UID: 0 2023-10-08T14:00:28.538 INFO:tasks.ceph.osd.7.smithi130.stderr:2023-10-08T14:00:28.532+0000 7fbbffffa640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44629) UID: 0 2023-10-08T14:00:28.538 INFO:tasks.ceph.osd.5.smithi130.stderr:2023-10-08T14:00:28.532+0000 7f24e193c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44629) UID: 0 2023-10-08T14:58:40.327 INFO:tasks.ceph.osd.5.smithi130.stderr:problem writing to /var/log/ceph/ceph-osd.5.log: (28) No space left on device 2023-10-08T14:58:40.385 INFO:tasks.ceph.mon.c.smithi130.stderr:problem writing to /var/log/ceph/ceph-mon.c.log: (28) No space left on device 2023-10-08T14:58:40.386 INFO:tasks.ceph.mon.b.smithi130.stderr:problem writing to /var/log/ceph/ceph-mon.b.log: (28) No space left on device 2023-10-08T14:58:40.389 INFO:tasks.ceph.mgr.x.smithi130.stderr:problem writing to /var/log/ceph/ceph-mgr.x.log: (28) No space left on device 2023-10-08T14:58:41.016 INFO:tasks.ceph.osd.6.smithi130.stderr:problem writing to /var/log/ceph/ceph-osd.6.log: (28) No space left on device 2023-10-08T14:58:41.187 INFO:teuthology.orchestra.run.smithi130.stderr:error: Compressing program wrote following message to stderr when compressing log /var/log/ceph/ceph-osd.5.log.1: 2023-10-08T14:58:41.187 INFO:teuthology.orchestra.run.smithi130.stderr: 2023-10-08T14:58:41.188 INFO:teuthology.orchestra.run.smithi130.stderr:gzip: stdout: No space left on device 2023-10-08T14:58:41.269 INFO:tasks.ceph.osd.7.smithi130.stderr:problem writing to /var/log/ceph/ceph-osd.7.log: (28) No space left on device 2023-10-08T14:58:41.306 INFO:tasks.ceph.osd.4.smithi130.stderr:problem writing to /var/log/ceph/ceph-osd.4.log: (28) No space left on device 2023-10-08T14:58:42.637 INFO:teuthology.orchestra.run.smithi130.stderr:error: failed to compress log /var/log/ceph/ceph-osd.5.log.1 2023-10-08T14:58:43.006 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T14:58:43.123 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_ceph-c_7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/qa/tasks/ceph.py", line 188, in invoke_logrotate run.wait(procs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi130 with status 1: 'sudo logrotate /etc/logrotate.d/ceph-test.conf' 2023-10-08T14:58:55.896 INFO:tasks.ceph.osd.5.smithi130.stderr:problem writing to /var/log/ceph/ceph-osd.5.log: (28) No space left on device 2023-10-08T14:58:55.940 INFO:tasks.ceph.mon.c.smithi130.stderr:problem writing to /var/log/ceph/ceph-mon.c.log: (28) No space left on device 2023-10-08T14:58:55.941 INFO:tasks.ceph.mon.b.smithi130.stderr:problem writing to /var/log/ceph/ceph-mon.b.log: (28) No space left on device 2023-10-08T14:58:55.947 INFO:tasks.ceph.osd.4.smithi130.stderr:problem writing to /var/log/ceph/ceph-osd.4.log: (28) No space left on device 2023-10-08T14:58:55.951 INFO:tasks.ceph.osd.6.smithi130.stderr:problem writing to /var/log/ceph/ceph-osd.6.log: (28) No space left on device 2023-10-08T14:58:56.212 INFO:tasks.ceph.osd.7.smithi130.stderr:problem writing to /var/log/ceph/ceph-osd.7.log: (28) No space left on device 2023-10-08T14:58:56.624 INFO:tasks.ceph.mgr.x.smithi130.stderr:problem writing to /var/log/ceph/ceph-mgr.x.log: (28) No space left on device 2023-10-08T14:58:57.110 INFO:tasks.ceph.mds.b.smithi130.stderr:problem writing to /var/log/ceph/ceph-mds.b.log: (28) No space left on device 2023-10-08T15:05:05.379 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/lib/python3.8/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2023-10-08T15:14:03.058 INFO:tasks.ceph.osd.5.smithi130.stderr:problem writing to /var/log/ceph/ceph-osd.5.log: (28) No space left on device 2023-10-08T15:19:25.098 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 699, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/lib/python3.8/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 1361, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 701, in recv raise socket.timeout() socket.timeout 2023-10-08T15:56:28.959 INFO:tasks.ceph.osd.5.smithi130.stderr:problem writing to /var/log/ceph/ceph-osd.5.log: (28) No space left on device 2023-10-08T18:31:13.194 INFO:tasks.ceph.osd.5.smithi130.stderr:problem writing to /var/log/ceph/ceph-osd.5.log: (28) No space left on device 2023-10-08T23:45:42.425 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2023-10-08T23:45:42.450 DEBUG:teuthology.task.console_log:Killing console logger for smithi062 2023-10-08T23:45:42.451 DEBUG:teuthology.task.console_log:Killing console logger for smithi130 2023-10-08T23:45:42.451 DEBUG:teuthology.task.console_log:Killing console logger for smithi156 2023-10-08T23:45:42.451 DEBUG:teuthology.exit:Finished running handlers